-- Logs begin at Sat 2022-10-15 13:10:14 UTC, end at Sat 2022-10-15 14:11:29 UTC. -- Oct 15 13:39:57.136263 dv-cinder-861491-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Oct 15 13:39:57.145882 dv-cinder-861491-3-iscsi devstack@n-api.service[110191]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 15 13:39:57.147966 dv-cinder-861491-3-iscsi devstack@n-api.service[110191]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Oct 15 13:39:57 2022] *** Oct 15 13:39:57.147966 dv-cinder-861491-3-iscsi devstack@n-api.service[110191]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 15 13:39:57.147966 dv-cinder-861491-3-iscsi devstack@n-api.service[110191]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 15 13:39:57.147966 dv-cinder-861491-3-iscsi devstack@n-api.service[110191]: nodename: dv-cinder-861491-3-iscsi Oct 15 13:39:57.147966 dv-cinder-861491-3-iscsi devstack@n-api.service[110191]: machine: x86_64 Oct 15 13:39:57.147966 dv-cinder-861491-3-iscsi devstack@n-api.service[110191]: clock source: unix Oct 15 13:39:57.147966 dv-cinder-861491-3-iscsi devstack@n-api.service[110191]: pcre jit disabled Oct 15 13:39:57.147966 dv-cinder-861491-3-iscsi devstack@n-api.service[110191]: detected number of CPU cores: 4 Oct 15 13:39:57.147966 dv-cinder-861491-3-iscsi devstack@n-api.service[110191]: current working directory: / Oct 15 13:39:57.147966 dv-cinder-861491-3-iscsi devstack@n-api.service[110191]: detected binary path: /usr/bin/uwsgi-core Oct 15 13:39:57.147966 dv-cinder-861491-3-iscsi devstack@n-api.service[110191]: your processes number limit is 47680 Oct 15 13:39:57.147966 dv-cinder-861491-3-iscsi devstack@n-api.service[110191]: your memory page size is 4096 bytes Oct 15 13:39:57.147966 dv-cinder-861491-3-iscsi devstack@n-api.service[110191]: detected max file descriptor number: 2048 Oct 15 13:39:57.147966 dv-cinder-861491-3-iscsi devstack@n-api.service[110191]: lock engine: pthread robust mutexes Oct 15 13:39:57.148791 dv-cinder-861491-3-iscsi devstack@n-api.service[110191]: thunder lock: enabled Oct 15 13:39:57.148791 dv-cinder-861491-3-iscsi devstack@n-api.service[110191]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 15 13:39:57.148791 dv-cinder-861491-3-iscsi devstack@n-api.service[110191]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 15 13:39:57.187100 dv-cinder-861491-3-iscsi devstack@n-api.service[110191]: Python main interpreter initialized at 0x56081a8b39c0 Oct 15 13:39:57.187100 dv-cinder-861491-3-iscsi devstack@n-api.service[110191]: python threads support enabled Oct 15 13:39:57.187100 dv-cinder-861491-3-iscsi devstack@n-api.service[110191]: your server socket listen backlog is limited to 100 connections Oct 15 13:39:57.187100 dv-cinder-861491-3-iscsi devstack@n-api.service[110191]: your mercy for graceful operations on workers is 90 seconds Oct 15 13:39:57.187563 dv-cinder-861491-3-iscsi devstack@n-api.service[110191]: mapped 403077 bytes (393 KB) for 2 cores Oct 15 13:39:57.187563 dv-cinder-861491-3-iscsi devstack@n-api.service[110191]: *** Operational MODE: preforking *** Oct 15 13:39:57.187846 dv-cinder-861491-3-iscsi devstack@n-api.service[110191]: *** uWSGI is running in multiple interpreter mode *** Oct 15 13:39:57.187846 dv-cinder-861491-3-iscsi devstack@n-api.service[110191]: spawned uWSGI master process (pid: 110191) Oct 15 13:39:57.188051 dv-cinder-861491-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Oct 15 13:39:57.189183 dv-cinder-861491-3-iscsi devstack@n-api.service[110191]: spawned uWSGI worker 1 (pid: 110192, cores: 1) Oct 15 13:39:57.189183 dv-cinder-861491-3-iscsi devstack@n-api.service[110191]: spawned uWSGI worker 2 (pid: 110193, cores: 1) Oct 15 13:39:57.189183 dv-cinder-861491-3-iscsi devstack@n-api.service[110191]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 15 13:39:57.849042 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 15 13:39:57.855336 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 15 13:39:58.934104 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 15 13:39:58.934104 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: from cryptography.utils import int_from_bytes Oct 15 13:39:58.934738 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 15 13:39:58.934738 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: from cryptography.utils import int_from_bytes Oct 15 13:39:58.950498 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 15 13:39:58.950498 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: from cryptography.utils import int_from_bytes Oct 15 13:39:58.951108 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 15 13:39:58.951108 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: from cryptography.utils import int_from_bytes Oct 15 13:40:01.435139 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 15 13:40:01.435748 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 15 13:40:01.435968 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 15 13:40:01.436341 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 15 13:40:01.436596 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 15 13:40:01.436940 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 15 13:40:01.437298 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.437472 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 15 13:40:01.437554 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.437637 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.437773 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 15 13:40:01.437914 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.438108 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 15 13:40:01.438232 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.438345 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 15 13:40:01.438551 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.438735 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.438874 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.439059 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.439198 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.439382 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.439529 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.439706 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.439819 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.440061 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.440157 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.440370 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.440509 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-861491-3-iscsi {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.440801 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.440941 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.441263 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.441401 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.441610 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.441789 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.441918 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.442125 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.442251 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.442434 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.442555 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-861491-3-iscsi {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.442763 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.442898 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.443074 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.443202 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.443447 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.443566 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.443769 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.444061 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.444182 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.444374 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.444483 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.444690 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.444811 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.445033 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.445181 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.445352 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.445501 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.445667 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.445809 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.446000 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.446126 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.446299 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.446442 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.446629 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.446751 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.446942 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.447066 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.447357 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.447497 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-861491-3-iscsi {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.447664 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.447791 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.448008 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.448129 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.448316 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.448444 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.448717 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-861491-3-iscsi {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.448841 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.449028 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.449169 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.449336 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.449472 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.449630 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.449770 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.449981 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.450109 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.450285 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.450450 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.450587 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.450722 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.450906 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.451034 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.451232 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.451380 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.451534 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.451655 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.451842 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.451979 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.452188 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.452320 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.452501 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.452622 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.452817 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.452937 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.453120 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.453272 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.453428 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.453547 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.453675 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.453795 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.453979 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.454124 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.454305 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.454461 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.454621 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.454751 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.454882 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.455007 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.455161 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.455293 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.455443 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.455563 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.455729 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.455863 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.456085 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.456250 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.456434 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.456605 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.456738 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.456843 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.457006 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.457316 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.457439 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.457623 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.457745 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.457930 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.458369 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.458492 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.458620 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.458760 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.458961 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.459123 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.459248 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.459366 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.459492 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.459492 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.459726 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.459844 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.460002 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.460216 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.460379 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.460379 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.460679 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.36 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.460799 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.460927 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.36 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.461046 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.461189 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.461326 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.461450 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.461608 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.461737 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.461928 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.462061 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.36 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.462246 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.36 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.462365 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.462557 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.462676 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.462863 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.462983 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.463173 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.463292 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.463487 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.463659 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.463887 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.464023 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.464144 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.464261 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.464428 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.464549 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.464675 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.464791 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.464971 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.465123 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.465280 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.465410 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.465601 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.465721 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.465910 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.466031 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.466193 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.466314 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.466461 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.466583 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.466767 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.466888 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.467087 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.467221 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.467391 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.467510 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.467695 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.467814 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.468026 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.468158 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.468315 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.468457 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.468617 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.468736 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.468919 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.469155 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.469290 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.469407 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.469524 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.469641 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.469803 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.469943 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.470090 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.470228 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.470424 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.470589 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.470766 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.470891 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.471015 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.471134 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.471261 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.471379 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.471555 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.471671 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.471942 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.472079 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.472255 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.472377 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.472591 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.472735 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.472917 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.473228 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.473354 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.473536 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.473739 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.473878 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.474017 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.474185 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.474310 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.474427 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.474553 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.474747 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.474871 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.475048 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.475188 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.475358 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.475495 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.475676 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.475796 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.476007 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.476139 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.476308 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.476432 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.476611 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.476730 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.476910 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.477029 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.477213 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.477336 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.477519 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.477649 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.477821 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.477947 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.478123 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.478244 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.478423 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.478544 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.478726 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.478853 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.479030 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.479255 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.479376 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.479493 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.479610 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.479735 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.479925 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.480066 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.480228 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.480348 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.480567 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.480757 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.480943 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.481076 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.481215 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.481334 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.481452 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.481607 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.481773 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.481939 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.482102 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:40:01.482270 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.482446 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.482644 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.482845 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.483019 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.483199 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.483372 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.483557 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.483730 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.484006 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.484177 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.484342 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.484508 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.484692 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.484874 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.485040 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.485216 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.485382 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.485547 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.485721 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.485889 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.486071 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.486806 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.486998 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.487170 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.487354 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.487559 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.487714 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.487864 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.488087 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.488254 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.488433 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.488600 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.488776 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.488944 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.489113 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.489305 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.489305 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.489776 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.489954 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.490138 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.490330 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.490513 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.490853 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.491034 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.491210 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.491381 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.491556 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.491741 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.491927 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.492080 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.492249 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.492415 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.492582 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.492777 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.492955 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.493129 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.493295 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.493459 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.493648 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.493858 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.494041 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.494208 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.494380 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.494553 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.494735 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.494914 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.495081 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.495252 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.495421 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.495588 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.495767 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.496013 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.496183 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.496349 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.496530 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.496779 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.496977 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.497164 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.497338 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.497510 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.497694 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.497866 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.498046 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.498214 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.498392 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.498561 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.498736 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.498902 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.499081 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.499248 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.499416 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.499608 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.499950 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.500177 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.500354 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.500533 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.500717 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.501061 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.501393 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.501580 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.501752 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.501919 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.502086 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.502245 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.502412 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.502591 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.502767 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.502942 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.503155 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.503364 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.503535 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.503703 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.503833 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.503983 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.504111 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.504236 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.504377 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.504500 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.504621 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.504742 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.504875 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.505001 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.505136 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.505261 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.505378 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.505485 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.505607 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.505733 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.505866 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.505988 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.506208 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.506353 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.506515 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.506647 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.506898 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.506898 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.507125 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.507306 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.507476 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.507694 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.507863 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.508118 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.508286 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.508455 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.508640 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.508826 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.508997 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.509174 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.509364 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.509556 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.509730 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.509935 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.510255 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.510471 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.510641 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.510820 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.511009 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.511327 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.511498 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.511668 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.511832 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.512019 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.512227 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.512427 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.512610 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.512782 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.512964 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.513143 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.513334 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.513502 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.513679 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.513858 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.514024 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.514202 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.514380 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.514550 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.514717 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.514883 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.515059 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.515245 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.515452 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.515626 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.515808 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.516077 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.516264 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.516445 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.516623 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.516793 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.517044 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.517229 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.517383 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.517564 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.517731 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.517898 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.518075 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.518273 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.518454 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.518770 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.518978 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.519448 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.519622 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.519789 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.519977 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.519977 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.520479 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.520650 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.520816 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.520980 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.521160 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.521526 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.521717 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.521889 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.522060 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.522252 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.522440 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.522600 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.522766 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.522766 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.523079 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.523246 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.523424 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.523603 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.523781 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.524043 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.524210 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.524389 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.524588 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.524771 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.524969 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.525164 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.525357 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.525548 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.525751 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.525944 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.526136 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.526331 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.526525 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.526801 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.526990 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.527288 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.527465 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.527636 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.527809 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.528022 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.528212 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.528379 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.528555 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.528721 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.528900 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.528900 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.529258 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.529427 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.529594 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.529762 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.529762 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.529762 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.530248 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.530482 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.530793 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.530972 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.531158 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.531331 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.531518 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.531815 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.532009 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.532179 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.532367 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.532539 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.532709 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.532880 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.533065 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.533268 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.533457 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.533631 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.533804 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.533992 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.534166 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.534365 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.534573 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.534747 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.534916 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.535089 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.535272 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.535454 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.535631 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.535801 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.536060 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.536239 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.536411 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.536603 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.536789 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.536960 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.537194 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.537368 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.537558 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.537730 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.537901 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.538079 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.538259 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.538426 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.538616 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.538830 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.539008 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.539179 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.539355 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.539529 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.539708 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.539924 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.540096 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.540267 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.540437 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.540621 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.540819 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.541101 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.541280 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.541460 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.541662 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.541969 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.542165 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.542341 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.542532 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.542700 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.542861 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.543032 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.543032 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.543364 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.543535 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.543712 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.543949 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.544122 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.544385 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.544584 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.544759 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.544944 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.544944 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.545294 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.545473 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.545645 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.545814 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.545992 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.546161 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.546347 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.546517 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.546686 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.546852 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.547031 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.547310 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.547511 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.547687 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.547857 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.548057 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.548240 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.548412 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.548593 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.548764 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.548934 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.549105 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.549279 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.549457 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.549637 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.549816 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.550039 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.550228 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.550413 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.550608 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.550788 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.550974 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.551295 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.551484 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.551682 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.551865 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.552200 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.552385 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.552566 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.552744 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.552915 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.553089 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.553262 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.553452 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.553651 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.553827 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.554121 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.554310 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.554482 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.554663 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.554842 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.555020 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.555220 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.555220 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.555555 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.555726 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.555930 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.556101 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.556287 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.556478 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.556666 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.556666 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.557030 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.557228 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.557463 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.557647 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.557817 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.557987 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.558157 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.558329 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.558498 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.558687 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.558874 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.559391 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.559580 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.559754 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.560085 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.560261 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.560450 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.560621 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.560803 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.560973 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.561155 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.561446 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.561629 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.561812 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.561996 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.562231 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.562509 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.562698 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.562873 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.563045 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.563206 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.563376 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.563548 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.563735 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.563930 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.564117 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.564290 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.564455 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.564455 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.564826 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.565010 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.565186 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.565361 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.565538 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.565781 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.565979 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.566151 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.566321 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.566492 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.566665 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.566845 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.567027 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.567198 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.567367 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.567581 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.567776 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.568006 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.568183 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.568359 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.568533 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.568533 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.568855 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.568855 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.569200 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.569373 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.569549 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.569720 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.569900 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.570082 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.570248 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.570440 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.570638 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.570827 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.571012 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.571189 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.571362 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.571637 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.571820 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.572064 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.572253 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.572424 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.572699 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.572881 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.573061 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.573285 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.573483 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.573658 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.573832 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.574010 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.574192 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.574363 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.574543 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.574724 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.574903 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.575089 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.575267 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.575449 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.575626 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.575808 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.576024 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.576215 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.576390 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.576577 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.576750 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.576927 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.577116 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.577289 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.577460 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.577682 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.577854 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.578025 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.578193 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.578363 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.578548 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.578770 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.578947 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.579133 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.579311 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.579485 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.579670 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.579840 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.580051 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.580241 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.580512 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.580686 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.580873 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.580873 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.581229 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.581453 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.581653 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.581917 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.582123 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.582304 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.582481 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.582680 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.582959 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.582959 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.583564 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.583749 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.583749 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.584117 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.584315 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.584519 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.584705 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.584883 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.585062 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.585237 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.585407 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.585590 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.585762 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.585931 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.586112 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.586290 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.586462 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.586646 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.586817 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.587020 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.587205 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.587376 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.587550 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.587791 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.588126 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.588308 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.588490 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.588663 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.588845 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.589016 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.589192 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.589361 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.589533 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.589725 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.589928 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.590116 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.590297 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.590480 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.590664 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.590858 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.591049 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.591238 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.591421 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.591609 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.591609 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.592037 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.592245 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.592417 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.592585 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.592775 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.592992 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.593283 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.593465 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.593639 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.593818 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.593998 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.594173 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.594360 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.594540 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.594719 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.594905 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.595087 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.595087 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.595430 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.595608 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.595782 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.596028 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.596208 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.596384 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.596581 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.596766 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.596996 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.597178 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.597363 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.597553 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.597786 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.597979 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.598158 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.598158 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.598491 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.598682 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.598856 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.599036 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.599209 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.599376 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.599544 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.599730 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.599938 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.600120 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.600300 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.600300 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.600643 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.600849 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.601033 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.601217 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.601422 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.601422 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.601806 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.601955 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.602086 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.602218 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.602348 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.602348 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.602601 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.602738 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.602863 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.603005 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.603147 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.603318 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.603318 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.603567 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.603567 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.604053 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.604230 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.604425 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.604619 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.604792 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.604975 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.605163 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.605353 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.605534 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.605728 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.605924 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.606118 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.606311 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.606493 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.606679 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.606851 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.607022 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.607202 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.607375 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.607556 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.607756 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.608012 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.608208 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.608402 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.608595 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.608786 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.608998 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.609195 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.609395 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.609587 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.609778 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.609967 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.610160 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.610346 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.610527 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.610706 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.610887 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.611092 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.611624 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.611808 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.612051 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.612244 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.612428 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.612658 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.612830 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.613008 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.613193 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.613387 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.613580 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.613811 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.614115 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.614314 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.614504 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.614695 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.614892 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.615091 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.615284 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.615476 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.615668 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.615896 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.616117 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.616311 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.616514 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.616707 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.616883 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.617057 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.617057 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.617404 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.617598 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.617791 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.618038 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.618219 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.618219 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.618706 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.618891 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.619097 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.619293 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.619526 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.619716 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.619964 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.620178 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.620365 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.620547 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.620729 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.620924 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.621111 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.621319 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.621506 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.621691 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.621885 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.622079 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.622284 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.622471 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.622471 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.622833 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.623018 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.623195 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.623384 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.623563 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.623739 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.623939 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.623939 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.624412 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.624622 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.624809 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.624997 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.625183 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.625387 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.625595 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.625782 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.625982 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.626175 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.626370 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.626561 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.626826 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.626826 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.627171 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.627353 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.627547 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.627738 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.627953 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.628248 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.628444 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.628635 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.628811 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.628986 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.629176 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.629377 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.629571 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.629759 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.629952 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.630159 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.630351 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.630537 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.630731 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.630925 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.631103 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.631390 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.631585 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.631792 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.631990 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.632184 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.632375 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.632578 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.632785 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.632986 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.633182 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.633382 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.633568 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.633768 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.633958 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.634142 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.634326 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.634635 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.634828 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.635038 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.635224 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.635409 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.635601 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.635795 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.636102 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.636288 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.636480 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.636672 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.636865 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.636865 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.637243 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.637438 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.637635 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.637822 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.638008 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.638251 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.638445 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.638641 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.638833 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.639029 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.639238 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.639442 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.639626 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.639813 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.640012 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.640206 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.640399 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.640607 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.640795 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.640974 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.641177 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.641360 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.641546 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.641546 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.641917 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.642102 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.642291 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.642483 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.642669 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.643119 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.643314 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.643507 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.643727 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.643959 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.644161 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.644340 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.644592 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.644900 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.645091 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.645285 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.645491 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.645673 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.645861 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.646057 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.646253 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.646443 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.646647 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.646833 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.647015 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.647206 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.647403 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.647597 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.647813 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.648048 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.648226 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.648374 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.648520 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.648676 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.648820 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.648983 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.649123 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.649263 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.649405 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.649581 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.649730 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.649868 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.650021 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.650159 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.650293 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.650450 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.650590 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.650725 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.650873 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.651014 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.651153 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.651305 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.651441 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.651581 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.651718 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.651852 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.652028 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.652153 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.652274 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.652274 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.652493 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.652619 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.652752 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.652874 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.653001 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.653124 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.653247 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.653369 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.653501 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.653624 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.653755 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.653877 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.653997 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.653997 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.654265 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.654387 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.654536 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.654660 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.654780 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.654913 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.655033 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.655153 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.655275 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.655396 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.655517 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.655651 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.655772 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.655918 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.656042 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.656042 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.656261 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.656408 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.656532 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.656672 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.656797 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.656917 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.657059 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.657183 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.657306 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.657306 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.657531 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.657652 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.657787 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.657922 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.658045 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.658167 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.658290 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.658430 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.658573 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.658700 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.658830 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.658947 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.659066 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.659207 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.659524 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.659654 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.659783 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.660307 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.660473 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.660613 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.660737 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.660871 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.660991 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.661114 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.661245 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.661368 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.661493 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.661623 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.661750 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.661870 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.662107 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.662239 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.662360 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.662503 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.662653 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.662786 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.662934 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.662934 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.663183 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.663322 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.663467 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.663615 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.663762 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.663940 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.664161 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.664301 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.664488 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.664640 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.664840 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.664986 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.665163 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.665163 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.665414 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.665560 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.665690 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.665823 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.665955 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.666103 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.666257 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.666399 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.666549 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.666686 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.666843 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.666986 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.667139 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.667280 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.667417 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.667554 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.667703 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.667840 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.668025 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.668175 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.668311 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.668311 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.668576 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.668725 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.668884 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.669021 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.669150 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.669274 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.669404 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.669553 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.669692 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.669840 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.669978 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.670118 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.670252 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.670252 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.670518 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.670665 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.670802 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.670948 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.671100 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.671258 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.671403 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.671545 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.671545 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.671797 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.672055 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.672203 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.672335 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.672542 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.672689 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.672824 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.672966 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.673116 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.673258 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.673413 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.673558 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.673696 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.673857 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.673996 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.674132 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.674270 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.674407 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.674542 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.674705 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.674851 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.675080 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.675204 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.675407 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.675550 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.675731 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.675942 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.676090 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.676216 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.676337 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.676479 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.676621 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.676769 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.676905 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.677107 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.677260 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.677417 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.677560 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.677698 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.677842 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.677985 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.678125 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.678283 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.678418 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.678561 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.678700 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.678840 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.678980 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.679129 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.679273 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.679404 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.679530 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.679657 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.679783 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.679991 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.680121 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.680250 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.680396 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.680527 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.680671 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.680804 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.680933 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.681061 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.681061 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.681305 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.681451 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.681586 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.681725 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.681884 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.682027 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.682027 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.682302 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.682452 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.682595 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.682595 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.682872 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.683029 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.683167 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.683310 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.683471 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.683614 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.683758 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.683938 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.683938 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.684207 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.684349 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.684487 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.684644 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.684862 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.685062 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.685278 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.685430 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.685573 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.685715 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.685871 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.686017 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.686162 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.686304 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.686450 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.686608 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.686608 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.686858 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.686998 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.687141 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.687284 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.687440 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.687581 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.687717 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.687865 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.688045 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.688185 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.688355 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.688501 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.688645 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.688789 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.688932 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.689189 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.689343 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.689485 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.689622 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.689760 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.689962 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.690105 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.690240 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.690369 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.690497 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.690774 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.690907 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.691050 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.691181 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.691312 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.691445 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.691580 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.691715 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.691836 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.692053 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.692178 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.692293 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.692416 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.692544 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.692544 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.692544 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.692857 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.692982 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.693109 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.693247 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.693364 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.693480 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.693597 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.693720 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.693848 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.693970 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.694087 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.694210 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.694328 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.694448 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.694577 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.694577 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.694805 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.694906 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.695022 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.695190 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.695318 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.695434 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.695547 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.695659 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.695771 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.696026 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.696151 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.696268 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.696385 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.696501 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.696616 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.696745 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.696863 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.696981 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.697098 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.697223 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.697340 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.697468 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.697468 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.697685 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.697811 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.697928 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.698045 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.698180 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.698301 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.698419 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.698537 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.698658 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.698788 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.698909 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.699027 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.699144 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.699261 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.699261 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.699495 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.699624 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.699742 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.699860 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.700049 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.700175 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.700311 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.700434 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.700552 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.700670 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.700784 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.700909 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.701025 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.701142 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.701261 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.701376 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.701490 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.701694 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.701865 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.701988 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.702108 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.702228 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.702345 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.702475 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.702591 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.702704 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.702830 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.702946 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.703062 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.703187 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.703312 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.703431 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.703549 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.703667 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.703795 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.703940 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.704062 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.704062 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.704278 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.704414 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.704545 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.704660 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.704775 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.704889 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.705059 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.705194 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.705351 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.705487 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.705631 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.705763 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.705894 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.706030 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.706295 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.706451 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.706591 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.706735 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.706881 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.706881 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.707172 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.707172 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.707443 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.707586 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.707730 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.708016 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.708154 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.708154 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.708439 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.708439 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.708713 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.708871 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.709012 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.709154 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.709299 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.709443 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.709584 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.709736 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.709879 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.710021 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.710225 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.710379 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.710534 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.710680 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.710823 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.710969 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.711109 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.711253 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.711418 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.711418 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.711676 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.711832 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.712070 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.712209 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.712366 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.712513 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.712667 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.712815 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.712947 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.712947 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.713217 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.713354 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.713509 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.713509 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.713796 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.714061 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.714218 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.714359 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.714498 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.714641 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.714781 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.714939 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.715084 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.715206 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.715420 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.715563 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.715715 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.715979 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.716178 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.716323 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.716482 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.716625 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.716788 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.716931 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 15 13:40:01.717075 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.717075 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.717075 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.717075 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.717075 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.717075 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.717075 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.717075 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.718083 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.718083 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:40:01.718083 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 15 13:40:01.852619 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: INFO dbcounter [None req-7fe0fd64-43de-4f19-b12a-4f498d8f036a None None] Registered counter for database nova_api Oct 15 13:40:01.857927 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: INFO dbcounter [None req-ddfa1688-85f0-4205-8459-26fabbf271b6 None None] Registered counter for database nova_api Oct 15 13:40:01.877290 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG oslo_db.sqlalchemy.engines [None req-7fe0fd64-43de-4f19-b12a-4f498d8f036a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110193) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 15 13:40:01.879810 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG oslo_db.sqlalchemy.engines [None req-ddfa1688-85f0-4205-8459-26fabbf271b6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110192) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 15 13:40:01.885236 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG dbcounter [-] [110193] Writer thread running {{(pid=110193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 15 13:40:01.887069 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG dbcounter [-] [110192] Writer thread running {{(pid=110192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 15 13:40:01.943632 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.context [None req-7fe0fd64-43de-4f19-b12a-4f498d8f036a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),7dc09bc6-d873-4fce-bdea-89bf85d4cbce(cell1) {{(pid=110193) load_cells /opt/stack/nova/nova/context.py:464}} Oct 15 13:40:01.946143 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.context [None req-ddfa1688-85f0-4205-8459-26fabbf271b6 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),7dc09bc6-d873-4fce-bdea-89bf85d4cbce(cell1) {{(pid=110192) load_cells /opt/stack/nova/nova/context.py:464}} Oct 15 13:40:01.947591 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG oslo_concurrency.lockutils [None req-7fe0fd64-43de-4f19-b12a-4f498d8f036a None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:40:01.948117 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG oslo_concurrency.lockutils [None req-7fe0fd64-43de-4f19-b12a-4f498d8f036a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=110193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:40:01.949739 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG oslo_concurrency.lockutils [None req-7fe0fd64-43de-4f19-b12a-4f498d8f036a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:40:01.950070 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG oslo_concurrency.lockutils [None req-ddfa1688-85f0-4205-8459-26fabbf271b6 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:40:01.950491 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG oslo_concurrency.lockutils [None req-7fe0fd64-43de-4f19-b12a-4f498d8f036a None None] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:40:01.950682 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG oslo_concurrency.lockutils [None req-ddfa1688-85f0-4205-8459-26fabbf271b6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=110192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:40:01.950940 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG oslo_concurrency.lockutils [None req-7fe0fd64-43de-4f19-b12a-4f498d8f036a None None] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:40:01.952165 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG oslo_concurrency.lockutils [None req-ddfa1688-85f0-4205-8459-26fabbf271b6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:40:01.952904 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG oslo_concurrency.lockutils [None req-ddfa1688-85f0-4205-8459-26fabbf271b6 None None] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:40:01.953067 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG oslo_concurrency.lockutils [None req-7fe0fd64-43de-4f19-b12a-4f498d8f036a None None] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:40:01.953326 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG oslo_concurrency.lockutils [None req-ddfa1688-85f0-4205-8459-26fabbf271b6 None None] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:40:01.955041 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: INFO dbcounter [None req-7fe0fd64-43de-4f19-b12a-4f498d8f036a None None] Registered counter for database nova_cell0 Oct 15 13:40:01.955380 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG oslo_concurrency.lockutils [None req-ddfa1688-85f0-4205-8459-26fabbf271b6 None None] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:40:01.957811 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: INFO dbcounter [None req-ddfa1688-85f0-4205-8459-26fabbf271b6 None None] Registered counter for database nova_cell0 Oct 15 13:40:01.959598 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: INFO dbcounter [None req-7fe0fd64-43de-4f19-b12a-4f498d8f036a None None] Registered counter for database nova_cell1 Oct 15 13:40:01.962113 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: INFO dbcounter [None req-ddfa1688-85f0-4205-8459-26fabbf271b6 None None] Registered counter for database nova_cell1 Oct 15 13:40:01.967981 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG oslo_db.sqlalchemy.engines [None req-7fe0fd64-43de-4f19-b12a-4f498d8f036a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110193) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 15 13:40:01.969078 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG oslo_db.sqlalchemy.engines [None req-7fe0fd64-43de-4f19-b12a-4f498d8f036a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110193) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 15 13:40:01.971777 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG oslo_db.sqlalchemy.engines [None req-ddfa1688-85f0-4205-8459-26fabbf271b6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110192) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 15 13:40:01.976267 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG dbcounter [-] [110193] Writer thread running {{(pid=110193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 15 13:40:01.976926 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG oslo_db.sqlalchemy.engines [None req-ddfa1688-85f0-4205-8459-26fabbf271b6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110192) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 15 13:40:01.979002 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG dbcounter [-] [110192] Writer thread running {{(pid=110192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 15 13:40:01.982345 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG dbcounter [-] [110193] Writer thread running {{(pid=110193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 15 13:40:02.126275 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG dbcounter [-] [110192] Writer thread running {{(pid=110192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 15 13:40:02.136049 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: INFO dbcounter [None req-7fe0fd64-43de-4f19-b12a-4f498d8f036a None None] Registered counter for database nova_cell0 Oct 15 13:40:02.137912 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: INFO dbcounter [None req-ddfa1688-85f0-4205-8459-26fabbf271b6 None None] Registered counter for database nova_cell0 Oct 15 13:40:02.149183 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG oslo_db.sqlalchemy.engines [None req-7fe0fd64-43de-4f19-b12a-4f498d8f036a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110193) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 15 13:40:02.152917 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG oslo_db.sqlalchemy.engines [None req-ddfa1688-85f0-4205-8459-26fabbf271b6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110192) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 15 13:40:02.156020 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG dbcounter [-] [110193] Writer thread running {{(pid=110193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 15 13:40:02.161472 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG dbcounter [-] [110192] Writer thread running {{(pid=110192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 15 13:40:02.508652 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: WARNING keystonemiddleware.auth_token [None req-7fe0fd64-43de-4f19-b12a-4f498d8f036a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 15 13:40:02.516269 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: WARNING keystonemiddleware.auth_token [None req-7fe0fd64-43de-4f19-b12a-4f498d8f036a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 15 13:40:02.559483 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: WARNING keystonemiddleware.auth_token [None req-ddfa1688-85f0-4205-8459-26fabbf271b6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 15 13:40:02.567368 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: WARNING keystonemiddleware.auth_token [None req-ddfa1688-85f0-4205-8459-26fabbf271b6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 15 13:40:02.871153 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: WARNING keystonemiddleware.auth_token [None req-7fe0fd64-43de-4f19-b12a-4f498d8f036a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 15 13:40:02.877255 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: WARNING keystonemiddleware.auth_token [None req-7fe0fd64-43de-4f19-b12a-4f498d8f036a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 15 13:40:02.883048 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x56081a8b39c0 pid: 110193 (default app) Oct 15 13:40:02.885225 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi [None req-7fe0fd64-43de-4f19-b12a-4f498d8f036a None None] Calling method '>' {{(pid=110193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:40:02.886435 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: INFO nova.api.openstack.requestlog [None req-7fe0fd64-43de-4f19-b12a-4f498d8f036a None None] 10.222.0.36 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001819 Oct 15 13:40:02.887241 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: [pid: 110193|app: 0|req: 1/1] 10.222.0.36 () {50 vars in 788 bytes} [Sat Oct 15 13:40:02 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 13:40:02.914238 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: WARNING keystonemiddleware.auth_token [None req-ddfa1688-85f0-4205-8459-26fabbf271b6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 15 13:40:02.920345 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: WARNING keystonemiddleware.auth_token [None req-ddfa1688-85f0-4205-8459-26fabbf271b6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 15 13:40:02.925795 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x56081a8b39c0 pid: 110192 (default app) Oct 15 13:41:30.580934 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi [None req-7fe0fd64-43de-4f19-b12a-4f498d8f036a None None] Calling method '>' {{(pid=110193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:41:30.581935 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: INFO nova.api.openstack.requestlog [None req-7fe0fd64-43de-4f19-b12a-4f498d8f036a None None] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001767 Oct 15 13:41:30.582565 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: [pid: 110193|app: 0|req: 2/2] 10.222.0.36 () {54 vars in 931 bytes} [Sat Oct 15 13:41:30 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 13:41:30.595398 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG dbcounter [-] [110192] Writing DB stats nova_api:SELECT=3 {{(pid=110192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:41:30.596385 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG dbcounter [-] [110192] Writing DB stats nova_cell0:SELECT=3 {{(pid=110192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:41:30.597544 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG dbcounter [-] [110192] Writing DB stats nova_cell1:SELECT=3 {{(pid=110192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:41:30.598397 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG dbcounter [-] [110192] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=110192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:41:31.809959 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi [None req-8423b2a0-21bc-4326-8d08-9795533c14a8 admin admin] Calling method '>' {{(pid=110192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:41:31.846924 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: INFO nova.api.openstack.requestlog [None req-8423b2a0-21bc-4326-8d08-9795533c14a8 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 1.256816 Oct 15 13:41:31.847750 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: [pid: 110192|app: 0|req: 1/3] 10.222.0.36 () {60 vars in 1292 bytes} [Sat Oct 15 13:41:30 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 1259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:41:35.150304 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi [None req-7fe0fd64-43de-4f19-b12a-4f498d8f036a None None] Calling method '>' {{(pid=110193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:41:35.151299 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: INFO nova.api.openstack.requestlog [None req-7fe0fd64-43de-4f19-b12a-4f498d8f036a None None] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 Oct 15 13:41:35.151691 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: [pid: 110193|app: 0|req: 3/4] 10.222.0.36 () {54 vars in 931 bytes} [Sat Oct 15 13:41:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 13:41:35.643420 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi [None req-0deffb53-915f-4548-a84b-f88f1f6b6bd4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "c1", "rxtx_factor": 1.0, "swap": 0, "disk": 1, "name": "cirros256", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 256, "vcpus": 1, "os-flavor-access:is_public": true}} {{(pid=110192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 13:41:35.694159 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: INFO nova.api.openstack.requestlog [None req-0deffb53-915f-4548-a84b-f88f1f6b6bd4 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.535727 Oct 15 13:41:35.694752 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: [pid: 110192|app: 0|req: 2/5] 10.222.0.36 () {64 vars in 1283 bytes} [Sat Oct 15 13:41:35 2022] POST /compute/v2.1/flavors => generated 407 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 13:41:35.709345 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG dbcounter [-] [110193] Writing DB stats nova_api:SELECT=3 {{(pid=110193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:41:35.710211 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG dbcounter [-] [110193] Writing DB stats nova_cell0:SELECT=3 {{(pid=110193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:41:35.712474 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG dbcounter [-] [110193] Writing DB stats nova_cell1:SELECT=3 {{(pid=110193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:41:35.713277 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG dbcounter [-] [110193] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=110193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:41:35.924431 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi [None req-2368d42c-5cb6-408f-8282-aec5be775044 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 13:41:35.994463 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: INFO nova.api.openstack.requestlog [None req-2368d42c-5cb6-408f-8282-aec5be775044 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.291183 Oct 15 13:41:35.995058 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: [pid: 110193|app: 0|req: 4/6] 10.222.0.36 () {64 vars in 1336 bytes} [Sat Oct 15 13:41:35 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:41:38.728586 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi [None req-0deffb53-915f-4548-a84b-f88f1f6b6bd4 admin admin] Calling method '>' {{(pid=110192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:41:38.729767 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: INFO nova.api.openstack.requestlog [None req-0deffb53-915f-4548-a84b-f88f1f6b6bd4 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001836 Oct 15 13:41:38.730303 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: [pid: 110192|app: 0|req: 3/7] 10.222.0.36 () {54 vars in 931 bytes} [Sat Oct 15 13:41:38 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 13:41:39.448497 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi [None req-5461ed7f-7bad-4058-9de6-18354e9f1404 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds512M", "ram": 512, "vcpus": 1, "id": "d1", "rxtx_factor": 1.0, "disk": 5, "os-flavor-access:is_public": true}} {{(pid=110193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 13:41:39.501063 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: INFO nova.api.openstack.requestlog [None req-5461ed7f-7bad-4058-9de6-18354e9f1404 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.763040 Oct 15 13:41:39.502170 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: [pid: 110193|app: 0|req: 5/8] 10.222.0.36 () {64 vars in 1283 bytes} [Sat Oct 15 13:41:38 2022] POST /compute/v2.1/flavors => generated 404 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 15 13:41:39.538373 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi [None req-a7b82058-ee4e-4e03-a014-e72a01aeca7e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 13:41:39.613771 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: INFO nova.api.openstack.requestlog [None req-a7b82058-ee4e-4e03-a014-e72a01aeca7e admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.098903 Oct 15 13:41:39.615005 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: [pid: 110192|app: 0|req: 4/9] 10.222.0.36 () {64 vars in 1336 bytes} [Sat Oct 15 13:41:39 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 13:41:42.545597 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi [None req-5461ed7f-7bad-4058-9de6-18354e9f1404 admin admin] Calling method '>' {{(pid=110193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:41:42.546627 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: INFO nova.api.openstack.requestlog [None req-5461ed7f-7bad-4058-9de6-18354e9f1404 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001507 Oct 15 13:41:42.547036 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: [pid: 110193|app: 0|req: 6/10] 10.222.0.36 () {54 vars in 931 bytes} [Sat Oct 15 13:41:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 13:41:43.108510 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi [None req-d7a42e63-0232-4f0d-8d40-b2dc14fcc72d admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "os-flavor-access:is_public": true, "name": "ds1G", "ram": 1024, "swap": 0, "rxtx_factor": 1.0, "id": "d2", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10}} {{(pid=110192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 13:41:43.134015 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: INFO nova.api.openstack.requestlog [None req-d7a42e63-0232-4f0d-8d40-b2dc14fcc72d admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.575219 Oct 15 13:41:43.142729 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: [pid: 110192|app: 0|req: 5/11] 10.222.0.36 () {64 vars in 1283 bytes} [Sat Oct 15 13:41:42 2022] POST /compute/v2.1/flavors => generated 404 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 13:41:43.147521 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi [None req-a8059f74-0444-40f7-97ce-6276887f449a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 13:41:43.225595 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: INFO nova.api.openstack.requestlog [None req-a8059f74-0444-40f7-97ce-6276887f449a admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.081545 Oct 15 13:41:43.226591 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: [pid: 110193|app: 0|req: 7/12] 10.222.0.36 () {64 vars in 1336 bytes} [Sat Oct 15 13:41:43 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:41:46.380188 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi [None req-d7a42e63-0232-4f0d-8d40-b2dc14fcc72d admin admin] Calling method '>' {{(pid=110192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:41:46.381950 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: INFO nova.api.openstack.requestlog [None req-d7a42e63-0232-4f0d-8d40-b2dc14fcc72d admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003083 Oct 15 13:41:46.382937 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: [pid: 110192|app: 0|req: 6/13] 10.222.0.36 () {54 vars in 931 bytes} [Sat Oct 15 13:41:46 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 13:41:47.011097 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi [None req-7eb961e3-a8af-4fb5-8a88-fc60bdc9fe40 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d3", "vcpus": 2, "os-flavor-access:is_public": true, "name": "ds2G", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "ram": 2048, "swap": 0}} {{(pid=110193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 13:41:47.039212 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: INFO nova.api.openstack.requestlog [None req-7eb961e3-a8af-4fb5-8a88-fc60bdc9fe40 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.645644 Oct 15 13:41:47.040494 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: [pid: 110193|app: 0|req: 8/14] 10.222.0.36 () {64 vars in 1283 bytes} [Sat Oct 15 13:41:46 2022] POST /compute/v2.1/flavors => generated 404 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 13:41:47.054576 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi [None req-48adf403-2da6-49b0-b1ae-6d6d44b86048 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 13:41:47.087792 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: INFO nova.api.openstack.requestlog [None req-48adf403-2da6-49b0-b1ae-6d6d44b86048 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037104 Oct 15 13:41:47.089308 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: [pid: 110192|app: 0|req: 7/15] 10.222.0.36 () {64 vars in 1336 bytes} [Sat Oct 15 13:41:47 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 13:41:50.389241 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi [None req-7eb961e3-a8af-4fb5-8a88-fc60bdc9fe40 admin admin] Calling method '>' {{(pid=110193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:41:50.390220 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: INFO nova.api.openstack.requestlog [None req-7eb961e3-a8af-4fb5-8a88-fc60bdc9fe40 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001584 Oct 15 13:41:50.390644 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: [pid: 110193|app: 0|req: 9/16] 10.222.0.36 () {54 vars in 931 bytes} [Sat Oct 15 13:41:50 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 15 13:41:50.964366 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi [None req-72c34900-6be7-4d0a-99b1-61dd8d89d264 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "swap": 0, "name": "ds4G", "id": "d4", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "rxtx_factor": 1.0, "disk": 20, "os-flavor-access:is_public": true}} {{(pid=110192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 13:41:50.996595 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: INFO nova.api.openstack.requestlog [None req-72c34900-6be7-4d0a-99b1-61dd8d89d264 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.595358 Oct 15 13:41:50.997694 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: [pid: 110192|app: 0|req: 8/17] 10.222.0.36 () {64 vars in 1283 bytes} [Sat Oct 15 13:41:50 2022] POST /compute/v2.1/flavors => generated 404 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 13:41:51.015344 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi [None req-9ac2862a-4010-437e-969a-e8b852589554 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 13:41:51.059111 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: INFO nova.api.openstack.requestlog [None req-9ac2862a-4010-437e-969a-e8b852589554 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.050612 Oct 15 13:41:51.060354 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: [pid: 110193|app: 0|req: 10/18] 10.222.0.36 () {64 vars in 1336 bytes} [Sat Oct 15 13:41:51 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:41:54.157695 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi [None req-72c34900-6be7-4d0a-99b1-61dd8d89d264 admin admin] Calling method '>' {{(pid=110192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:41:54.158649 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: INFO nova.api.openstack.requestlog [None req-72c34900-6be7-4d0a-99b1-61dd8d89d264 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001507 Oct 15 13:41:54.159013 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: [pid: 110192|app: 0|req: 9/19] 10.222.0.36 () {54 vars in 931 bytes} [Sat Oct 15 13:41:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 13:41:54.705760 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi [None req-65e2a765-ac71-44fc-a4bc-091d41133251 admin admin] Calling method '>' {{(pid=110193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:41:54.732019 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: INFO nova.api.openstack.requestlog [None req-65e2a765-ac71-44fc-a4bc-091d41133251 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.561652 Oct 15 13:41:54.732439 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: [pid: 110193|app: 0|req: 11/20] 10.222.0.36 () {60 vars in 1292 bytes} [Sat Oct 15 13:41:54 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 13:41:57.332049 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi [None req-72c34900-6be7-4d0a-99b1-61dd8d89d264 admin admin] Calling method '>' {{(pid=110192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:41:57.333057 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: INFO nova.api.openstack.requestlog [None req-72c34900-6be7-4d0a-99b1-61dd8d89d264 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001510 Oct 15 13:41:57.333469 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: [pid: 110192|app: 0|req: 10/21] 10.222.0.36 () {54 vars in 931 bytes} [Sat Oct 15 13:41:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 13:41:57.768901 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi [None req-ef078868-017c-4d86-98cf-4a977db0ec39 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.tiny", "vcpus": 1, "id": "1", "disk": 1, "ram": 512, "swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0}} {{(pid=110193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 13:41:57.795679 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: INFO nova.api.openstack.requestlog [None req-ef078868-017c-4d86-98cf-4a977db0ec39 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.455665 Oct 15 13:41:57.796289 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: [pid: 110193|app: 0|req: 12/22] 10.222.0.36 () {64 vars in 1283 bytes} [Sat Oct 15 13:41:57 2022] POST /compute/v2.1/flavors => generated 402 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 13:41:57.809271 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi [None req-486c8e85-18bf-4a1a-b8b0-c051b0c2d79d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 13:41:57.842377 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: INFO nova.api.openstack.requestlog [None req-486c8e85-18bf-4a1a-b8b0-c051b0c2d79d admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036907 Oct 15 13:41:57.842997 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: [pid: 110192|app: 0|req: 11/23] 10.222.0.36 () {64 vars in 1333 bytes} [Sat Oct 15 13:41:57 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:42:00.523352 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi [None req-ef078868-017c-4d86-98cf-4a977db0ec39 admin admin] Calling method '>' {{(pid=110193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:42:00.524322 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: INFO nova.api.openstack.requestlog [None req-ef078868-017c-4d86-98cf-4a977db0ec39 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001523 Oct 15 13:42:00.529945 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: [pid: 110193|app: 0|req: 13/24] 10.222.0.36 () {54 vars in 931 bytes} [Sat Oct 15 13:42:00 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 13:42:01.017869 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi [None req-7ca68799-04d4-428f-b3ee-d41233cb0b1d admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "vcpus": 1, "name": "m1.small", "disk": 20, "rxtx_factor": 1.0, "ram": 2048, "swap": 0, "id": "2", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=110192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 13:42:01.023842 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG dbcounter [-] [110192] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=6,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=110192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:42:01.039532 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: INFO nova.api.openstack.requestlog [None req-7ca68799-04d4-428f-b3ee-d41233cb0b1d admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.507902 Oct 15 13:42:01.047747 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: [pid: 110192|app: 0|req: 12/25] 10.222.0.36 () {64 vars in 1283 bytes} [Sat Oct 15 13:42:00 2022] POST /compute/v2.1/flavors => generated 405 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 13:42:01.053206 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi [None req-b7ad6a0f-6c79-4c50-80c0-b662f4d6a642 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 13:42:01.142739 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: INFO nova.api.openstack.requestlog [None req-b7ad6a0f-6c79-4c50-80c0-b662f4d6a642 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.093293 Oct 15 13:42:01.144040 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: [pid: 110193|app: 0|req: 14/26] 10.222.0.36 () {64 vars in 1333 bytes} [Sat Oct 15 13:42:01 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:42:03.829061 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi [None req-7ca68799-04d4-428f-b3ee-d41233cb0b1d admin admin] Calling method '>' {{(pid=110192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:42:03.830699 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: INFO nova.api.openstack.requestlog [None req-7ca68799-04d4-428f-b3ee-d41233cb0b1d admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002090 Oct 15 13:42:03.831111 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: [pid: 110192|app: 0|req: 13/27] 10.222.0.36 () {54 vars in 931 bytes} [Sat Oct 15 13:42:03 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 13:42:04.329319 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi [None req-41589528-27cc-4140-b529-cde4e63bb62b admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "swap": 0, "name": "m1.medium", "vcpus": 2, "id": "3", "os-flavor-access:is_public": true, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 40}} {{(pid=110193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 13:42:04.356425 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: INFO nova.api.openstack.requestlog [None req-41589528-27cc-4140-b529-cde4e63bb62b admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.511299 Oct 15 13:42:04.357285 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: [pid: 110193|app: 0|req: 15/28] 10.222.0.36 () {64 vars in 1283 bytes} [Sat Oct 15 13:42:03 2022] POST /compute/v2.1/flavors => generated 406 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 15 13:42:04.369651 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi [None req-53e2ffe9-fbb3-4e11-80ba-af23fc7d1e8d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 13:42:04.404756 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: INFO nova.api.openstack.requestlog [None req-53e2ffe9-fbb3-4e11-80ba-af23fc7d1e8d admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.038769 Oct 15 13:42:04.412459 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: [pid: 110192|app: 0|req: 14/29] 10.222.0.36 () {64 vars in 1333 bytes} [Sat Oct 15 13:42:04 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:42:07.050505 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi [None req-41589528-27cc-4140-b529-cde4e63bb62b admin admin] Calling method '>' {{(pid=110193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:42:07.053089 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: INFO nova.api.openstack.requestlog [None req-41589528-27cc-4140-b529-cde4e63bb62b admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002686 Oct 15 13:42:07.053580 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: [pid: 110193|app: 0|req: 16/30] 10.222.0.36 () {54 vars in 931 bytes} [Sat Oct 15 13:42:07 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 13:42:07.545706 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi [None req-3470b595-a0ed-4b13-a1e8-ceaad5810837 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "ram": 8192, "disk": 80, "id": "4", "name": "m1.large", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 4, "rxtx_factor": 1.0}} {{(pid=110192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 13:42:07.567176 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: INFO nova.api.openstack.requestlog [None req-3470b595-a0ed-4b13-a1e8-ceaad5810837 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.506234 Oct 15 13:42:07.567926 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: [pid: 110192|app: 0|req: 15/31] 10.222.0.36 () {64 vars in 1283 bytes} [Sat Oct 15 13:42:07 2022] POST /compute/v2.1/flavors => generated 405 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 13:42:07.580157 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi [None req-ae9d91a8-6e7a-48d5-bc27-b2434b09433f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 13:42:07.585447 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG dbcounter [-] [110193] Writing DB stats nova_api:SELECT=39,nova_api:SAVEPOINT=4,nova_api:INSERT=8,nova_api:RELEASE=4 {{(pid=110193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:42:07.612733 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: INFO nova.api.openstack.requestlog [None req-ae9d91a8-6e7a-48d5-bc27-b2434b09433f admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035433 Oct 15 13:42:07.615951 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: [pid: 110193|app: 0|req: 17/32] 10.222.0.36 () {64 vars in 1333 bytes} [Sat Oct 15 13:42:07 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:42:10.327971 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi [None req-3470b595-a0ed-4b13-a1e8-ceaad5810837 admin admin] Calling method '>' {{(pid=110192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:42:10.329715 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: INFO nova.api.openstack.requestlog [None req-3470b595-a0ed-4b13-a1e8-ceaad5810837 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002239 Oct 15 13:42:10.336217 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: [pid: 110192|app: 0|req: 16/33] 10.222.0.36 () {54 vars in 931 bytes} [Sat Oct 15 13:42:10 2022] GET /compute/v2.1 => generated 388 bytes in 9 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 13:42:10.860908 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi [None req-303024fd-1a85-4221-8c62-5ef7536d2b29 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "ram": 16384, "swap": 0, "disk": 160, "name": "m1.xlarge", "vcpus": 8, "id": "5", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0}} {{(pid=110193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 13:42:10.887842 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: INFO nova.api.openstack.requestlog [None req-303024fd-1a85-4221-8c62-5ef7536d2b29 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.550335 Oct 15 13:42:10.888778 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: [pid: 110193|app: 0|req: 18/34] 10.222.0.36 () {64 vars in 1283 bytes} [Sat Oct 15 13:42:10 2022] POST /compute/v2.1/flavors => generated 408 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 15 13:42:10.901385 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi [None req-a26331c2-4256-4cbe-918c-9114945a1b74 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 13:42:10.930988 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: INFO nova.api.openstack.requestlog [None req-a26331c2-4256-4cbe-918c-9114945a1b74 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033343 Oct 15 13:42:10.931905 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: [pid: 110192|app: 0|req: 17/35] 10.222.0.36 () {64 vars in 1333 bytes} [Sat Oct 15 13:42:10 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:42:25.605391 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi [None req-303024fd-1a85-4221-8c62-5ef7536d2b29 admin admin] Calling method '>' {{(pid=110193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:42:25.606772 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: INFO nova.api.openstack.requestlog [None req-303024fd-1a85-4221-8c62-5ef7536d2b29 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002091 Oct 15 13:42:25.607376 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: [pid: 110193|app: 0|req: 19/36] 10.222.0.36 () {54 vars in 931 bytes} [Sat Oct 15 13:42:25 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 13:42:25.623922 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG dbcounter [-] [110192] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=17,nova_api:SAVEPOINT=2,nova_api:RELEASE=2 {{(pid=110192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:42:26.046116 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi [None req-e6678fb0-bf1a-4c2c-b900-21da6acffba1 admin admin] Calling method '>' {{(pid=110192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:42:26.064986 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: INFO nova.api.openstack.requestlog [None req-e6678fb0-bf1a-4c2c-b900-21da6acffba1 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.447677 Oct 15 13:42:26.065540 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: [pid: 110192|app: 0|req: 18/37] 10.222.0.36 () {60 vars in 1292 bytes} [Sat Oct 15 13:42:25 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 13:42:27.403254 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi [None req-303024fd-1a85-4221-8c62-5ef7536d2b29 admin admin] Calling method '>' {{(pid=110193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:42:27.404307 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: INFO nova.api.openstack.requestlog [None req-303024fd-1a85-4221-8c62-5ef7536d2b29 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001550 Oct 15 13:42:27.404697 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: [pid: 110193|app: 0|req: 20/38] 10.222.0.36 () {56 vars in 1074 bytes} [Sat Oct 15 13:42:27 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 13:42:27.960629 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi [None req-1483f1a7-0708-4b7b-b1f0-aa4590e6fb7d admin admin] Calling method '>' {{(pid=110192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:42:27.966284 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: INFO nova.api.openstack.wsgi [None req-1483f1a7-0708-4b7b-b1f0-aa4590e6fb7d admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 15 13:42:27.969588 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi [None req-1483f1a7-0708-4b7b-b1f0-aa4590e6fb7d admin admin] Request method failure captured: Oct 15 13:42:27.969588 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 15 13:42:27.969588 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: Accept: application/json Oct 15 13:42:27.969588 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: Accept-Encoding: gzip, deflate Oct 15 13:42:27.969588 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: Connection: keep-alive Oct 15 13:42:27.969588 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: Content-Length: 0 Oct 15 13:42:27.969588 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: Host: 10.222.0.36 Oct 15 13:42:27.969588 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: Openstack-Api-Version: compute 2.92 Oct 15 13:42:27.969588 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: Openstack-System-Scope: None Oct 15 13:42:27.969588 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: User-Agent: python-novaclient Oct 15 13:42:27.969588 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: X-Auth-Token: gAAAAABjSrjD2d3R8S8erl3TLAL9WrAKR0BYCW0AdN7Mua9embmFi_ApLQ5In2d54rNVpV5ST5IH3UxLYqYHA8KZ2yj00UaVv2WHF-qD14ebI4qPFYH2lCFbi1rZ_9ovqv0-P-vCqvJXPZLbvsd0HJtDovFo0VS2JjIZyxmn7Xl1_jSSC1TSa3E Oct 15 13:42:27.969588 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: X-Domain-Id: None Oct 15 13:42:27.969588 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: X-Domain-Name: None Oct 15 13:42:27.969588 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: X-Identity-Status: Confirmed Oct 15 13:42:27.969588 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: X-Is-Admin-Project: True Oct 15 13:42:27.969588 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: X-Openstack-Nova-Api-Version: 2.92 Oct 15 13:42:27.969588 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: X-Project-Domain-Id: default Oct 15 13:42:27.969588 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: X-Project-Domain-Name: Default Oct 15 13:42:27.969588 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: X-Project-Id: 443104cd704b44c6867e1bc065e90d39 Oct 15 13:42:27.969588 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: X-Project-Name: admin Oct 15 13:42:27.969588 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: X-Role: member,reader,admin Oct 15 13:42:27.969588 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: X-Roles: member,reader,admin Oct 15 13:42:27.971744 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_443104cd704b44c6867e1bc065e90d39", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/443104cd704b44c6867e1bc065e90d39"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/443104cd704b44c6867e1bc065e90d39"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/443104cd704b44c6867e1bc065e90d39"}]}] Oct 15 13:42:27.971744 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: X-Tenant: admin Oct 15 13:42:27.971744 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: X-Tenant-Id: 443104cd704b44c6867e1bc065e90d39 Oct 15 13:42:27.971744 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: X-Tenant-Name: admin Oct 15 13:42:27.971744 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: X-User: admin Oct 15 13:42:27.971744 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: X-User-Domain-Id: default Oct 15 13:42:27.971744 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: X-User-Domain-Name: Default Oct 15 13:42:27.971744 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: X-User-Id: d6c4e60be4154870948fd9be3f7e4091 Oct 15 13:42:27.971744 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: X-User-Name: admin Oct 15 13:42:27.971744 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: method: > Oct 15 13:42:27.971744 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: exception: Flavor 42 could not be found. Oct 15 13:42:27.971744 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: action_args: {'id': '42'} Oct 15 13:42:27.971744 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: {{(pid=110192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 15 13:42:27.971744 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 13:42:27.972649 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 15 13:42:27.972649 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 15 13:42:27.972649 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 15 13:42:27.972649 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 15 13:42:27.972649 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 15 13:42:27.972649 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 15 13:42:27.972649 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 15 13:42:27.972649 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 15 13:42:27.972649 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 15 13:42:27.972649 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 15 13:42:27.972649 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 15 13:42:27.972649 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 15 13:42:27.972649 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 15 13:42:27.972649 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: ERROR nova.api.openstack.wsgi Oct 15 13:42:27.972649 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 13:42:27.972649 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: ERROR nova.api.openstack.wsgi Oct 15 13:42:27.972649 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 13:42:27.972649 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 13:42:27.972649 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 13:42:27.974114 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 15 13:42:27.974114 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 15 13:42:27.974114 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 15 13:42:27.974114 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 15 13:42:27.974114 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 15 13:42:27.974114 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 15 13:42:27.974114 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 15 13:42:27.974114 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: ERROR nova.api.openstack.wsgi Oct 15 13:42:27.974114 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 13:42:27.974114 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: ERROR nova.api.openstack.wsgi Oct 15 13:42:27.974114 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 13:42:27.974114 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 13:42:27.974114 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 13:42:27.974114 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 15 13:42:27.974114 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 15 13:42:27.974114 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 15 13:42:27.974114 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: ERROR nova.api.openstack.wsgi Oct 15 13:42:27.974114 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi [None req-1483f1a7-0708-4b7b-b1f0-aa4590e6fb7d admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=110192) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 15 13:42:27.975143 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: INFO nova.api.openstack.requestlog [None req-1483f1a7-0708-4b7b-b1f0-aa4590e6fb7d admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.429579 Oct 15 13:42:27.975143 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: [pid: 110192|app: 0|req: 19/39] 10.222.0.36 () {60 vars in 1190 bytes} [Sat Oct 15 13:42:27 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 431 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 15 13:42:27.981618 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi [None req-189089ea-b1f2-400a-9a23-920fde6b9e1b admin admin] Calling method '>' {{(pid=110193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:42:27.985764 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG dbcounter [-] [110193] Writing DB stats nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:INSERT=2,nova_api:RELEASE=1 {{(pid=110193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:42:28.011438 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: INFO nova.api.openstack.requestlog [None req-189089ea-b1f2-400a-9a23-920fde6b9e1b admin admin] 10.222.0.36 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.033427 Oct 15 13:42:28.012085 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: [pid: 110193|app: 0|req: 21/40] 10.222.0.36 () {60 vars in 1210 bytes} [Sat Oct 15 13:42:27 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 13:42:28.023792 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi [None req-252baf89-8f4d-4b4f-953d-52ae36c1bf9d admin admin] Calling method '>' {{(pid=110192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:42:28.046530 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: INFO nova.api.openstack.requestlog [None req-252baf89-8f4d-4b4f-953d-52ae36c1bf9d admin admin] 10.222.0.36 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.027512 Oct 15 13:42:28.047120 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: [pid: 110192|app: 0|req: 20/41] 10.222.0.36 () {60 vars in 1210 bytes} [Sat Oct 15 13:42:28 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 13:42:28.059857 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi [None req-84b1d39d-4dcd-480b-881a-fb4e8277492c admin admin] Calling method '>' {{(pid=110193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:42:28.067308 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: INFO nova.api.openstack.wsgi [None req-84b1d39d-4dcd-480b-881a-fb4e8277492c admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 15 13:42:28.071044 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi [None req-84b1d39d-4dcd-480b-881a-fb4e8277492c admin admin] Request method failure captured: Oct 15 13:42:28.071044 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 15 13:42:28.071044 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: Accept: application/json Oct 15 13:42:28.071044 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: Accept-Encoding: gzip, deflate Oct 15 13:42:28.071044 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: Connection: keep-alive Oct 15 13:42:28.071044 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: Content-Length: 0 Oct 15 13:42:28.071044 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: Host: 10.222.0.36 Oct 15 13:42:28.071044 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: Openstack-Api-Version: compute 2.92 Oct 15 13:42:28.071044 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: Openstack-System-Scope: None Oct 15 13:42:28.071044 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: User-Agent: python-novaclient Oct 15 13:42:28.071044 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: X-Auth-Token: gAAAAABjSrjD2d3R8S8erl3TLAL9WrAKR0BYCW0AdN7Mua9embmFi_ApLQ5In2d54rNVpV5ST5IH3UxLYqYHA8KZ2yj00UaVv2WHF-qD14ebI4qPFYH2lCFbi1rZ_9ovqv0-P-vCqvJXPZLbvsd0HJtDovFo0VS2JjIZyxmn7Xl1_jSSC1TSa3E Oct 15 13:42:28.071044 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: X-Domain-Id: None Oct 15 13:42:28.071044 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: X-Domain-Name: None Oct 15 13:42:28.071044 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: X-Identity-Status: Confirmed Oct 15 13:42:28.071044 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: X-Is-Admin-Project: True Oct 15 13:42:28.071044 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: X-Openstack-Nova-Api-Version: 2.92 Oct 15 13:42:28.071044 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: X-Project-Domain-Id: default Oct 15 13:42:28.071044 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: X-Project-Domain-Name: Default Oct 15 13:42:28.071044 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: X-Project-Id: 443104cd704b44c6867e1bc065e90d39 Oct 15 13:42:28.071044 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: X-Project-Name: admin Oct 15 13:42:28.071044 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: X-Role: member,reader,admin Oct 15 13:42:28.071044 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: X-Roles: member,reader,admin Oct 15 13:42:28.072636 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_443104cd704b44c6867e1bc065e90d39", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/443104cd704b44c6867e1bc065e90d39"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/443104cd704b44c6867e1bc065e90d39"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/443104cd704b44c6867e1bc065e90d39"}]}] Oct 15 13:42:28.072636 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: X-Tenant: admin Oct 15 13:42:28.072636 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: X-Tenant-Id: 443104cd704b44c6867e1bc065e90d39 Oct 15 13:42:28.072636 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: X-Tenant-Name: admin Oct 15 13:42:28.072636 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: X-User: admin Oct 15 13:42:28.072636 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: X-User-Domain-Id: default Oct 15 13:42:28.072636 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: X-User-Domain-Name: Default Oct 15 13:42:28.072636 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: X-User-Id: d6c4e60be4154870948fd9be3f7e4091 Oct 15 13:42:28.072636 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: X-User-Name: admin Oct 15 13:42:28.072636 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: method: > Oct 15 13:42:28.072636 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: exception: Flavor 42 could not be found. Oct 15 13:42:28.072636 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: action_args: {'id': '42'} Oct 15 13:42:28.072636 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: {{(pid=110193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 15 13:42:28.072636 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 13:42:28.073409 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 15 13:42:28.073409 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 15 13:42:28.073409 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 15 13:42:28.073409 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 15 13:42:28.073409 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 15 13:42:28.073409 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 15 13:42:28.073409 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 15 13:42:28.073409 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 15 13:42:28.073409 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 15 13:42:28.073409 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 15 13:42:28.073409 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 15 13:42:28.073409 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 15 13:42:28.073409 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 15 13:42:28.073409 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: ERROR nova.api.openstack.wsgi Oct 15 13:42:28.073409 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 13:42:28.073409 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: ERROR nova.api.openstack.wsgi Oct 15 13:42:28.073409 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 13:42:28.073409 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 13:42:28.073409 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 13:42:28.074416 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 15 13:42:28.074416 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 15 13:42:28.074416 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 15 13:42:28.074416 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 15 13:42:28.074416 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 15 13:42:28.074416 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 15 13:42:28.074416 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 15 13:42:28.074416 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: ERROR nova.api.openstack.wsgi Oct 15 13:42:28.074416 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 13:42:28.074416 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: ERROR nova.api.openstack.wsgi Oct 15 13:42:28.074416 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 13:42:28.074416 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 13:42:28.074416 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 13:42:28.074416 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 15 13:42:28.074416 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 15 13:42:28.074416 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 15 13:42:28.074416 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: ERROR nova.api.openstack.wsgi Oct 15 13:42:28.074416 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi [None req-84b1d39d-4dcd-480b-881a-fb4e8277492c admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=110193) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 15 13:42:28.075391 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: INFO nova.api.openstack.requestlog [None req-84b1d39d-4dcd-480b-881a-fb4e8277492c admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.018465 Oct 15 13:42:28.075391 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: [pid: 110193|app: 0|req: 22/42] 10.222.0.36 () {60 vars in 1190 bytes} [Sat Oct 15 13:42:28 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 15 13:42:29.347968 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi [None req-252baf89-8f4d-4b4f-953d-52ae36c1bf9d admin admin] Calling method '>' {{(pid=110192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:42:29.349252 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: INFO nova.api.openstack.requestlog [None req-252baf89-8f4d-4b4f-953d-52ae36c1bf9d admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001622 Oct 15 13:42:29.349740 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: [pid: 110192|app: 0|req: 21/43] 10.222.0.36 () {56 vars in 1074 bytes} [Sat Oct 15 13:42:29 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 13:42:29.912512 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi [None req-f6a451cd-8cd4-4cb7-806e-5225a997a545 admin admin] Calling method '>' {{(pid=110193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:42:29.917754 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: INFO nova.api.openstack.wsgi [None req-f6a451cd-8cd4-4cb7-806e-5225a997a545 admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 15 13:42:29.919331 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi [None req-f6a451cd-8cd4-4cb7-806e-5225a997a545 admin admin] Request method failure captured: Oct 15 13:42:29.919331 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 15 13:42:29.919331 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: Accept: application/json Oct 15 13:42:29.919331 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: Accept-Encoding: gzip, deflate Oct 15 13:42:29.919331 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: Connection: keep-alive Oct 15 13:42:29.919331 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: Content-Length: 0 Oct 15 13:42:29.919331 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: Host: 10.222.0.36 Oct 15 13:42:29.919331 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: Openstack-Api-Version: compute 2.92 Oct 15 13:42:29.919331 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: Openstack-System-Scope: None Oct 15 13:42:29.919331 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: User-Agent: python-novaclient Oct 15 13:42:29.919331 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: X-Auth-Token: gAAAAABjSrjFcrFd6cm2UislgR-hxmxqRSKV6zoC-gK-DEv9mfStJ_J2UBjwp5lvHIzElHcGEhEwRy59TuBsrSpiaqqu3iBD7AgK7kPdqG7c-IiJiYyHJxoVVWLZMvt6E_6CMkfQt_3CwXRz65YPGc0LRU1ctT7Vhrk_WdzM04WBmBImrxTBaTM Oct 15 13:42:29.919331 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: X-Domain-Id: None Oct 15 13:42:29.919331 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: X-Domain-Name: None Oct 15 13:42:29.919331 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: X-Identity-Status: Confirmed Oct 15 13:42:29.919331 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: X-Is-Admin-Project: True Oct 15 13:42:29.919331 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: X-Openstack-Nova-Api-Version: 2.92 Oct 15 13:42:29.919331 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: X-Project-Domain-Id: default Oct 15 13:42:29.919331 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: X-Project-Domain-Name: Default Oct 15 13:42:29.919331 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: X-Project-Id: 443104cd704b44c6867e1bc065e90d39 Oct 15 13:42:29.919331 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: X-Project-Name: admin Oct 15 13:42:29.919331 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: X-Role: member,reader,admin Oct 15 13:42:29.919331 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: X-Roles: member,reader,admin Oct 15 13:42:29.920962 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_443104cd704b44c6867e1bc065e90d39", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/443104cd704b44c6867e1bc065e90d39"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/443104cd704b44c6867e1bc065e90d39"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/443104cd704b44c6867e1bc065e90d39"}]}] Oct 15 13:42:29.920962 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: X-Tenant: admin Oct 15 13:42:29.920962 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: X-Tenant-Id: 443104cd704b44c6867e1bc065e90d39 Oct 15 13:42:29.920962 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: X-Tenant-Name: admin Oct 15 13:42:29.920962 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: X-User: admin Oct 15 13:42:29.920962 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: X-User-Domain-Id: default Oct 15 13:42:29.920962 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: X-User-Domain-Name: Default Oct 15 13:42:29.920962 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: X-User-Id: d6c4e60be4154870948fd9be3f7e4091 Oct 15 13:42:29.920962 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: X-User-Name: admin Oct 15 13:42:29.920962 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: method: > Oct 15 13:42:29.920962 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: exception: Flavor 84 could not be found. Oct 15 13:42:29.920962 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: action_args: {'id': '84'} Oct 15 13:42:29.920962 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: {{(pid=110193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 15 13:42:29.920962 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 13:42:29.921807 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 15 13:42:29.921807 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 15 13:42:29.921807 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 15 13:42:29.921807 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 15 13:42:29.921807 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 15 13:42:29.921807 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 15 13:42:29.921807 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 15 13:42:29.921807 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 15 13:42:29.921807 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 15 13:42:29.921807 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 15 13:42:29.921807 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 15 13:42:29.921807 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 15 13:42:29.921807 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 15 13:42:29.921807 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: ERROR nova.api.openstack.wsgi Oct 15 13:42:29.921807 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 13:42:29.921807 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: ERROR nova.api.openstack.wsgi Oct 15 13:42:29.921807 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 13:42:29.921807 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 13:42:29.921807 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 13:42:29.922966 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 15 13:42:29.922966 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 15 13:42:29.922966 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 15 13:42:29.922966 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 15 13:42:29.922966 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 15 13:42:29.922966 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 15 13:42:29.922966 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 15 13:42:29.922966 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: ERROR nova.api.openstack.wsgi Oct 15 13:42:29.922966 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 13:42:29.922966 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: ERROR nova.api.openstack.wsgi Oct 15 13:42:29.922966 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 13:42:29.922966 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 13:42:29.922966 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 13:42:29.922966 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 15 13:42:29.922966 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 15 13:42:29.922966 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 15 13:42:29.922966 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: ERROR nova.api.openstack.wsgi Oct 15 13:42:29.922966 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi [None req-f6a451cd-8cd4-4cb7-806e-5225a997a545 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=110193) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 15 13:42:29.924014 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: INFO nova.api.openstack.requestlog [None req-f6a451cd-8cd4-4cb7-806e-5225a997a545 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.429573 Oct 15 13:42:29.924014 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: [pid: 110193|app: 0|req: 23/44] 10.222.0.36 () {60 vars in 1190 bytes} [Sat Oct 15 13:42:29 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 431 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 15 13:42:29.931025 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi [None req-6e0d7d63-2cf0-454e-8bd9-9923e0c525e5 admin admin] Calling method '>' {{(pid=110192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:42:29.946532 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: INFO nova.api.openstack.requestlog [None req-6e0d7d63-2cf0-454e-8bd9-9923e0c525e5 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019156 Oct 15 13:42:29.947115 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: [pid: 110192|app: 0|req: 22/45] 10.222.0.36 () {60 vars in 1210 bytes} [Sat Oct 15 13:42:29 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 13:42:29.957505 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi [None req-8c17530c-45c9-4fba-942f-f1796c4da7be admin admin] Calling method '>' {{(pid=110193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:42:29.973067 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: INFO nova.api.openstack.requestlog [None req-8c17530c-45c9-4fba-942f-f1796c4da7be admin admin] 10.222.0.36 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019400 Oct 15 13:42:29.973619 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: [pid: 110193|app: 0|req: 24/46] 10.222.0.36 () {60 vars in 1210 bytes} [Sat Oct 15 13:42:29 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 15 13:42:29.983504 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi [None req-87b93b31-77ff-4088-9446-5791a3dd3b6d admin admin] Calling method '>' {{(pid=110192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:42:29.989312 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: INFO nova.api.openstack.wsgi [None req-87b93b31-77ff-4088-9446-5791a3dd3b6d admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 15 13:42:29.990875 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi [None req-87b93b31-77ff-4088-9446-5791a3dd3b6d admin admin] Request method failure captured: Oct 15 13:42:29.990875 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 15 13:42:29.990875 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: Accept: application/json Oct 15 13:42:29.990875 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: Accept-Encoding: gzip, deflate Oct 15 13:42:29.990875 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: Connection: keep-alive Oct 15 13:42:29.990875 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: Content-Length: 0 Oct 15 13:42:29.990875 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: Host: 10.222.0.36 Oct 15 13:42:29.990875 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: Openstack-Api-Version: compute 2.92 Oct 15 13:42:29.990875 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: Openstack-System-Scope: None Oct 15 13:42:29.990875 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: User-Agent: python-novaclient Oct 15 13:42:29.990875 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: X-Auth-Token: gAAAAABjSrjFcrFd6cm2UislgR-hxmxqRSKV6zoC-gK-DEv9mfStJ_J2UBjwp5lvHIzElHcGEhEwRy59TuBsrSpiaqqu3iBD7AgK7kPdqG7c-IiJiYyHJxoVVWLZMvt6E_6CMkfQt_3CwXRz65YPGc0LRU1ctT7Vhrk_WdzM04WBmBImrxTBaTM Oct 15 13:42:29.990875 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: X-Domain-Id: None Oct 15 13:42:29.990875 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: X-Domain-Name: None Oct 15 13:42:29.990875 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: X-Identity-Status: Confirmed Oct 15 13:42:29.990875 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: X-Is-Admin-Project: True Oct 15 13:42:29.990875 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: X-Openstack-Nova-Api-Version: 2.92 Oct 15 13:42:29.990875 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: X-Project-Domain-Id: default Oct 15 13:42:29.990875 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: X-Project-Domain-Name: Default Oct 15 13:42:29.990875 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: X-Project-Id: 443104cd704b44c6867e1bc065e90d39 Oct 15 13:42:29.990875 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: X-Project-Name: admin Oct 15 13:42:29.990875 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: X-Role: member,reader,admin Oct 15 13:42:29.990875 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: X-Roles: member,reader,admin Oct 15 13:42:29.992282 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_443104cd704b44c6867e1bc065e90d39", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/443104cd704b44c6867e1bc065e90d39"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/443104cd704b44c6867e1bc065e90d39"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/443104cd704b44c6867e1bc065e90d39"}]}] Oct 15 13:42:29.992282 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: X-Tenant: admin Oct 15 13:42:29.992282 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: X-Tenant-Id: 443104cd704b44c6867e1bc065e90d39 Oct 15 13:42:29.992282 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: X-Tenant-Name: admin Oct 15 13:42:29.992282 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: X-User: admin Oct 15 13:42:29.992282 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: X-User-Domain-Id: default Oct 15 13:42:29.992282 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: X-User-Domain-Name: Default Oct 15 13:42:29.992282 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: X-User-Id: d6c4e60be4154870948fd9be3f7e4091 Oct 15 13:42:29.992282 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: X-User-Name: admin Oct 15 13:42:29.992282 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: method: > Oct 15 13:42:29.992282 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: exception: Flavor 84 could not be found. Oct 15 13:42:29.992282 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: action_args: {'id': '84'} Oct 15 13:42:29.992282 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: {{(pid=110192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 15 13:42:29.992282 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 13:42:29.993251 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 15 13:42:29.993251 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 15 13:42:29.993251 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 15 13:42:29.993251 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 15 13:42:29.993251 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 15 13:42:29.993251 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 15 13:42:29.993251 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 15 13:42:29.993251 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 15 13:42:29.993251 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 15 13:42:29.993251 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 15 13:42:29.993251 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 15 13:42:29.993251 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 15 13:42:29.993251 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 15 13:42:29.993251 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: ERROR nova.api.openstack.wsgi Oct 15 13:42:29.993251 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 13:42:29.993251 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: ERROR nova.api.openstack.wsgi Oct 15 13:42:29.993251 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 13:42:29.993251 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 13:42:29.993251 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 13:42:29.994499 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 15 13:42:29.994499 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 15 13:42:29.994499 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 15 13:42:29.994499 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 15 13:42:29.994499 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 15 13:42:29.994499 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 15 13:42:29.994499 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 15 13:42:29.994499 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: ERROR nova.api.openstack.wsgi Oct 15 13:42:29.994499 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 13:42:29.994499 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: ERROR nova.api.openstack.wsgi Oct 15 13:42:29.994499 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 13:42:29.994499 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 13:42:29.994499 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 13:42:29.994499 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 15 13:42:29.994499 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 15 13:42:29.994499 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 15 13:42:29.994499 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: ERROR nova.api.openstack.wsgi Oct 15 13:42:29.994499 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi [None req-87b93b31-77ff-4088-9446-5791a3dd3b6d admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=110192) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 15 13:42:29.995673 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: INFO nova.api.openstack.requestlog [None req-87b93b31-77ff-4088-9446-5791a3dd3b6d admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.012398 Oct 15 13:42:29.995673 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: [pid: 110192|app: 0|req: 23/47] 10.222.0.36 () {60 vars in 1190 bytes} [Sat Oct 15 13:42:29 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 15 13:42:31.246779 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi [None req-8c17530c-45c9-4fba-942f-f1796c4da7be admin admin] Calling method '>' {{(pid=110193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:42:31.247802 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: INFO nova.api.openstack.requestlog [None req-8c17530c-45c9-4fba-942f-f1796c4da7be admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001481 Oct 15 13:42:31.248239 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: [pid: 110193|app: 0|req: 25/48] 10.222.0.36 () {56 vars in 1074 bytes} [Sat Oct 15 13:42:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 13:42:31.803640 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi [None req-3ded4bec-3bb2-4a7a-a569-6d015e1d869d admin admin] Calling method '>' {{(pid=110192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:42:31.809685 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: INFO nova.api.openstack.wsgi [None req-3ded4bec-3bb2-4a7a-a569-6d015e1d869d admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 15 13:42:31.811226 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi [None req-3ded4bec-3bb2-4a7a-a569-6d015e1d869d admin admin] Request method failure captured: Oct 15 13:42:31.811226 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 15 13:42:31.811226 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: Accept: application/json Oct 15 13:42:31.811226 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: Accept-Encoding: gzip, deflate Oct 15 13:42:31.811226 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: Connection: keep-alive Oct 15 13:42:31.811226 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: Content-Length: 0 Oct 15 13:42:31.811226 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: Host: 10.222.0.36 Oct 15 13:42:31.811226 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: Openstack-Api-Version: compute 2.92 Oct 15 13:42:31.811226 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: Openstack-System-Scope: None Oct 15 13:42:31.811226 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: User-Agent: python-novaclient Oct 15 13:42:31.811226 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: X-Auth-Token: gAAAAABjSrjH33HVnjWLe-6qCYstBaN8kkwJCjf3BfYE2yN8yLsz6wxvYECmY-s74xMWatMuAL1b-S5P-Lz3ShYlq84P84XeK4bRj9VdHMyvZOaPBbbFAgxils177AO83CP7qIYJ5Sm799jp66So6WxsiiWmOL4_k2Lk_3Rk_RfVQyaEKs746hU Oct 15 13:42:31.811226 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: X-Domain-Id: None Oct 15 13:42:31.811226 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: X-Domain-Name: None Oct 15 13:42:31.811226 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: X-Identity-Status: Confirmed Oct 15 13:42:31.811226 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: X-Is-Admin-Project: True Oct 15 13:42:31.811226 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: X-Openstack-Nova-Api-Version: 2.92 Oct 15 13:42:31.811226 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: X-Project-Domain-Id: default Oct 15 13:42:31.811226 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: X-Project-Domain-Name: Default Oct 15 13:42:31.811226 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: X-Project-Id: 443104cd704b44c6867e1bc065e90d39 Oct 15 13:42:31.811226 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: X-Project-Name: admin Oct 15 13:42:31.811226 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: X-Role: member,reader,admin Oct 15 13:42:31.811226 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: X-Roles: member,reader,admin Oct 15 13:42:31.812892 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_443104cd704b44c6867e1bc065e90d39", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/443104cd704b44c6867e1bc065e90d39"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/443104cd704b44c6867e1bc065e90d39"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/443104cd704b44c6867e1bc065e90d39"}]}] Oct 15 13:42:31.812892 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: X-Tenant: admin Oct 15 13:42:31.812892 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: X-Tenant-Id: 443104cd704b44c6867e1bc065e90d39 Oct 15 13:42:31.812892 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: X-Tenant-Name: admin Oct 15 13:42:31.812892 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: X-User: admin Oct 15 13:42:31.812892 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: X-User-Domain-Id: default Oct 15 13:42:31.812892 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: X-User-Domain-Name: Default Oct 15 13:42:31.812892 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: X-User-Id: d6c4e60be4154870948fd9be3f7e4091 Oct 15 13:42:31.812892 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: X-User-Name: admin Oct 15 13:42:31.812892 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: method: > Oct 15 13:42:31.812892 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: exception: Flavor 451 could not be found. Oct 15 13:42:31.812892 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: action_args: {'id': '451'} Oct 15 13:42:31.812892 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: {{(pid=110192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 15 13:42:31.812892 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 13:42:31.813991 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 15 13:42:31.813991 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 15 13:42:31.813991 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 15 13:42:31.813991 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 15 13:42:31.813991 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 15 13:42:31.813991 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 15 13:42:31.813991 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 15 13:42:31.813991 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 15 13:42:31.813991 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 15 13:42:31.813991 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 15 13:42:31.813991 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 15 13:42:31.813991 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 15 13:42:31.813991 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 15 13:42:31.813991 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: ERROR nova.api.openstack.wsgi Oct 15 13:42:31.813991 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 13:42:31.813991 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: ERROR nova.api.openstack.wsgi Oct 15 13:42:31.813991 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 13:42:31.813991 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 13:42:31.813991 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 13:42:31.815529 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 15 13:42:31.815529 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 15 13:42:31.815529 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 15 13:42:31.815529 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 15 13:42:31.815529 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 15 13:42:31.815529 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 15 13:42:31.815529 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 15 13:42:31.815529 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: ERROR nova.api.openstack.wsgi Oct 15 13:42:31.815529 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 13:42:31.815529 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: ERROR nova.api.openstack.wsgi Oct 15 13:42:31.815529 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 13:42:31.815529 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 13:42:31.815529 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 13:42:31.815529 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 15 13:42:31.815529 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 15 13:42:31.815529 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 15 13:42:31.815529 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: ERROR nova.api.openstack.wsgi Oct 15 13:42:31.815529 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi [None req-3ded4bec-3bb2-4a7a-a569-6d015e1d869d admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=110192) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 15 13:42:31.817181 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: INFO nova.api.openstack.requestlog [None req-3ded4bec-3bb2-4a7a-a569-6d015e1d869d admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.427681 Oct 15 13:42:31.817181 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: [pid: 110192|app: 0|req: 24/49] 10.222.0.36 () {60 vars in 1193 bytes} [Sat Oct 15 13:42:31 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 429 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 15 13:42:31.823771 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi [None req-dc673dd7-c06a-49b3-8134-43443061f8a4 admin admin] Calling method '>' {{(pid=110193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:42:31.839582 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: INFO nova.api.openstack.requestlog [None req-dc673dd7-c06a-49b3-8134-43443061f8a4 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019416 Oct 15 13:42:31.840159 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: [pid: 110193|app: 0|req: 26/50] 10.222.0.36 () {60 vars in 1210 bytes} [Sat Oct 15 13:42:31 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 13:42:31.850073 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi [None req-f43663fa-2444-44f6-a3c4-ac1c20213abb admin admin] Calling method '>' {{(pid=110192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:42:31.866060 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: INFO nova.api.openstack.requestlog [None req-f43663fa-2444-44f6-a3c4-ac1c20213abb admin admin] 10.222.0.36 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019549 Oct 15 13:42:31.866684 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: [pid: 110192|app: 0|req: 25/51] 10.222.0.36 () {60 vars in 1210 bytes} [Sat Oct 15 13:42:31 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 13:42:31.877057 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi [None req-a4770772-600f-43ca-bfbf-bd4acc4e06f7 admin admin] Calling method '>' {{(pid=110193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:42:31.882575 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: INFO nova.api.openstack.wsgi [None req-a4770772-600f-43ca-bfbf-bd4acc4e06f7 admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 15 13:42:31.884178 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi [None req-a4770772-600f-43ca-bfbf-bd4acc4e06f7 admin admin] Request method failure captured: Oct 15 13:42:31.884178 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 15 13:42:31.884178 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: Accept: application/json Oct 15 13:42:31.884178 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: Accept-Encoding: gzip, deflate Oct 15 13:42:31.884178 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: Connection: keep-alive Oct 15 13:42:31.884178 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: Content-Length: 0 Oct 15 13:42:31.884178 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: Host: 10.222.0.36 Oct 15 13:42:31.884178 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: Openstack-Api-Version: compute 2.92 Oct 15 13:42:31.884178 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: Openstack-System-Scope: None Oct 15 13:42:31.884178 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: User-Agent: python-novaclient Oct 15 13:42:31.884178 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: X-Auth-Token: gAAAAABjSrjH33HVnjWLe-6qCYstBaN8kkwJCjf3BfYE2yN8yLsz6wxvYECmY-s74xMWatMuAL1b-S5P-Lz3ShYlq84P84XeK4bRj9VdHMyvZOaPBbbFAgxils177AO83CP7qIYJ5Sm799jp66So6WxsiiWmOL4_k2Lk_3Rk_RfVQyaEKs746hU Oct 15 13:42:31.884178 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: X-Domain-Id: None Oct 15 13:42:31.884178 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: X-Domain-Name: None Oct 15 13:42:31.884178 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: X-Identity-Status: Confirmed Oct 15 13:42:31.884178 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: X-Is-Admin-Project: True Oct 15 13:42:31.884178 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: X-Openstack-Nova-Api-Version: 2.92 Oct 15 13:42:31.884178 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: X-Project-Domain-Id: default Oct 15 13:42:31.884178 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: X-Project-Domain-Name: Default Oct 15 13:42:31.884178 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: X-Project-Id: 443104cd704b44c6867e1bc065e90d39 Oct 15 13:42:31.884178 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: X-Project-Name: admin Oct 15 13:42:31.884178 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: X-Role: member,reader,admin Oct 15 13:42:31.884178 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: X-Roles: member,reader,admin Oct 15 13:42:31.885683 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_443104cd704b44c6867e1bc065e90d39", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/443104cd704b44c6867e1bc065e90d39"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/443104cd704b44c6867e1bc065e90d39"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/443104cd704b44c6867e1bc065e90d39"}]}] Oct 15 13:42:31.885683 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: X-Tenant: admin Oct 15 13:42:31.885683 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: X-Tenant-Id: 443104cd704b44c6867e1bc065e90d39 Oct 15 13:42:31.885683 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: X-Tenant-Name: admin Oct 15 13:42:31.885683 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: X-User: admin Oct 15 13:42:31.885683 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: X-User-Domain-Id: default Oct 15 13:42:31.885683 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: X-User-Domain-Name: Default Oct 15 13:42:31.885683 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: X-User-Id: d6c4e60be4154870948fd9be3f7e4091 Oct 15 13:42:31.885683 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: X-User-Name: admin Oct 15 13:42:31.885683 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: method: > Oct 15 13:42:31.885683 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: exception: Flavor 451 could not be found. Oct 15 13:42:31.885683 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: action_args: {'id': '451'} Oct 15 13:42:31.885683 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: {{(pid=110193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 15 13:42:31.885683 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 13:42:31.886517 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 15 13:42:31.886517 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 15 13:42:31.886517 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 15 13:42:31.886517 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 15 13:42:31.886517 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 15 13:42:31.886517 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 15 13:42:31.886517 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 15 13:42:31.886517 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 15 13:42:31.886517 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 15 13:42:31.886517 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 15 13:42:31.886517 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 15 13:42:31.886517 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 15 13:42:31.886517 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 15 13:42:31.886517 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: ERROR nova.api.openstack.wsgi Oct 15 13:42:31.886517 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 13:42:31.886517 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: ERROR nova.api.openstack.wsgi Oct 15 13:42:31.886517 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 13:42:31.886517 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 13:42:31.886517 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 13:42:31.887732 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 15 13:42:31.887732 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 15 13:42:31.887732 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 15 13:42:31.887732 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 15 13:42:31.887732 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 15 13:42:31.887732 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 15 13:42:31.887732 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 15 13:42:31.887732 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: ERROR nova.api.openstack.wsgi Oct 15 13:42:31.887732 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 13:42:31.887732 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: ERROR nova.api.openstack.wsgi Oct 15 13:42:31.887732 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 13:42:31.887732 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 13:42:31.887732 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 13:42:31.887732 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 15 13:42:31.887732 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 15 13:42:31.887732 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 15 13:42:31.887732 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: ERROR nova.api.openstack.wsgi Oct 15 13:42:31.887732 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi [None req-a4770772-600f-43ca-bfbf-bd4acc4e06f7 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=110193) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 15 13:42:31.889003 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: INFO nova.api.openstack.requestlog [None req-a4770772-600f-43ca-bfbf-bd4acc4e06f7 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.012486 Oct 15 13:42:31.889003 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: [pid: 110193|app: 0|req: 27/52] 10.222.0.36 () {60 vars in 1193 bytes} [Sat Oct 15 13:42:31 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 15 13:42:33.146065 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi [None req-f43663fa-2444-44f6-a3c4-ac1c20213abb admin admin] Calling method '>' {{(pid=110192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:42:33.147143 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: INFO nova.api.openstack.requestlog [None req-f43663fa-2444-44f6-a3c4-ac1c20213abb admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001514 Oct 15 13:42:33.147566 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: [pid: 110192|app: 0|req: 26/53] 10.222.0.36 () {56 vars in 1074 bytes} [Sat Oct 15 13:42:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 13:42:33.700203 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi [None req-73bdc556-a83c-4289-8c24-05ad22240b35 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 13:42:33.722432 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: INFO nova.api.openstack.requestlog [None req-73bdc556-a83c-4289-8c24-05ad22240b35 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.437224 Oct 15 13:42:33.723043 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: [pid: 110193|app: 0|req: 28/54] 10.222.0.36 () {64 vars in 1235 bytes} [Sat Oct 15 13:42:33 2022] POST /compute/v2.1/flavors => generated 404 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 13:42:34.954201 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi [None req-f43663fa-2444-44f6-a3c4-ac1c20213abb admin admin] Calling method '>' {{(pid=110192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:42:34.955263 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: INFO nova.api.openstack.requestlog [None req-f43663fa-2444-44f6-a3c4-ac1c20213abb admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001479 Oct 15 13:42:34.955716 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: [pid: 110192|app: 0|req: 27/55] 10.222.0.36 () {56 vars in 1074 bytes} [Sat Oct 15 13:42:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 13:42:35.529462 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi [None req-16012470-c4bb-43be-ad57-27bd39da5988 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 13:42:35.552561 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: INFO nova.api.openstack.requestlog [None req-16012470-c4bb-43be-ad57-27bd39da5988 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.457552 Oct 15 13:42:35.553144 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: [pid: 110193|app: 0|req: 29/56] 10.222.0.36 () {64 vars in 1235 bytes} [Sat Oct 15 13:42:35 2022] POST /compute/v2.1/flavors => generated 405 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 13:42:36.808195 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi [None req-f43663fa-2444-44f6-a3c4-ac1c20213abb admin admin] Calling method '>' {{(pid=110192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:42:36.809218 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: INFO nova.api.openstack.requestlog [None req-f43663fa-2444-44f6-a3c4-ac1c20213abb admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001812 Oct 15 13:42:36.809625 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: [pid: 110192|app: 0|req: 28/57] 10.222.0.36 () {56 vars in 1074 bytes} [Sat Oct 15 13:42:36 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 13:42:37.348676 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi [None req-a47c1edf-264f-460f-83b6-aa2692b256ba admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 13:42:37.370332 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: INFO nova.api.openstack.requestlog [None req-a47c1edf-264f-460f-83b6-aa2692b256ba admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.422516 Oct 15 13:42:37.370891 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: [pid: 110193|app: 0|req: 30/58] 10.222.0.36 () {64 vars in 1235 bytes} [Sat Oct 15 13:42:36 2022] POST /compute/v2.1/flavors => generated 407 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 13:42:38.632747 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi [None req-f43663fa-2444-44f6-a3c4-ac1c20213abb admin admin] Calling method '>' {{(pid=110192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:42:38.634401 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: INFO nova.api.openstack.requestlog [None req-f43663fa-2444-44f6-a3c4-ac1c20213abb admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002375 Oct 15 13:42:38.634943 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: [pid: 110192|app: 0|req: 29/59] 10.222.0.36 () {56 vars in 1074 bytes} [Sat Oct 15 13:42:38 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 13:42:39.178635 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi [None req-6dbc0f76-53ee-423b-8ae7-a2a8c4cd24df admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 13:42:39.199819 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: INFO nova.api.openstack.requestlog [None req-6dbc0f76-53ee-423b-8ae7-a2a8c4cd24df admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.422887 Oct 15 13:42:39.200420 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: [pid: 110193|app: 0|req: 31/60] 10.222.0.36 () {64 vars in 1235 bytes} [Sat Oct 15 13:42:38 2022] POST /compute/v2.1/flavors => generated 409 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 13:42:40.450870 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi [None req-f43663fa-2444-44f6-a3c4-ac1c20213abb admin admin] Calling method '>' {{(pid=110192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:42:40.451898 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: INFO nova.api.openstack.requestlog [None req-f43663fa-2444-44f6-a3c4-ac1c20213abb admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001478 Oct 15 13:42:40.452319 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: [pid: 110192|app: 0|req: 30/61] 10.222.0.36 () {56 vars in 1074 bytes} [Sat Oct 15 13:42:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 13:42:41.015901 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi [None req-33e54bb3-fde0-4287-a686-2b7f191a11f7 admin admin] Calling method '>' {{(pid=110193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:42:41.036897 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: INFO nova.api.openstack.requestlog [None req-33e54bb3-fde0-4287-a686-2b7f191a11f7 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.446819 Oct 15 13:42:41.037458 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: [pid: 110193|app: 0|req: 32/62] 10.222.0.36 () {60 vars in 1202 bytes} [Sat Oct 15 13:42:40 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 13:43:38.766729 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi [None req-f43663fa-2444-44f6-a3c4-ac1c20213abb admin admin] Calling method '>' {{(pid=110192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:43:38.767749 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: INFO nova.api.openstack.requestlog [None req-f43663fa-2444-44f6-a3c4-ac1c20213abb admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001687 Oct 15 13:43:38.768228 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: [pid: 110192|app: 0|req: 31/63] 10.222.0.36 () {54 vars in 931 bytes} [Sat Oct 15 13:43:38 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 13:43:38.779700 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG dbcounter [-] [110193] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=110193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:43:39.185676 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi [None req-2d537d38-5eaa-4733-9053-9c51b9c31b56 admin admin] Calling method '>' {{(pid=110193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:43:39.208337 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: INFO nova.api.openstack.requestlog [None req-2d537d38-5eaa-4733-9053-9c51b9c31b56 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.433104 Oct 15 13:43:39.209133 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: [pid: 110193|app: 0|req: 33/64] 10.222.0.36 () {60 vars in 1292 bytes} [Sat Oct 15 13:43:38 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 13:43:39.230590 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG dbcounter [-] [110192] Writing DB stats nova_api:SELECT=14 {{(pid=110192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:43:39.235017 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi [None req-b54a675d-c742-42d0-aead-56d8df5c6ef3 admin admin] Calling method '>' {{(pid=110192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:43:39.243018 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: INFO nova.api.openstack.requestlog [None req-b54a675d-c742-42d0-aead-56d8df5c6ef3 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.014026 Oct 15 13:43:39.243573 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: [pid: 110192|app: 0|req: 32/65] 10.222.0.36 () {60 vars in 1283 bytes} [Sat Oct 15 13:43:39 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:43:39.256949 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi [None req-10550da0-3698-4b6b-9d34-caff0bc1bf9d admin admin] Calling method '>' {{(pid=110193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:43:39.264770 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: INFO nova.api.openstack.requestlog [None req-10550da0-3698-4b6b-9d34-caff0bc1bf9d admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012167 Oct 15 13:43:39.265680 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: [pid: 110193|app: 0|req: 34/66] 10.222.0.36 () {60 vars in 1286 bytes} [Sat Oct 15 13:43:39 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:43:39.278753 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi [None req-360018a3-d901-4760-9d36-435d769f48bc admin admin] Calling method '>' {{(pid=110192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:43:39.286663 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: INFO nova.api.openstack.requestlog [None req-360018a3-d901-4760-9d36-435d769f48bc admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011729 Oct 15 13:43:39.287222 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: [pid: 110192|app: 0|req: 33/67] 10.222.0.36 () {60 vars in 1286 bytes} [Sat Oct 15 13:43:39 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:43:39.299478 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi [None req-23e6e13b-4b18-4faa-8de3-0db72e80fb1c admin admin] Calling method '>' {{(pid=110193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:43:39.307817 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: INFO nova.api.openstack.requestlog [None req-23e6e13b-4b18-4faa-8de3-0db72e80fb1c admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012058 Oct 15 13:43:39.308490 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: [pid: 110193|app: 0|req: 35/68] 10.222.0.36 () {60 vars in 1283 bytes} [Sat Oct 15 13:43:39 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:46:35.322518 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi [None req-360018a3-d901-4760-9d36-435d769f48bc admin admin] Calling method '>' {{(pid=110192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:46:35.323530 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: INFO nova.api.openstack.requestlog [None req-360018a3-d901-4760-9d36-435d769f48bc admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001480 Oct 15 13:46:35.323948 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: [pid: 110192|app: 0|req: 34/69] 10.222.0.36 () {56 vars in 1074 bytes} [Sat Oct 15 13:46:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 13:46:35.463573 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG dbcounter [-] [110193] Writing DB stats nova_api:SELECT=6 {{(pid=110193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:46:35.646258 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi [None req-9b4de745-cb53-4529-ab86-605c77698099 admin admin] Calling method '>' {{(pid=110193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:46:35.651403 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG oslo_concurrency.lockutils [None req-9b4de745-cb53-4529-ab86-605c77698099 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:46:35.651888 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG oslo_concurrency.lockutils [None req-9b4de745-cb53-4529-ab86-605c77698099 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=110193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:46:35.652340 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG oslo_concurrency.lockutils [None req-9b4de745-cb53-4529-ab86-605c77698099 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:46:35.653049 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG oslo_concurrency.lockutils [None req-9b4de745-cb53-4529-ab86-605c77698099 admin admin] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:46:35.653494 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG oslo_concurrency.lockutils [None req-9b4de745-cb53-4529-ab86-605c77698099 admin admin] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:46:35.653912 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG oslo_concurrency.lockutils [None req-9b4de745-cb53-4529-ab86-605c77698099 admin admin] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:46:35.685301 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: INFO nova.api.openstack.requestlog [None req-9b4de745-cb53-4529-ab86-605c77698099 admin admin] 10.222.0.36 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.223733 Oct 15 13:46:35.685862 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: [pid: 110193|app: 0|req: 36/70] 10.222.0.36 () {60 vars in 1193 bytes} [Sat Oct 15 13:46:35 2022] GET /compute/v2.1/os-services => generated 791 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 13:46:36.774364 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi [None req-360018a3-d901-4760-9d36-435d769f48bc admin admin] Calling method '>' {{(pid=110192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:46:36.775742 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: INFO nova.api.openstack.requestlog [None req-360018a3-d901-4760-9d36-435d769f48bc admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001926 Oct 15 13:46:36.776195 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: [pid: 110192|app: 0|req: 35/71] 10.222.0.36 () {56 vars in 1074 bytes} [Sat Oct 15 13:46:36 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 15 13:46:36.972518 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi [None req-058ed25b-ee18-46a8-8bc2-6a807fa91f93 admin admin] Calling method '>' {{(pid=110193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:46:36.976014 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG oslo_concurrency.lockutils [None req-058ed25b-ee18-46a8-8bc2-6a807fa91f93 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:46:36.976532 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG oslo_concurrency.lockutils [None req-058ed25b-ee18-46a8-8bc2-6a807fa91f93 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=110193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:46:36.976985 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG oslo_concurrency.lockutils [None req-058ed25b-ee18-46a8-8bc2-6a807fa91f93 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:46:36.977704 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG oslo_concurrency.lockutils [None req-058ed25b-ee18-46a8-8bc2-6a807fa91f93 admin admin] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:46:36.978149 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG oslo_concurrency.lockutils [None req-058ed25b-ee18-46a8-8bc2-6a807fa91f93 admin admin] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:46:36.978567 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG oslo_concurrency.lockutils [None req-058ed25b-ee18-46a8-8bc2-6a807fa91f93 admin admin] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:46:36.998200 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: INFO nova.api.openstack.requestlog [None req-058ed25b-ee18-46a8-8bc2-6a807fa91f93 admin admin] 10.222.0.36 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.078389 Oct 15 13:46:36.998763 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: [pid: 110193|app: 0|req: 37/72] 10.222.0.36 () {60 vars in 1193 bytes} [Sat Oct 15 13:46:36 2022] GET /compute/v2.1/os-services => generated 791 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 13:46:48.511306 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi [None req-360018a3-d901-4760-9d36-435d769f48bc admin admin] Calling method '>' {{(pid=110192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:46:48.512365 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: INFO nova.api.openstack.requestlog [None req-360018a3-d901-4760-9d36-435d769f48bc admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001521 Oct 15 13:46:48.512761 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: [pid: 110192|app: 0|req: 36/73] 10.222.0.36 () {56 vars in 1074 bytes} [Sat Oct 15 13:46:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 15 13:46:48.660138 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG dbcounter [-] [110193] Writing DB stats nova_cell0:SELECT=4 {{(pid=110193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:46:48.661073 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG dbcounter [-] [110193] Writing DB stats nova_cell1:SELECT=4 {{(pid=110193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:46:48.661754 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG dbcounter [-] [110193] Writing DB stats nova_api:SELECT=8 {{(pid=110193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:46:48.717848 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi [None req-2a59fef7-19a7-4be6-a576-130a082d6b38 admin admin] Calling method '>' {{(pid=110193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:46:48.723288 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG oslo_concurrency.lockutils [None req-2a59fef7-19a7-4be6-a576-130a082d6b38 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:46:48.724126 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG oslo_concurrency.lockutils [None req-2a59fef7-19a7-4be6-a576-130a082d6b38 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=110193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:46:48.724776 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG oslo_concurrency.lockutils [None req-2a59fef7-19a7-4be6-a576-130a082d6b38 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:46:48.725794 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG oslo_concurrency.lockutils [None req-2a59fef7-19a7-4be6-a576-130a082d6b38 admin admin] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:46:48.726459 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG oslo_concurrency.lockutils [None req-2a59fef7-19a7-4be6-a576-130a082d6b38 admin admin] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=110193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:46:48.727059 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG oslo_concurrency.lockutils [None req-2a59fef7-19a7-4be6-a576-130a082d6b38 admin admin] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:46:48.753026 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: INFO nova.api.openstack.requestlog [None req-2a59fef7-19a7-4be6-a576-130a082d6b38 admin admin] 10.222.0.36 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.92 time: 0.100316 Oct 15 13:46:48.753589 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: [pid: 110193|app: 0|req: 38/74] 10.222.0.36 () {60 vars in 1193 bytes} [Sat Oct 15 13:46:48 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 13:46:49.867851 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG nova.api.openstack.wsgi [None req-360018a3-d901-4760-9d36-435d769f48bc admin admin] Calling method '>' {{(pid=110192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:46:49.868936 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: INFO nova.api.openstack.requestlog [None req-360018a3-d901-4760-9d36-435d769f48bc admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001496 Oct 15 13:46:49.869355 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: [pid: 110192|app: 0|req: 37/75] 10.222.0.36 () {56 vars in 1074 bytes} [Sat Oct 15 13:46:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 13:46:50.061784 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG nova.api.openstack.wsgi [None req-cce959dd-3a45-4ed6-bc73-e2590c40b1b0 admin admin] Calling method '>' {{(pid=110193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:46:50.065172 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG oslo_concurrency.lockutils [None req-cce959dd-3a45-4ed6-bc73-e2590c40b1b0 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:46:50.065787 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG oslo_concurrency.lockutils [None req-cce959dd-3a45-4ed6-bc73-e2590c40b1b0 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:46:50.066212 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG oslo_concurrency.lockutils [None req-cce959dd-3a45-4ed6-bc73-e2590c40b1b0 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:46:50.066925 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG oslo_concurrency.lockutils [None req-cce959dd-3a45-4ed6-bc73-e2590c40b1b0 admin admin] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:46:50.067363 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG oslo_concurrency.lockutils [None req-cce959dd-3a45-4ed6-bc73-e2590c40b1b0 admin admin] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:46:50.067776 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: DEBUG oslo_concurrency.lockutils [None req-cce959dd-3a45-4ed6-bc73-e2590c40b1b0 admin admin] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:46:50.090905 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: INFO nova.api.openstack.requestlog [None req-cce959dd-3a45-4ed6-bc73-e2590c40b1b0 admin admin] 10.222.0.36 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.92 time: 0.083118 Oct 15 13:46:50.091490 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: [pid: 110193|app: 0|req: 39/76] 10.222.0.36 () {60 vars in 1193 bytes} [Sat Oct 15 13:46:50 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 13:47:46.855286 dv-cinder-861491-3-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Oct 15 13:47:46.857049 dv-cinder-861491-3-iscsi devstack@n-api.service[110191]: Sat Oct 15 13:47:46 2022 - graceful shutdown triggered... Oct 15 13:47:46.857697 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: Gracefully killing worker 1 (pid: 110192)... Oct 15 13:47:46.858395 dv-cinder-861491-3-iscsi devstack@n-api.service[110193]: Gracefully killing worker 2 (pid: 110193)... Oct 15 13:47:46.990936 dv-cinder-861491-3-iscsi devstack@n-api.service[110192]: DEBUG dbcounter [-] [110192] Writing DB stats nova_api:SELECT=4 {{(pid=110192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:47:47.858231 dv-cinder-861491-3-iscsi devstack@n-api.service[110191]: worker 1 buried after 1 seconds Oct 15 13:47:47.858231 dv-cinder-861491-3-iscsi devstack@n-api.service[110191]: worker 2 buried after 1 seconds Oct 15 13:47:47.858231 dv-cinder-861491-3-iscsi devstack@n-api.service[110191]: goodbye to uWSGI. Oct 15 13:47:47.860969 dv-cinder-861491-3-iscsi systemd[1]: devstack@n-api.service: Succeeded. Oct 15 13:47:47.861736 dv-cinder-861491-3-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Oct 15 13:47:47.865004 dv-cinder-861491-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Oct 15 13:47:47.886026 dv-cinder-861491-3-iscsi devstack@n-api.service[125226]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 15 13:47:47.888908 dv-cinder-861491-3-iscsi devstack@n-api.service[125226]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Oct 15 13:47:47 2022] *** Oct 15 13:47:47.890061 dv-cinder-861491-3-iscsi devstack@n-api.service[125226]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 15 13:47:47.890212 dv-cinder-861491-3-iscsi devstack@n-api.service[125226]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 15 13:47:47.890366 dv-cinder-861491-3-iscsi devstack@n-api.service[125226]: nodename: dv-cinder-861491-3-iscsi Oct 15 13:47:47.890366 dv-cinder-861491-3-iscsi devstack@n-api.service[125226]: machine: x86_64 Oct 15 13:47:47.890366 dv-cinder-861491-3-iscsi devstack@n-api.service[125226]: clock source: unix Oct 15 13:47:47.890366 dv-cinder-861491-3-iscsi devstack@n-api.service[125226]: pcre jit disabled Oct 15 13:47:47.890366 dv-cinder-861491-3-iscsi devstack@n-api.service[125226]: detected number of CPU cores: 4 Oct 15 13:47:47.890366 dv-cinder-861491-3-iscsi devstack@n-api.service[125226]: current working directory: / Oct 15 13:47:47.890366 dv-cinder-861491-3-iscsi devstack@n-api.service[125226]: detected binary path: /usr/bin/uwsgi-core Oct 15 13:47:47.890366 dv-cinder-861491-3-iscsi devstack@n-api.service[125226]: your processes number limit is 47680 Oct 15 13:47:47.890366 dv-cinder-861491-3-iscsi devstack@n-api.service[125226]: your memory page size is 4096 bytes Oct 15 13:47:47.890366 dv-cinder-861491-3-iscsi devstack@n-api.service[125226]: detected max file descriptor number: 2048 Oct 15 13:47:47.890366 dv-cinder-861491-3-iscsi devstack@n-api.service[125226]: lock engine: pthread robust mutexes Oct 15 13:47:47.891204 dv-cinder-861491-3-iscsi devstack@n-api.service[125226]: thunder lock: enabled Oct 15 13:47:47.891204 dv-cinder-861491-3-iscsi devstack@n-api.service[125226]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 15 13:47:47.891204 dv-cinder-861491-3-iscsi devstack@n-api.service[125226]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 15 13:47:47.936885 dv-cinder-861491-3-iscsi devstack@n-api.service[125226]: Python main interpreter initialized at 0x555ed9cdb9c0 Oct 15 13:47:47.936885 dv-cinder-861491-3-iscsi devstack@n-api.service[125226]: python threads support enabled Oct 15 13:47:47.936885 dv-cinder-861491-3-iscsi devstack@n-api.service[125226]: your server socket listen backlog is limited to 100 connections Oct 15 13:47:47.936885 dv-cinder-861491-3-iscsi devstack@n-api.service[125226]: your mercy for graceful operations on workers is 90 seconds Oct 15 13:47:47.937431 dv-cinder-861491-3-iscsi devstack@n-api.service[125226]: mapped 403077 bytes (393 KB) for 2 cores Oct 15 13:47:47.937431 dv-cinder-861491-3-iscsi devstack@n-api.service[125226]: *** Operational MODE: preforking *** Oct 15 13:47:47.937645 dv-cinder-861491-3-iscsi devstack@n-api.service[125226]: *** uWSGI is running in multiple interpreter mode *** Oct 15 13:47:47.937645 dv-cinder-861491-3-iscsi devstack@n-api.service[125226]: spawned uWSGI master process (pid: 125226) Oct 15 13:47:47.937862 dv-cinder-861491-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Oct 15 13:47:47.939125 dv-cinder-861491-3-iscsi devstack@n-api.service[125226]: spawned uWSGI worker 1 (pid: 125242, cores: 1) Oct 15 13:47:47.939699 dv-cinder-861491-3-iscsi devstack@n-api.service[125226]: spawned uWSGI worker 2 (pid: 125243, cores: 1) Oct 15 13:47:47.940074 dv-cinder-861491-3-iscsi devstack@n-api.service[125226]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 15 13:47:48.625176 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 15 13:47:48.636559 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 15 13:47:49.808631 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 15 13:47:49.808631 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: from cryptography.utils import int_from_bytes Oct 15 13:47:49.809559 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 15 13:47:49.809559 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: from cryptography.utils import int_from_bytes Oct 15 13:47:49.809962 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 15 13:47:49.809962 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: from cryptography.utils import int_from_bytes Oct 15 13:47:49.810218 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 15 13:47:49.810218 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: from cryptography.utils import int_from_bytes Oct 15 13:47:52.308662 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 15 13:47:52.309466 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 15 13:47:52.309466 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 15 13:47:52.310088 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 15 13:47:52.310088 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 15 13:47:52.310692 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.310954 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.311274 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.311594 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.311948 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.312260 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.312583 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.312901 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.313227 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.313483 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.313798 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.314310 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-861491-3-iscsi {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.314646 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.314963 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.315268 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.315588 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.315905 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.316249 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.316576 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.317089 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.317841 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.318516 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.319090 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.319600 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.319965 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.320280 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.320598 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.321197 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.321605 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.321976 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.322623 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-861491-3-iscsi {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.323165 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.323668 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.324643 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.324921 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.325449 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.326337 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.326938 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.327469 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.328056 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.328634 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.329174 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.329681 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.330205 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.330690 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.331197 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.331698 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.332271 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.332786 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.333183 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.333442 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.334023 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.334437 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.334994 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.335490 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.335785 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.336125 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.336225 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 15 13:47:52.336649 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 15 13:47:52.336731 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.336846 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.337042 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 15 13:47:52.337155 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.337379 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 15 13:47:52.337488 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.337672 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 15 13:47:52.337820 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.338010 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.338115 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.338347 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.338644 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.338794 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.339037 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.339198 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.339324 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.339422 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.339663 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.339947 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.340064 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.340270 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.340367 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.340618 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.340842 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.341066 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.341335 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.341497 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.341689 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.342095 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-861491-3-iscsi {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.342292 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.342411 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.342503 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.36 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.342633 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.342730 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.36 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.342952 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.343053 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.343280 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.343380 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.343591 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.343744 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.343943 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.344197 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.344309 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.344682 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.344789 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.345075 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.345179 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.345385 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.345578 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.345689 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.345995 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.346106 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.346331 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.346446 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.346643 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.346751 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.346964 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.347161 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.347298 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.347536 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.347683 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.347893 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.348035 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.348266 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.348428 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-861491-3-iscsi {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.348619 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.348773 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.348933 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.349038 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.349247 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.349402 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.349666 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.349765 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.349979 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.350141 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.350290 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.350383 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.350612 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.350710 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.350927 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.351017 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.351235 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.351325 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.351575 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.351679 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.351856 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.352030 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.352193 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.352322 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.352498 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.352635 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.352803 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.353466 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.353466 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.353717 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.353853 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.353991 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.354125 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.354283 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.354396 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.354492 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.354637 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.354737 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.354892 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.355022 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.355205 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.355330 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.355527 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.355619 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.355851 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.355956 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.356198 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.356310 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.356453 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.356545 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.356705 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.356944 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.357112 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.357272 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.357450 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.357623 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.357799 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.357940 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.358111 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.358245 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.358416 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.358539 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.358724 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.358847 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.359020 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.359152 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.359322 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.359420 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.359629 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.359722 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.359999 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.360110 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.360277 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.360373 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.360581 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.360675 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.360882 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.360973 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.361184 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.361282 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.361512 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.361613 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.361838 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.361936 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.36 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.362171 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.36 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.362310 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.362482 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.362610 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.362816 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.363133 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.363536 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.363655 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.363737 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.364024 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.364139 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.364330 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.364459 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.364660 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.364768 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.364990 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.365125 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.365291 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.365408 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.365607 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.365715 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.365930 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.366035 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.366234 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.366385 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.366553 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.366697 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.367014 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.367281 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.367443 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.367586 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.367715 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.367931 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.368058 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.368225 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.368327 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.368530 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.368625 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.368847 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.368970 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.369151 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.369251 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.369462 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.369619 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.369766 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.369867 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.370064 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.370163 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.370376 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.370540 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.370684 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.370824 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.370961 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.371097 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.371271 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.371376 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.371581 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.371679 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.371924 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.372135 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.372284 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.372496 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.372650 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.373342 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.373676 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.373891 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.374038 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.374145 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.374231 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.374344 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.374440 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.374525 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.374617 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.374702 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.374844 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.375009 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.375128 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.375261 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.375367 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.375367 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.375581 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.375581 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.375850 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.376149 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.376312 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.376312 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.376602 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.376602 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.376924 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.376924 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.377331 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.377542 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.377738 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.377738 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.378046 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.378262 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.378421 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.378563 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.378759 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.378924 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.379100 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.379265 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.379468 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.379662 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.379865 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.379865 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.380266 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.380398 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.380525 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.380658 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.380824 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.380976 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.381067 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.381151 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.381242 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.381334 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.381418 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.381518 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.381605 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.381689 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.381778 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.381778 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.381940 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.382065 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.382208 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.382336 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.382432 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.382523 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.382616 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.382760 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.382859 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 13:47:52.383085 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.383183 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.383389 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.383487 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.383724 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.383815 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.384051 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.384215 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.384361 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.384465 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.384669 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.384760 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.384977 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.385066 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.385281 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.385380 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.385591 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.385728 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.385897 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.385989 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.386199 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.386305 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.386517 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.386607 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.386822 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.386919 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.387123 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.387224 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.387440 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.387539 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.387744 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.387843 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.388384 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.388883 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.388883 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.389060 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.389145 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.389237 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.389334 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.389427 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.389517 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.389649 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.389826 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.389917 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.390154 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.390331 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.390470 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.390657 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.390819 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.390970 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.391169 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.391304 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.391485 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.391635 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.391812 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.391966 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.392182 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.392293 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.392501 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.392620 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.392817 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.392921 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.393133 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.393224 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.393478 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.393576 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.393794 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.393898 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.394093 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.394188 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.394417 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.394513 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.394771 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.394873 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.395054 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.395183 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.395369 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.395616 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.395719 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.396007 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.396102 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.396325 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.396430 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.396635 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.396739 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.396960 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.397058 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.397285 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.397383 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.397595 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.397698 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.397900 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.397991 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.398210 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.398308 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.398527 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.398620 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.398844 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.398941 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.399157 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.399248 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.399471 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.399570 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.399782 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.399893 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.400130 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.400223 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.400437 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.400538 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.400750 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.400844 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.401054 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.401141 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.401364 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.401453 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.401672 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.401812 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.401980 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.402105 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.402303 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.402432 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.402610 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.402725 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.402924 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.403056 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.403229 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.403351 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.403539 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.403661 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.403908 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.404544 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.404684 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.404773 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.404773 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.404982 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.405068 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.405198 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.405311 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.405540 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.405811 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.405920 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.406140 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.406364 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.406471 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.406748 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.406841 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.407071 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.407172 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.407388 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.407523 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.407702 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.407793 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.408035 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.408181 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.408326 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.408461 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.408639 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.408776 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.408965 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.409108 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.409282 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.409380 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.409624 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.409715 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.409960 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.410151 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.410270 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.410597 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.410685 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.410926 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.411247 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.411338 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.411553 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.411682 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.411866 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.412029 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.412206 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.412378 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.412516 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.412727 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.412825 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.413109 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.413208 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.413418 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.413507 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.413726 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.413816 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.414031 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.414137 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.414340 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.414449 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.414645 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.414778 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.414965 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.415094 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.415277 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.415374 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.415580 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.415675 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.415951 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.416117 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.416252 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.416358 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.416561 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.416655 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.416870 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.416962 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.417180 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.417274 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.417485 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.417615 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.417799 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.417901 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.418106 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.418252 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.418411 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.418512 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.418711 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.418812 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.419023 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.419174 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.419719 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.419945 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.420038 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.420173 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.420335 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.420485 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.420586 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.420687 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.420779 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.420909 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.420996 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.421129 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.421283 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.421444 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.421590 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.421765 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.421878 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.421969 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.422186 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.422311 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.422489 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.422597 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.422834 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.422980 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.423144 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.423244 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.423448 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.423538 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.423765 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.423859 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.424109 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.424202 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.424416 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.424509 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.424734 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.424865 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.425042 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.425136 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.425349 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.425441 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.425668 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.425759 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.425984 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.426113 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.426287 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.426449 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.426591 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.426745 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.426898 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.426997 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.427206 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.427305 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.427514 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.427617 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.427828 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.427974 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.428161 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.428283 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.428468 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.428573 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.428774 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.428867 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.429116 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.429228 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.429423 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.429550 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.429746 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.429856 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.430061 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.430385 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.430699 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.431011 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.431110 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.431326 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.431468 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.431638 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.431974 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.432073 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.432204 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.432309 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.432404 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.432577 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.432688 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.432892 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.432984 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.433211 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.433343 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.433515 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.433625 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.433835 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.433933 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.434146 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.434236 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.434450 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.434564 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.434754 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.434851 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.435092 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.435223 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.435568 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.436150 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.436264 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.436440 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.436609 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.436726 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.436851 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.436960 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.437050 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.437191 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.437280 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.437450 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.437582 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.437672 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.437759 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.437853 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.437984 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.438094 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.438209 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.438314 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.438436 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.438554 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.438645 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.438847 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.438940 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.439166 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.439302 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.439474 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.439600 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.439800 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.439963 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.440105 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.440204 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.440451 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.440550 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.440820 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.440929 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.441060 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.441159 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.441375 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.441474 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.441703 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.441809 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.442025 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.442183 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.442322 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.442415 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.442639 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.442742 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.442942 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.443040 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.443246 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.443395 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.443550 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.443703 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.443859 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.444134 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.444256 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.444343 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.444449 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.444548 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.444756 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.444899 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.445062 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.445195 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.445367 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.445498 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.445673 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.445765 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.445972 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.446281 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.446404 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.446577 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.446709 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.446887 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.446979 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.447196 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.447288 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.447495 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.447615 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.447793 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.447940 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.448142 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.448269 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.448448 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.448542 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.448748 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.448849 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.449056 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.449159 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.449364 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.449519 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.449672 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.449809 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.449978 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.450096 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.450276 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.450379 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.450678 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.450787 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.451004 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.451591 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.451866 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.452112 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.452237 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.452386 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.452487 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.452580 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.452696 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.452785 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.452868 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.452966 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.453051 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.453143 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.453277 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.453373 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.453541 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.453632 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.453722 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.453906 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.454006 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.454212 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.454349 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.454528 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.454676 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.454826 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.454925 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.455132 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.455239 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.455434 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.455528 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.455736 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.455827 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.456062 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.456199 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.456369 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.456514 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.456699 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.456886 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.457085 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.457230 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.457385 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.457525 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.457675 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.457835 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.458028 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.458182 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.458350 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.458527 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.458697 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.458845 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.458995 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.459128 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.459256 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.459387 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.459524 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.459660 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.459815 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.459966 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.460084 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.460244 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.460397 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.460657 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.460812 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.460962 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.461113 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.461409 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.461674 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.461821 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.461983 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.462142 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.462279 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.462403 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.462544 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.462687 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.462833 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.462997 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.463151 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.463866 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.464094 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.464254 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.464410 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.464565 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.464716 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.464860 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.465029 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.465180 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.465335 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.465508 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.465964 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.466137 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.466367 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.466521 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.466657 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.466807 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.466943 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.467100 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.467233 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.467380 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.467534 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.467688 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.467688 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.468029 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.468186 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.468338 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.468493 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.468648 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.468793 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.469046 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.469199 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.469372 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.469519 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.469679 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.469849 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.469995 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.470146 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.470290 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.470437 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.470588 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.470734 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.470871 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.471039 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.471204 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.471364 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.471514 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.471679 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.471834 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.472125 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.472338 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.472552 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.472757 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.472990 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.473203 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.473407 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.473792 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.474013 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.474234 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.474453 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.474667 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.474881 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.475084 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.475284 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.475493 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.475725 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.476246 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.476476 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.476681 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.476895 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.477119 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.477342 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.477544 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.477746 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.478285 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.478499 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.478816 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.479174 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.479397 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.479598 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.479796 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.480079 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.480288 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.480503 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.480706 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.480908 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.481118 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.481342 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.481565 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.481776 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.482191 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.482409 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.482605 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.482809 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.483009 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.483230 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.483428 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.483630 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.484068 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.484304 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.484531 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.484730 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.484945 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.485164 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.485385 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.485580 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.485781 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.485983 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.486493 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.486702 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.486936 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.487146 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.487348 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.487559 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.487766 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.488022 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.488262 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.488489 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.488489 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.488894 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.489108 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.489317 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.489538 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.489743 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.489960 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.490175 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.490385 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.490623 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.490827 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.491028 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.491231 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.491442 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.491645 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.491862 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.492086 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.492303 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.492502 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.492702 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.492905 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.493122 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.493326 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.493545 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.493742 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.493927 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.494266 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.494489 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.494697 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.494915 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.495134 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.495383 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.495599 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.495812 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.496117 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.496352 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.496777 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.497001 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.497219 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.497445 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.497710 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.497933 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.498128 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.498338 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.498548 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.498742 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.498944 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.499137 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.499337 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.499527 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.499747 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.500825 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.501059 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.501266 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.501497 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.501735 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.501954 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.502226 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.502448 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.502662 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.502878 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.503105 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.503312 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.503525 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.503733 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.504020 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.504020 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.504642 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.504855 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.505042 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.505228 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.505424 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.505639 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.505820 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.506001 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.506190 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.506380 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.506572 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.507013 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.507213 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.507409 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.507600 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.507804 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.508162 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.508382 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.508587 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.508797 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.508991 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.509187 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.509396 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.509591 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.509816 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.510790 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.511005 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.511205 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.511397 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.511586 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.511788 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.512064 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.512261 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.512469 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.512668 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.512864 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.513057 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.513287 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.513504 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.513718 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.513914 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.514121 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.514314 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.514512 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.514900 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.515100 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.515306 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.515500 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.515710 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.515948 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.516167 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.516361 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.516556 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.516751 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.517233 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.517448 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.517666 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.517873 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.518067 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.518263 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.518464 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.518657 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.518866 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.519060 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.519253 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.519456 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.519661 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.519931 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.520129 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.520323 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.520323 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.520726 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.520926 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.521133 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.521340 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.521544 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.521734 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.521940 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.522148 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.522356 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.522552 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.522747 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.522951 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.523148 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.523341 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.523555 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.523761 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.523986 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.524202 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.524407 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.524614 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.524810 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.525179 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.525375 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.525564 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.525757 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.525973 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.526169 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.526370 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.526562 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.526755 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.526959 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.527495 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.527694 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.527924 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.528111 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.528312 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.528498 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.528805 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.528984 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.529171 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.529412 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.529588 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.530040 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.530733 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.530947 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.530947 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.531622 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.531827 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.532089 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.532304 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.532521 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.532800 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.533000 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.533230 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.533418 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.533588 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.533788 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.534000 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.534170 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.534333 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.534498 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.534712 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.534917 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.535192 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.535516 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.535734 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.535976 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.536197 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.536397 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.536611 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.536771 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.536974 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.537146 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.537432 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.537716 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.537914 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.538127 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.538360 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.538513 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.538748 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.538975 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.539136 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.539343 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.539493 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.539493 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.539786 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.539995 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.540146 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.540309 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.540465 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.540619 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.540775 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.540940 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.541130 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.541291 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.541460 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.541704 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.541856 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.542010 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.542169 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.542326 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.542491 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.542677 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.542854 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.542854 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.543486 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.543647 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.543800 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.543977 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.544129 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.544277 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.544471 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.544623 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.544796 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.544997 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.545197 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.545399 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.545796 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.545990 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.546147 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.546298 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.546455 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.546619 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.546780 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.546780 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.547072 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.547234 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.547389 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.547567 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.547790 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.548076 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.548276 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.548473 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.548682 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.548871 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.549035 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.549190 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.549349 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.549497 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.549661 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.549810 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.549957 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.550114 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.550271 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.550432 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.550591 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.550591 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.550876 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.551024 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.551184 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.551345 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.551584 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.551837 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.552015 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.552180 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.552332 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.552480 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.552652 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.552845 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.553023 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.553023 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.553387 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.553607 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.553805 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.554039 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.554206 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.554357 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.554507 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.554507 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.554811 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.554968 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.555124 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.555282 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.555430 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.555593 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.555767 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.556138 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.556306 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.556455 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.556625 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.556782 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.556930 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.557087 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.557235 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.557382 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.557540 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.557706 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.557855 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.558003 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.558170 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.558352 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.558511 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.558511 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.558803 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.558960 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.559115 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.559341 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.559497 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.559650 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.559800 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.559984 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.559984 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.560438 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.560640 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.560847 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.561032 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.561255 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.561465 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.561653 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.561822 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.562071 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.562230 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.562230 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.562526 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.562674 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.562832 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.563007 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.563198 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.563373 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.563552 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.563742 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.563990 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.564199 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.564389 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.564541 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.564541 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.564837 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.564995 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.565144 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.565304 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.565304 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.565606 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.565755 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.565755 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.566218 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.566414 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.566601 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.566752 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.566900 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.567050 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.567198 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.567355 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.567512 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.567669 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.567819 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.567994 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.568110 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.568223 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.568223 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.568498 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.568618 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.568729 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.568847 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.568958 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.568958 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.569186 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.569298 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.569414 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.569414 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.569645 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.569763 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.569874 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.569983 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.570101 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.570213 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.570333 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.570451 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.570567 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.570683 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.570792 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.570901 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.571018 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.571129 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.571129 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.571342 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.571451 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.571567 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.571687 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.571797 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.571941 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.572090 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.572227 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.572227 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.572425 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.572507 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.572581 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.572652 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.572725 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.572815 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.572889 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.572960 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.573039 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.573163 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.573298 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.573388 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.573471 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.573545 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.573545 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.573733 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.573863 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.573989 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.574078 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.574199 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.574346 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.574470 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.574567 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.574643 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.574715 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.574786 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.574859 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.574938 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.575020 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.575020 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.575172 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.575252 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.575325 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.575396 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.575476 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.575556 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.576827 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.577145 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.577279 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.577429 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.577569 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.577697 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.577828 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.577966 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.578095 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.578238 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.578373 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.578517 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.578697 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.578837 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.578837 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.579104 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.579233 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.579359 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.579488 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.579488 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.579740 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.579740 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.580020 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.580220 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.580417 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.580595 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.580785 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.580915 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.580915 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.581167 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.581301 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.581434 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.581575 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.581704 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.581704 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.581952 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.582095 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.582232 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.582381 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.582566 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.582695 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.582825 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.582961 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.583101 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.583238 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.583382 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.583515 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.583645 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.583772 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.584002 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.584185 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.584185 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.584484 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.584668 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.584800 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.584940 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.585088 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.585223 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.585364 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.585491 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.585705 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.585844 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.585980 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.586110 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.586271 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.586398 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.586535 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.586671 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.586809 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.586952 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.587098 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.587283 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.587422 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.587549 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.587690 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.587898 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.588050 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.588186 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.588324 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.588452 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.588579 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.588706 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.588899 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.589041 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.589178 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.589307 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.589434 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.589569 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.589697 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.589833 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.589969 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.590106 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.590238 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.590377 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.590520 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.590659 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.590825 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.591026 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.591356 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.591864 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.592433 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.592566 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.592752 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.592892 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.593020 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.593155 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.593296 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.593435 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.593625 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.593764 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.593764 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.594039 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.594183 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.594373 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.594506 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.594703 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.594879 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.595025 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.595168 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.595297 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.595429 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.595565 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.595693 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.595830 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.596028 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.596172 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.596311 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.596458 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.596594 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.596730 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.596867 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.597007 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.597159 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.597304 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.597444 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.597592 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.597721 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.597847 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.597982 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.598119 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.598260 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.598401 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.598542 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.598669 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.598799 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.598937 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.599086 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.599214 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.599340 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.599340 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.599587 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.599724 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.599862 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.600169 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.600339 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.600470 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.600673 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.600835 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.600979 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.601117 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.601255 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.601385 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.601512 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.601663 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.601663 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.601914 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.602042 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.602176 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.602304 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.602456 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.602655 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.602835 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.603331 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.603468 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.603601 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.603796 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.603961 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.604112 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.604250 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.604250 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.604561 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.604693 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.604893 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.605067 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.605195 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.605338 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.605476 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.605612 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.605740 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.605868 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.606003 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.606131 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.606275 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.606419 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.606558 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.606685 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.606685 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.607021 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.607797 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.608176 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.608311 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.608455 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.608584 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.608774 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=125243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 15 13:47:52.608964 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.608964 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.608964 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.608964 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.608964 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.608964 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.608964 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.608964 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.609966 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.609966 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.609966 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.609966 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.609966 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.609966 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.609966 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.609966 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.610925 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.610925 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.610925 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.610925 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.610925 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.610925 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.610925 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.610925 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.611898 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.611898 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.611898 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.611898 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.611898 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.611898 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.611898 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.611898 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 13:47:52.612868 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=125242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 15 13:47:52.654903 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO dbcounter [None req-33414317-993b-412d-9551-2529610de268 None None] Registered counter for database nova_api Oct 15 13:47:52.661363 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO dbcounter [None req-51110f3e-aed6-4d4a-9fbf-4c35c10c43c6 None None] Registered counter for database nova_api Oct 15 13:47:52.676099 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_db.sqlalchemy.engines [None req-33414317-993b-412d-9551-2529610de268 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125243) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 15 13:47:52.682491 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_db.sqlalchemy.engines [None req-51110f3e-aed6-4d4a-9fbf-4c35c10c43c6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125242) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 15 13:47:52.686993 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG dbcounter [-] [125243] Writer thread running {{(pid=125243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 15 13:47:52.689487 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG dbcounter [-] [125242] Writer thread running {{(pid=125242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 15 13:47:52.748369 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.context [None req-51110f3e-aed6-4d4a-9fbf-4c35c10c43c6 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),7dc09bc6-d873-4fce-bdea-89bf85d4cbce(cell1) {{(pid=125242) load_cells /opt/stack/nova/nova/context.py:464}} Oct 15 13:47:52.748644 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.context [None req-33414317-993b-412d-9551-2529610de268 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),7dc09bc6-d873-4fce-bdea-89bf85d4cbce(cell1) {{(pid=125243) load_cells /opt/stack/nova/nova/context.py:464}} Oct 15 13:47:52.752605 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-51110f3e-aed6-4d4a-9fbf-4c35c10c43c6 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:47:52.752747 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-33414317-993b-412d-9551-2529610de268 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:47:52.753033 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-51110f3e-aed6-4d4a-9fbf-4c35c10c43c6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:47:52.753150 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-33414317-993b-412d-9551-2529610de268 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:47:52.754635 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-51110f3e-aed6-4d4a-9fbf-4c35c10c43c6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:47:52.754822 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-33414317-993b-412d-9551-2529610de268 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:47:52.755382 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-51110f3e-aed6-4d4a-9fbf-4c35c10c43c6 None None] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:47:52.755555 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-33414317-993b-412d-9551-2529610de268 None None] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:47:52.755840 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-51110f3e-aed6-4d4a-9fbf-4c35c10c43c6 None None] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:47:52.756014 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-33414317-993b-412d-9551-2529610de268 None None] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:47:52.757927 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-51110f3e-aed6-4d4a-9fbf-4c35c10c43c6 None None] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:47:52.758072 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-33414317-993b-412d-9551-2529610de268 None None] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:47:52.760071 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO dbcounter [None req-51110f3e-aed6-4d4a-9fbf-4c35c10c43c6 None None] Registered counter for database nova_cell0 Oct 15 13:47:52.760259 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO dbcounter [None req-33414317-993b-412d-9551-2529610de268 None None] Registered counter for database nova_cell0 Oct 15 13:47:52.764862 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO dbcounter [None req-51110f3e-aed6-4d4a-9fbf-4c35c10c43c6 None None] Registered counter for database nova_cell1 Oct 15 13:47:52.765051 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO dbcounter [None req-33414317-993b-412d-9551-2529610de268 None None] Registered counter for database nova_cell1 Oct 15 13:47:52.772119 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_db.sqlalchemy.engines [None req-33414317-993b-412d-9551-2529610de268 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125243) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 15 13:47:52.775689 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_db.sqlalchemy.engines [None req-51110f3e-aed6-4d4a-9fbf-4c35c10c43c6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125242) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 15 13:47:52.775906 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_db.sqlalchemy.engines [None req-33414317-993b-412d-9551-2529610de268 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125243) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 15 13:47:52.777445 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_db.sqlalchemy.engines [None req-51110f3e-aed6-4d4a-9fbf-4c35c10c43c6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125242) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 15 13:47:52.779299 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG dbcounter [-] [125243] Writer thread running {{(pid=125243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 15 13:47:52.784227 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG dbcounter [-] [125242] Writer thread running {{(pid=125242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 15 13:47:52.930009 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG dbcounter [-] [125243] Writer thread running {{(pid=125243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 15 13:47:52.940479 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO dbcounter [None req-33414317-993b-412d-9551-2529610de268 None None] Registered counter for database nova_cell0 Oct 15 13:47:52.945035 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG dbcounter [-] [125242] Writer thread running {{(pid=125242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 15 13:47:52.949155 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_db.sqlalchemy.engines [None req-33414317-993b-412d-9551-2529610de268 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125243) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 15 13:47:52.955161 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG dbcounter [-] [125243] Writer thread running {{(pid=125243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 15 13:47:52.965139 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO dbcounter [None req-51110f3e-aed6-4d4a-9fbf-4c35c10c43c6 None None] Registered counter for database nova_cell0 Oct 15 13:47:52.977091 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_db.sqlalchemy.engines [None req-51110f3e-aed6-4d4a-9fbf-4c35c10c43c6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125242) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 15 13:47:52.985663 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG dbcounter [-] [125242] Writer thread running {{(pid=125242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 15 13:47:53.292324 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: WARNING keystonemiddleware.auth_token [None req-33414317-993b-412d-9551-2529610de268 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 15 13:47:53.307043 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: WARNING keystonemiddleware.auth_token [None req-33414317-993b-412d-9551-2529610de268 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 15 13:47:53.424552 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: WARNING keystonemiddleware.auth_token [None req-51110f3e-aed6-4d4a-9fbf-4c35c10c43c6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 15 13:47:53.432181 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: WARNING keystonemiddleware.auth_token [None req-51110f3e-aed6-4d4a-9fbf-4c35c10c43c6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 15 13:47:53.730459 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: WARNING keystonemiddleware.auth_token [None req-33414317-993b-412d-9551-2529610de268 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 15 13:47:53.737140 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: WARNING keystonemiddleware.auth_token [None req-33414317-993b-412d-9551-2529610de268 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 15 13:47:53.742473 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x555ed9cdb9c0 pid: 125243 (default app) Oct 15 13:47:53.788404 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: WARNING keystonemiddleware.auth_token [None req-51110f3e-aed6-4d4a-9fbf-4c35c10c43c6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 15 13:47:53.794824 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: WARNING keystonemiddleware.auth_token [None req-51110f3e-aed6-4d4a-9fbf-4c35c10c43c6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 15 13:47:53.800275 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x555ed9cdb9c0 pid: 125242 (default app) Oct 15 13:48:29.715969 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG dbcounter [-] [125243] Writing DB stats nova_api:SELECT=3 {{(pid=125243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:48:29.717571 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG dbcounter [-] [125243] Writing DB stats nova_cell0:SELECT=3 {{(pid=125243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:48:29.718534 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG dbcounter [-] [125243] Writing DB stats nova_cell1:SELECT=3 {{(pid=125243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:48:29.719647 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG dbcounter [-] [125243] Writing DB stats nova_cell0:SELECT=3 {{(pid=125243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:48:30.976259 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG dbcounter [-] [125242] Writing DB stats nova_api:SELECT=3 {{(pid=125242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:48:30.977682 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG dbcounter [-] [125242] Writing DB stats nova_cell0:SELECT=3 {{(pid=125242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:48:30.979212 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG dbcounter [-] [125242] Writing DB stats nova_cell1:SELECT=3 {{(pid=125242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:48:30.980299 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG dbcounter [-] [125242] Writing DB stats nova_cell0:SELECT=3 {{(pid=125242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:48:31.876264 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-1af114ff-a1b7-4ce9-9f8b-d994d951ddc5 tempest-VolumesNegativeTest-1636154340 tempest-VolumesNegativeTest-1636154340-project] Action: 'create', calling method: .version_select at 0x7f1b5f28f550>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-2138643627", "metadata": {"Type": "work"}}} {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 13:48:31.883063 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-1af114ff-a1b7-4ce9-9f8b-d994d951ddc5 tempest-VolumesNegativeTest-1636154340 tempest-VolumesNegativeTest-1636154340-project] Request method failure captured: Oct 15 13:48:31.883063 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 15 13:48:31.883063 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: Accept: application/json Oct 15 13:48:31.883063 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: Accept-Encoding: identity Oct 15 13:48:31.883063 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: Connection: close Oct 15 13:48:31.883063 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: Content-Length: 122 Oct 15 13:48:31.883063 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: Content-Type: application/json Oct 15 13:48:31.883063 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: Host: 10.222.0.36 Oct 15 13:48:31.883063 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: Openstack-System-Scope: None Oct 15 13:48:31.883063 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: User-Agent: python-urllib3/1.26.12 Oct 15 13:48:31.883063 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Auth-Token: gAAAAABjSrotIrYdwSaLLW9kWh645vDPIyhxQheJcP3kmd0wTgWpMNMlVyg0SnBD1xdqxOT96n-qCeYAJzqxBUMu-wjQ8XNVjASiCoYgfGf9QBTFoFvX29gKjuO739a9xi5b-8_Xkt7pbkRJ27lyi_bCutUbbk3Iz-8G09jW1qJLPReQftP8rQQ Oct 15 13:48:31.883063 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Domain-Id: None Oct 15 13:48:31.883063 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Domain-Name: None Oct 15 13:48:31.883063 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Identity-Status: Confirmed Oct 15 13:48:31.883063 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Is-Admin-Project: True Oct 15 13:48:31.883063 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Project-Domain-Id: default Oct 15 13:48:31.883063 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Project-Domain-Name: Default Oct 15 13:48:31.883063 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Project-Id: 080f5405f5a44718858ccbc99dc49680 Oct 15 13:48:31.883063 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Project-Name: tempest-VolumesNegativeTest-1636154340 Oct 15 13:48:31.883063 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Role: member,reader Oct 15 13:48:31.883063 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Roles: member,reader Oct 15 13:48:31.884999 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_080f5405f5a44718858ccbc99dc49680", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/080f5405f5a44718858ccbc99dc49680"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/080f5405f5a44718858ccbc99dc49680"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/080f5405f5a44718858ccbc99dc49680"}]}] Oct 15 13:48:31.884999 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Tenant: tempest-VolumesNegativeTest-1636154340 Oct 15 13:48:31.884999 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Tenant-Id: 080f5405f5a44718858ccbc99dc49680 Oct 15 13:48:31.884999 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Tenant-Name: tempest-VolumesNegativeTest-1636154340 Oct 15 13:48:31.884999 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-User: tempest-VolumesNegativeTest-1636154340-project Oct 15 13:48:31.884999 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-User-Domain-Id: default Oct 15 13:48:31.884999 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-User-Domain-Name: Default Oct 15 13:48:31.884999 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-User-Id: 8b3f059dc7e04446a8f04da22761c30f Oct 15 13:48:31.884999 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-User-Name: tempest-VolumesNegativeTest-1636154340-project Oct 15 13:48:31.884999 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: Oct 15 13:48:31.884999 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-2138643627", "metadata": {"Type": "work"}}} Oct 15 13:48:31.884999 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: method: Oct 15 13:48:31.884999 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 15 13:48:31.886021 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-2138643627', 'metadata': {'Type': 'work'}}}} Oct 15 13:48:31.886021 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 15 13:48:31.886021 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 13:48:31.886021 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 15 13:48:31.886021 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 15 13:48:31.886021 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 15 13:48:31.886021 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi raise error Oct 15 13:48:31.886021 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Oct 15 13:48:31.886021 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Oct 15 13:48:31.886021 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 15 13:48:31.886021 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 15 13:48:31.886021 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Oct 15 13:48:31.886021 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 15 13:48:31.886021 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi '#$%' Oct 15 13:48:31.886021 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Oct 15 13:48:31.886021 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 13:48:31.886021 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Oct 15 13:48:31.886021 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 13:48:31.886021 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 13:48:31.886021 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 13:48:31.886021 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 15 13:48:31.886021 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 15 13:48:31.887420 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 15 13:48:31.887420 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 15 13:48:31.887420 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 15 13:48:31.887420 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 15 13:48:31.887420 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 15 13:48:31.887420 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 15 13:48:31.887420 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 15 13:48:31.887420 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 15 13:48:31.887420 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 15 13:48:31.887420 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 15 13:48:31.887420 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 15 13:48:31.887420 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Oct 15 13:48:31.887420 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 13:48:31.887420 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Oct 15 13:48:31.887420 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 13:48:31.887420 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 13:48:31.887420 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 13:48:31.887420 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 15 13:48:31.887420 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 15 13:48:31.888837 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 15 13:48:31.888837 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Oct 15 13:48:31.888837 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-1af114ff-a1b7-4ce9-9f8b-d994d951ddc5 tempest-VolumesNegativeTest-1636154340 tempest-VolumesNegativeTest-1636154340-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=125243) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 15 13:48:31.888837 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-1af114ff-a1b7-4ce9-9f8b-d994d951ddc5 tempest-VolumesNegativeTest-1636154340 tempest-VolumesNegativeTest-1636154340-project] 10.222.0.36 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 2.182542 Oct 15 13:48:31.888837 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 1/1] 10.222.0.36 () {60 vars in 1156 bytes} [Sat Oct 15 13:48:29 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 2185 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 15 13:48:32.039196 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-13e9cb7b-3d93-4f6b-922c-1dd63fbb6968 tempest-VolumesSnapshotsTestJSON-1222309969 tempest-VolumesSnapshotsTestJSON-1222309969-project] Action: 'create', calling method: .version_select at 0x7f1b5f28fe50>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1142523282"}} {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 13:48:32.321238 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-cde14fe8-425d-4363-a2e8-0885defbe8c1 tempest-VolumesGetTestJSON-825535435 tempest-VolumesGetTestJSON-825535435-project] Action: 'create', calling method: .version_select at 0x7f1b5f2904c0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1944219845", "metadata": {"Type": "work"}}} {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 13:48:33.560861 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-13e9cb7b-3d93-4f6b-922c-1dd63fbb6968 tempest-VolumesSnapshotsTestJSON-1222309969 tempest-VolumesSnapshotsTestJSON-1222309969-project] 10.222.0.36 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 1.673188 Oct 15 13:48:33.563371 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 2/2] 10.222.0.36 () {60 vars in 1155 bytes} [Sat Oct 15 13:48:31 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 1677 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 15 13:48:33.572623 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-92501145-fd42-47bf-8005-bb47cf8d5adc tempest-VolumesNegativeTest-1636154340 tempest-VolumesNegativeTest-1636154340-project] Action: 'create', calling method: .version_select at 0x7f1b5f121940>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-331942967", "metadata": {"Type": "work"}}} {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 13:48:33.591416 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-92501145-fd42-47bf-8005-bb47cf8d5adc tempest-VolumesNegativeTest-1636154340 tempest-VolumesNegativeTest-1636154340-project] Request method failure captured: Oct 15 13:48:33.591416 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 15 13:48:33.591416 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: Accept: application/json Oct 15 13:48:33.591416 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: Accept-Encoding: identity Oct 15 13:48:33.591416 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: Connection: close Oct 15 13:48:33.591416 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: Content-Length: 119 Oct 15 13:48:33.591416 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: Content-Type: application/json Oct 15 13:48:33.591416 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: Host: 10.222.0.36 Oct 15 13:48:33.591416 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: Openstack-System-Scope: None Oct 15 13:48:33.591416 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: User-Agent: python-urllib3/1.26.12 Oct 15 13:48:33.591416 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Auth-Token: gAAAAABjSrotIrYdwSaLLW9kWh645vDPIyhxQheJcP3kmd0wTgWpMNMlVyg0SnBD1xdqxOT96n-qCeYAJzqxBUMu-wjQ8XNVjASiCoYgfGf9QBTFoFvX29gKjuO739a9xi5b-8_Xkt7pbkRJ27lyi_bCutUbbk3Iz-8G09jW1qJLPReQftP8rQQ Oct 15 13:48:33.591416 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Domain-Id: None Oct 15 13:48:33.591416 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Domain-Name: None Oct 15 13:48:33.591416 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Identity-Status: Confirmed Oct 15 13:48:33.591416 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Is-Admin-Project: True Oct 15 13:48:33.591416 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Project-Domain-Id: default Oct 15 13:48:33.591416 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Project-Domain-Name: Default Oct 15 13:48:33.591416 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Project-Id: 080f5405f5a44718858ccbc99dc49680 Oct 15 13:48:33.591416 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Project-Name: tempest-VolumesNegativeTest-1636154340 Oct 15 13:48:33.591416 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Role: member,reader Oct 15 13:48:33.591416 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Roles: member,reader Oct 15 13:48:33.593199 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_080f5405f5a44718858ccbc99dc49680", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/080f5405f5a44718858ccbc99dc49680"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/080f5405f5a44718858ccbc99dc49680"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/080f5405f5a44718858ccbc99dc49680"}]}] Oct 15 13:48:33.593199 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Tenant: tempest-VolumesNegativeTest-1636154340 Oct 15 13:48:33.593199 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Tenant-Id: 080f5405f5a44718858ccbc99dc49680 Oct 15 13:48:33.593199 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Tenant-Name: tempest-VolumesNegativeTest-1636154340 Oct 15 13:48:33.593199 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-User: tempest-VolumesNegativeTest-1636154340-project Oct 15 13:48:33.593199 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-User-Domain-Id: default Oct 15 13:48:33.593199 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-User-Domain-Name: Default Oct 15 13:48:33.593199 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-User-Id: 8b3f059dc7e04446a8f04da22761c30f Oct 15 13:48:33.593199 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-User-Name: tempest-VolumesNegativeTest-1636154340-project Oct 15 13:48:33.593199 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: Oct 15 13:48:33.593199 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-331942967", "metadata": {"Type": "work"}}} Oct 15 13:48:33.593199 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: method: Oct 15 13:48:33.593199 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 15 13:48:33.594087 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-331942967', 'metadata': {'Type': 'work'}}}} Oct 15 13:48:33.594087 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 15 13:48:33.594087 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 13:48:33.594087 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 15 13:48:33.594087 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 15 13:48:33.594087 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 15 13:48:33.594087 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi raise error Oct 15 13:48:33.594087 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 15 13:48:33.594087 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Oct 15 13:48:33.594087 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Oct 15 13:48:33.594087 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 15 13:48:33.594087 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Oct 15 13:48:33.594087 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 15 13:48:33.594087 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi '0' Oct 15 13:48:33.594087 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Oct 15 13:48:33.594087 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 13:48:33.594087 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Oct 15 13:48:33.594087 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 13:48:33.594087 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 13:48:33.594087 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 13:48:33.594087 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 15 13:48:33.594087 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 15 13:48:33.595490 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 15 13:48:33.595490 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 15 13:48:33.595490 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 15 13:48:33.595490 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 15 13:48:33.595490 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 15 13:48:33.595490 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 15 13:48:33.595490 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 15 13:48:33.595490 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 15 13:48:33.595490 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 15 13:48:33.595490 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 15 13:48:33.595490 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 15 13:48:33.595490 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Oct 15 13:48:33.595490 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 13:48:33.595490 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Oct 15 13:48:33.595490 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 13:48:33.595490 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 13:48:33.595490 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 13:48:33.595490 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 15 13:48:33.595490 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 15 13:48:33.600082 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 15 13:48:33.600082 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Oct 15 13:48:33.602302 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-92501145-fd42-47bf-8005-bb47cf8d5adc tempest-VolumesNegativeTest-1636154340 tempest-VolumesNegativeTest-1636154340-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=125243) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 15 13:48:33.603837 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-92501145-fd42-47bf-8005-bb47cf8d5adc tempest-VolumesNegativeTest-1636154340 tempest-VolumesNegativeTest-1636154340-project] 10.222.0.36 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.038957 Oct 15 13:48:33.605067 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 3/3] 10.222.0.36 () {60 vars in 1156 bytes} [Sat Oct 15 13:48:33 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 41 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 15 13:48:33.615287 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-fb5b7c08-4187-458a-9121-d7b19e5fd1ba tempest-VolumesSnapshotsTestJSON-1222309969 tempest-VolumesSnapshotsTestJSON-1222309969-project] Calling method '.version_select at 0x7f1b5f26d9d0>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:48:33.713314 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-cde14fe8-425d-4363-a2e8-0885defbe8c1 tempest-VolumesGetTestJSON-825535435 tempest-VolumesGetTestJSON-825535435-project] 10.222.0.36 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 2.751311 Oct 15 13:48:33.729316 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 1/4] 10.222.0.36 () {60 vars in 1156 bytes} [Sat Oct 15 13:48:30 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 2770 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 15 13:48:33.740253 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-fb5b7c08-4187-458a-9121-d7b19e5fd1ba tempest-VolumesSnapshotsTestJSON-1222309969 tempest-VolumesSnapshotsTestJSON-1222309969-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/53c6122a-415b-429a-a33f-0fb85604c6c4" status: 200 len: 345 microversion: 2.1 time: 0.133754 Oct 15 13:48:33.741122 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 4/5] 10.222.0.36 () {58 vars in 1245 bytes} [Sat Oct 15 13:48:33 2022] GET /compute/v2.1/os-volumes/53c6122a-415b-429a-a33f-0fb85604c6c4 => generated 345 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 13:48:33.745239 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-9c73abbb-9a40-428e-8e4f-1676e9ebc164 tempest-VolumesNegativeTest-1636154340 tempest-VolumesNegativeTest-1636154340-project] Action: 'create', calling method: .version_select at 0x7f1b5f165310>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-557992751", "metadata": {"Type": "work"}}} {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 13:48:33.748704 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-1670f176-fa53-4a5f-a125-60ba61adf9ae tempest-VolumesGetTestJSON-825535435 tempest-VolumesGetTestJSON-825535435-project] Calling method '.version_select at 0x7f1b5f133790>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:48:33.754970 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-9c73abbb-9a40-428e-8e4f-1676e9ebc164 tempest-VolumesNegativeTest-1636154340 tempest-VolumesNegativeTest-1636154340-project] Request method failure captured: Oct 15 13:48:33.754970 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 15 13:48:33.754970 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Accept: application/json Oct 15 13:48:33.754970 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Accept-Encoding: identity Oct 15 13:48:33.754970 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Connection: close Oct 15 13:48:33.754970 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Content-Length: 118 Oct 15 13:48:33.754970 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Content-Type: application/json Oct 15 13:48:33.754970 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Host: 10.222.0.36 Oct 15 13:48:33.754970 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Openstack-System-Scope: None Oct 15 13:48:33.754970 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: User-Agent: python-urllib3/1.26.12 Oct 15 13:48:33.754970 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Auth-Token: gAAAAABjSrotIrYdwSaLLW9kWh645vDPIyhxQheJcP3kmd0wTgWpMNMlVyg0SnBD1xdqxOT96n-qCeYAJzqxBUMu-wjQ8XNVjASiCoYgfGf9QBTFoFvX29gKjuO739a9xi5b-8_Xkt7pbkRJ27lyi_bCutUbbk3Iz-8G09jW1qJLPReQftP8rQQ Oct 15 13:48:33.754970 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Domain-Id: None Oct 15 13:48:33.754970 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Domain-Name: None Oct 15 13:48:33.754970 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Identity-Status: Confirmed Oct 15 13:48:33.754970 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Is-Admin-Project: True Oct 15 13:48:33.754970 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Project-Domain-Id: default Oct 15 13:48:33.754970 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Project-Domain-Name: Default Oct 15 13:48:33.754970 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Project-Id: 080f5405f5a44718858ccbc99dc49680 Oct 15 13:48:33.754970 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Project-Name: tempest-VolumesNegativeTest-1636154340 Oct 15 13:48:33.754970 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Role: member,reader Oct 15 13:48:33.754970 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Roles: member,reader Oct 15 13:48:33.757654 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_080f5405f5a44718858ccbc99dc49680", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/080f5405f5a44718858ccbc99dc49680"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/080f5405f5a44718858ccbc99dc49680"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/080f5405f5a44718858ccbc99dc49680"}]}] Oct 15 13:48:33.757654 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Tenant: tempest-VolumesNegativeTest-1636154340 Oct 15 13:48:33.757654 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Tenant-Id: 080f5405f5a44718858ccbc99dc49680 Oct 15 13:48:33.757654 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Tenant-Name: tempest-VolumesNegativeTest-1636154340 Oct 15 13:48:33.757654 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-User: tempest-VolumesNegativeTest-1636154340-project Oct 15 13:48:33.757654 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-User-Domain-Id: default Oct 15 13:48:33.757654 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-User-Domain-Name: Default Oct 15 13:48:33.757654 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-User-Id: 8b3f059dc7e04446a8f04da22761c30f Oct 15 13:48:33.757654 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-User-Name: tempest-VolumesNegativeTest-1636154340-project Oct 15 13:48:33.757654 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Oct 15 13:48:33.757654 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-557992751", "metadata": {"Type": "work"}}} Oct 15 13:48:33.757654 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: method: Oct 15 13:48:33.757654 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 15 13:48:33.759093 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-557992751', 'metadata': {'Type': 'work'}}}} Oct 15 13:48:33.759093 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 15 13:48:33.759093 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 13:48:33.759093 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 15 13:48:33.759093 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 15 13:48:33.759093 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 15 13:48:33.759093 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi raise error Oct 15 13:48:33.759093 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Oct 15 13:48:33.759093 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Oct 15 13:48:33.759093 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 15 13:48:33.759093 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 15 13:48:33.759093 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Oct 15 13:48:33.759093 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 15 13:48:33.759093 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi '' Oct 15 13:48:33.759093 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Oct 15 13:48:33.759093 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 13:48:33.759093 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Oct 15 13:48:33.759093 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 13:48:33.759093 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 13:48:33.759093 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 13:48:33.759093 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 15 13:48:33.759093 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 15 13:48:33.763374 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 15 13:48:33.763374 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 15 13:48:33.763374 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 15 13:48:33.763374 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 15 13:48:33.763374 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 15 13:48:33.763374 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 15 13:48:33.763374 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 15 13:48:33.763374 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 15 13:48:33.763374 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 15 13:48:33.763374 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 15 13:48:33.763374 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 15 13:48:33.763374 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Oct 15 13:48:33.763374 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 13:48:33.763374 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Oct 15 13:48:33.763374 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 13:48:33.763374 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 13:48:33.763374 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 13:48:33.763374 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 15 13:48:33.763374 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 15 13:48:33.769723 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 15 13:48:33.769723 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Oct 15 13:48:33.769723 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-9c73abbb-9a40-428e-8e4f-1676e9ebc164 tempest-VolumesNegativeTest-1636154340 tempest-VolumesNegativeTest-1636154340-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=125242) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 15 13:48:33.770445 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-9c73abbb-9a40-428e-8e4f-1676e9ebc164 tempest-VolumesNegativeTest-1636154340 tempest-VolumesNegativeTest-1636154340-project] 10.222.0.36 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.036760 Oct 15 13:48:33.779527 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 2/6] 10.222.0.36 () {60 vars in 1156 bytes} [Sat Oct 15 13:48:33 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 49 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 15 13:48:33.789789 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-f4a77651-ada5-4fc2-86c5-799216857572 tempest-VolumesNegativeTest-1636154340 tempest-VolumesNegativeTest-1636154340-project] Calling method '.version_select at 0x7f1b5f0f7d30>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:48:33.874100 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.wsgi [None req-f4a77651-ada5-4fc2-86c5-799216857572 tempest-VolumesNegativeTest-1636154340 tempest-VolumesNegativeTest-1636154340-project] HTTP exception thrown: Volume tempest-invalid-852492513 could not be found. Oct 15 13:48:33.895287 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-f4a77651-ada5-4fc2-86c5-799216857572 tempest-VolumesNegativeTest-1636154340 tempest-VolumesNegativeTest-1636154340-project] Request method failure captured: Oct 15 13:48:33.895287 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-852492513 HTTP/1.1 Oct 15 13:48:33.895287 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Accept: application/json Oct 15 13:48:33.895287 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Accept-Encoding: identity Oct 15 13:48:33.895287 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Connection: close Oct 15 13:48:33.895287 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Content-Length: 0 Oct 15 13:48:33.895287 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Content-Type: application/json Oct 15 13:48:33.895287 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Host: 10.222.0.36 Oct 15 13:48:33.895287 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Openstack-System-Scope: None Oct 15 13:48:33.895287 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: User-Agent: python-urllib3/1.26.12 Oct 15 13:48:33.895287 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Auth-Token: gAAAAABjSrotIrYdwSaLLW9kWh645vDPIyhxQheJcP3kmd0wTgWpMNMlVyg0SnBD1xdqxOT96n-qCeYAJzqxBUMu-wjQ8XNVjASiCoYgfGf9QBTFoFvX29gKjuO739a9xi5b-8_Xkt7pbkRJ27lyi_bCutUbbk3Iz-8G09jW1qJLPReQftP8rQQ Oct 15 13:48:33.895287 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Domain-Id: None Oct 15 13:48:33.895287 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Domain-Name: None Oct 15 13:48:33.895287 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Identity-Status: Confirmed Oct 15 13:48:33.895287 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Is-Admin-Project: True Oct 15 13:48:33.895287 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Project-Domain-Id: default Oct 15 13:48:33.895287 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Project-Domain-Name: Default Oct 15 13:48:33.895287 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Project-Id: 080f5405f5a44718858ccbc99dc49680 Oct 15 13:48:33.895287 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Project-Name: tempest-VolumesNegativeTest-1636154340 Oct 15 13:48:33.895287 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Role: member,reader Oct 15 13:48:33.895287 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Roles: member,reader Oct 15 13:48:33.897733 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_080f5405f5a44718858ccbc99dc49680", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/080f5405f5a44718858ccbc99dc49680"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/080f5405f5a44718858ccbc99dc49680"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/080f5405f5a44718858ccbc99dc49680"}]}] Oct 15 13:48:33.897733 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Tenant: tempest-VolumesNegativeTest-1636154340 Oct 15 13:48:33.897733 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Tenant-Id: 080f5405f5a44718858ccbc99dc49680 Oct 15 13:48:33.897733 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Tenant-Name: tempest-VolumesNegativeTest-1636154340 Oct 15 13:48:33.897733 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-User: tempest-VolumesNegativeTest-1636154340-project Oct 15 13:48:33.897733 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-User-Domain-Id: default Oct 15 13:48:33.897733 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-User-Domain-Name: Default Oct 15 13:48:33.897733 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-User-Id: 8b3f059dc7e04446a8f04da22761c30f Oct 15 13:48:33.897733 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-User-Name: tempest-VolumesNegativeTest-1636154340-project Oct 15 13:48:33.897733 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: method: Oct 15 13:48:33.897733 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: exception: Volume tempest-invalid-852492513 could not be found. Oct 15 13:48:33.897733 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: action_args: {'id': 'tempest-invalid-852492513'} Oct 15 13:48:33.897733 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 15 13:48:33.899179 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 13:48:33.899179 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 15 13:48:33.899179 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 15 13:48:33.899179 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 15 13:48:33.899179 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 15 13:48:33.899179 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 15 13:48:33.899179 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 15 13:48:33.899179 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 15 13:48:33.899179 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 15 13:48:33.899179 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 15 13:48:33.899179 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 15 13:48:33.899179 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 15 13:48:33.899179 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 15 13:48:33.899179 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 15 13:48:33.899179 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 15 13:48:33.899179 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-852492513 could not be found. (HTTP 404) (Request-ID: req-0c33999a-b9ed-4784-85e8-c7997f8f78ff) Oct 15 13:48:33.899179 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Oct 15 13:48:33.899179 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 13:48:33.899179 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Oct 15 13:48:33.903354 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 13:48:33.903354 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 15 13:48:33.903354 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 15 13:48:33.903354 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 15 13:48:33.903354 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 15 13:48:33.903354 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 15 13:48:33.903354 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 15 13:48:33.903354 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 15 13:48:33.903354 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 15 13:48:33.903354 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 15 13:48:33.903354 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 15 13:48:33.903354 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 15 13:48:33.903354 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 15 13:48:33.903354 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 15 13:48:33.903354 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 15 13:48:33.903354 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 15 13:48:33.903354 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 15 13:48:33.903354 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 15 13:48:33.903354 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 15 13:48:33.906724 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 15 13:48:33.906724 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 15 13:48:33.906724 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 15 13:48:33.906724 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 15 13:48:33.906724 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-852492513 could not be found. Oct 15 13:48:33.906724 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Oct 15 13:48:33.906724 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 13:48:33.906724 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Oct 15 13:48:33.906724 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 13:48:33.906724 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 13:48:33.906724 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 13:48:33.906724 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 15 13:48:33.906724 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 15 13:48:33.906724 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 15 13:48:33.906724 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 15 13:48:33.906724 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 15 13:48:33.906724 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 15 13:48:33.906724 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 15 13:48:33.906724 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 15 13:48:33.906724 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-852492513 could not be found. Oct 15 13:48:33.915044 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Oct 15 13:48:33.915044 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 13:48:33.915044 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Oct 15 13:48:33.915044 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 13:48:33.915044 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 13:48:33.915044 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 13:48:33.915044 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 15 13:48:33.915044 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 15 13:48:33.915044 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-852492513 could not be found. Oct 15 13:48:33.915044 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Oct 15 13:48:33.920768 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-f4a77651-ada5-4fc2-86c5-799216857572 tempest-VolumesNegativeTest-1636154340 tempest-VolumesNegativeTest-1636154340-project] Returning 404 to user: Volume tempest-invalid-852492513 could not be found. {{(pid=125242) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 15 13:48:33.926436 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-f4a77651-ada5-4fc2-86c5-799216857572 tempest-VolumesNegativeTest-1636154340 tempest-VolumesNegativeTest-1636154340-project] 10.222.0.36 "DELETE /compute/v2.1/os-volumes/tempest-invalid-852492513" status: 404 len: 98 microversion: 2.1 time: 0.144139 Oct 15 13:48:33.932171 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 3/7] 10.222.0.36 () {58 vars in 1215 bytes} [Sat Oct 15 13:48:33 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-852492513 => generated 98 bytes in 151 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 15 13:48:33.945724 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-1670f176-fa53-4a5f-a125-60ba61adf9ae tempest-VolumesGetTestJSON-825535435 tempest-VolumesGetTestJSON-825535435-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/c7e4b27b-6b5c-4947-814d-3630c7c470d2" status: 200 len: 353 microversion: 2.1 time: 0.203307 Oct 15 13:48:33.947157 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 5/8] 10.222.0.36 () {58 vars in 1245 bytes} [Sat Oct 15 13:48:33 2022] GET /compute/v2.1/os-volumes/c7e4b27b-6b5c-4947-814d-3630c7c470d2 => generated 353 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 13:48:33.974460 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-a2b43a15-9d2b-4144-bcfc-1a6cde77b7b6 tempest-VolumesNegativeTest-1636154340 tempest-VolumesNegativeTest-1636154340-project] 10.222.0.36 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.034457 Oct 15 13:48:33.975931 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 4/9] 10.222.0.36 () {58 vars in 1140 bytes} [Sat Oct 15 13:48:33 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 15 13:48:33.985714 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-657e4333-7dc3-413f-8e94-672f44748b1c tempest-VolumesNegativeTest-1636154340 tempest-VolumesNegativeTest-1636154340-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004078 Oct 15 13:48:33.992281 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 6/10] 10.222.0.36 () {58 vars in 1137 bytes} [Sat Oct 15 13:48:33 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 15 13:48:34.001722 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-3cbc3079-f2b2-4762-8d48-a11621fc49ec tempest-VolumesNegativeTest-1636154340 tempest-VolumesNegativeTest-1636154340-project] Calling method '.version_select at 0x7f1b5f0873a0>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:48:34.057598 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.wsgi [None req-3cbc3079-f2b2-4762-8d48-a11621fc49ec tempest-VolumesNegativeTest-1636154340 tempest-VolumesNegativeTest-1636154340-project] HTTP exception thrown: Volume 873379b0-831e-4d1e-b5f3-a86097badb4e could not be found. Oct 15 13:48:34.060263 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-3cbc3079-f2b2-4762-8d48-a11621fc49ec tempest-VolumesNegativeTest-1636154340 tempest-VolumesNegativeTest-1636154340-project] Request method failure captured: Oct 15 13:48:34.060263 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: request: DELETE /compute/v2.1/os-volumes/873379b0-831e-4d1e-b5f3-a86097badb4e HTTP/1.1 Oct 15 13:48:34.060263 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Accept: application/json Oct 15 13:48:34.060263 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Accept-Encoding: identity Oct 15 13:48:34.060263 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Connection: close Oct 15 13:48:34.060263 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Content-Length: 0 Oct 15 13:48:34.060263 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Content-Type: application/json Oct 15 13:48:34.060263 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Host: 10.222.0.36 Oct 15 13:48:34.060263 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Openstack-System-Scope: None Oct 15 13:48:34.060263 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: User-Agent: python-urllib3/1.26.12 Oct 15 13:48:34.060263 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Auth-Token: gAAAAABjSrotIrYdwSaLLW9kWh645vDPIyhxQheJcP3kmd0wTgWpMNMlVyg0SnBD1xdqxOT96n-qCeYAJzqxBUMu-wjQ8XNVjASiCoYgfGf9QBTFoFvX29gKjuO739a9xi5b-8_Xkt7pbkRJ27lyi_bCutUbbk3Iz-8G09jW1qJLPReQftP8rQQ Oct 15 13:48:34.060263 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Domain-Id: None Oct 15 13:48:34.060263 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Domain-Name: None Oct 15 13:48:34.060263 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Identity-Status: Confirmed Oct 15 13:48:34.060263 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Is-Admin-Project: True Oct 15 13:48:34.060263 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Project-Domain-Id: default Oct 15 13:48:34.060263 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Project-Domain-Name: Default Oct 15 13:48:34.060263 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Project-Id: 080f5405f5a44718858ccbc99dc49680 Oct 15 13:48:34.060263 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Project-Name: tempest-VolumesNegativeTest-1636154340 Oct 15 13:48:34.060263 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Role: member,reader Oct 15 13:48:34.060263 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Roles: member,reader Oct 15 13:48:34.062673 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_080f5405f5a44718858ccbc99dc49680", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/080f5405f5a44718858ccbc99dc49680"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/080f5405f5a44718858ccbc99dc49680"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/080f5405f5a44718858ccbc99dc49680"}]}] Oct 15 13:48:34.062673 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Tenant: tempest-VolumesNegativeTest-1636154340 Oct 15 13:48:34.062673 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Tenant-Id: 080f5405f5a44718858ccbc99dc49680 Oct 15 13:48:34.062673 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Tenant-Name: tempest-VolumesNegativeTest-1636154340 Oct 15 13:48:34.062673 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-User: tempest-VolumesNegativeTest-1636154340-project Oct 15 13:48:34.062673 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-User-Domain-Id: default Oct 15 13:48:34.062673 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-User-Domain-Name: Default Oct 15 13:48:34.062673 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-User-Id: 8b3f059dc7e04446a8f04da22761c30f Oct 15 13:48:34.062673 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-User-Name: tempest-VolumesNegativeTest-1636154340-project Oct 15 13:48:34.062673 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: method: Oct 15 13:48:34.062673 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: exception: Volume 873379b0-831e-4d1e-b5f3-a86097badb4e could not be found. Oct 15 13:48:34.062673 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: action_args: {'id': '873379b0-831e-4d1e-b5f3-a86097badb4e'} Oct 15 13:48:34.062673 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 15 13:48:34.064013 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 13:48:34.064013 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 15 13:48:34.064013 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 15 13:48:34.064013 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 15 13:48:34.064013 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 15 13:48:34.064013 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 15 13:48:34.064013 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 15 13:48:34.064013 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 15 13:48:34.064013 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 15 13:48:34.064013 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 15 13:48:34.064013 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 15 13:48:34.064013 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 15 13:48:34.064013 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 15 13:48:34.064013 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 15 13:48:34.064013 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 15 13:48:34.064013 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 873379b0-831e-4d1e-b5f3-a86097badb4e could not be found. (HTTP 404) (Request-ID: req-bf949686-d0a3-4369-89c5-0273e90d669d) Oct 15 13:48:34.064013 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Oct 15 13:48:34.064013 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 13:48:34.064013 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Oct 15 13:48:34.066032 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 13:48:34.066032 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 15 13:48:34.066032 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 15 13:48:34.066032 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 15 13:48:34.066032 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 15 13:48:34.066032 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 15 13:48:34.066032 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 15 13:48:34.066032 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 15 13:48:34.066032 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 15 13:48:34.066032 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 15 13:48:34.066032 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 15 13:48:34.066032 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 15 13:48:34.066032 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 15 13:48:34.066032 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 15 13:48:34.066032 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 15 13:48:34.066032 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 15 13:48:34.066032 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 15 13:48:34.066032 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 15 13:48:34.066032 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 15 13:48:34.070630 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 15 13:48:34.070630 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 15 13:48:34.070630 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 15 13:48:34.070630 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 15 13:48:34.070630 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 873379b0-831e-4d1e-b5f3-a86097badb4e could not be found. Oct 15 13:48:34.070630 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Oct 15 13:48:34.070630 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 13:48:34.070630 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Oct 15 13:48:34.070630 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 13:48:34.070630 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 13:48:34.070630 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 13:48:34.070630 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 15 13:48:34.070630 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 15 13:48:34.070630 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 15 13:48:34.070630 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 15 13:48:34.070630 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 15 13:48:34.070630 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 15 13:48:34.070630 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 15 13:48:34.070630 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 15 13:48:34.076568 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 873379b0-831e-4d1e-b5f3-a86097badb4e could not be found. Oct 15 13:48:34.076568 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Oct 15 13:48:34.076568 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 13:48:34.076568 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Oct 15 13:48:34.076568 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 13:48:34.076568 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 13:48:34.076568 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 13:48:34.076568 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 15 13:48:34.076568 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 15 13:48:34.076568 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 873379b0-831e-4d1e-b5f3-a86097badb4e could not be found. Oct 15 13:48:34.076568 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Oct 15 13:48:34.076568 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-3cbc3079-f2b2-4762-8d48-a11621fc49ec tempest-VolumesNegativeTest-1636154340 tempest-VolumesNegativeTest-1636154340-project] Returning 404 to user: Volume 873379b0-831e-4d1e-b5f3-a86097badb4e could not be found. {{(pid=125242) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 15 13:48:34.076568 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-3cbc3079-f2b2-4762-8d48-a11621fc49ec tempest-VolumesNegativeTest-1636154340 tempest-VolumesNegativeTest-1636154340-project] 10.222.0.36 "DELETE /compute/v2.1/os-volumes/873379b0-831e-4d1e-b5f3-a86097badb4e" status: 404 len: 109 microversion: 2.1 time: 0.066476 Oct 15 13:48:34.076568 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 5/11] 10.222.0.36 () {58 vars in 1248 bytes} [Sat Oct 15 13:48:33 2022] DELETE /compute/v2.1/os-volumes/873379b0-831e-4d1e-b5f3-a86097badb4e => generated 109 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 15 13:48:34.079666 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-47350908-cda6-4038-bcef-a6cab9ae7545 tempest-VolumesNegativeTest-1636154340 tempest-VolumesNegativeTest-1636154340-project] Calling method '.version_select at 0x7f1b5f1330d0>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:48:34.129495 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.wsgi [None req-47350908-cda6-4038-bcef-a6cab9ae7545 tempest-VolumesNegativeTest-1636154340 tempest-VolumesNegativeTest-1636154340-project] HTTP exception thrown: Volume b2be6ddc-f3cc-4857-bf8b-6e34b63901ed could not be found. Oct 15 13:48:34.134972 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-47350908-cda6-4038-bcef-a6cab9ae7545 tempest-VolumesNegativeTest-1636154340 tempest-VolumesNegativeTest-1636154340-project] Request method failure captured: Oct 15 13:48:34.134972 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: request: GET /compute/v2.1/os-volumes/b2be6ddc-f3cc-4857-bf8b-6e34b63901ed HTTP/1.1 Oct 15 13:48:34.134972 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: Accept: application/json Oct 15 13:48:34.134972 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: Accept-Encoding: identity Oct 15 13:48:34.134972 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: Connection: close Oct 15 13:48:34.134972 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: Content-Length: 0 Oct 15 13:48:34.134972 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: Content-Type: application/json Oct 15 13:48:34.134972 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: Host: 10.222.0.36 Oct 15 13:48:34.134972 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: Openstack-System-Scope: None Oct 15 13:48:34.134972 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: User-Agent: python-urllib3/1.26.12 Oct 15 13:48:34.134972 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Auth-Token: gAAAAABjSrotIrYdwSaLLW9kWh645vDPIyhxQheJcP3kmd0wTgWpMNMlVyg0SnBD1xdqxOT96n-qCeYAJzqxBUMu-wjQ8XNVjASiCoYgfGf9QBTFoFvX29gKjuO739a9xi5b-8_Xkt7pbkRJ27lyi_bCutUbbk3Iz-8G09jW1qJLPReQftP8rQQ Oct 15 13:48:34.134972 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Domain-Id: None Oct 15 13:48:34.134972 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Domain-Name: None Oct 15 13:48:34.134972 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Identity-Status: Confirmed Oct 15 13:48:34.134972 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Is-Admin-Project: True Oct 15 13:48:34.134972 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Project-Domain-Id: default Oct 15 13:48:34.134972 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Project-Domain-Name: Default Oct 15 13:48:34.134972 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Project-Id: 080f5405f5a44718858ccbc99dc49680 Oct 15 13:48:34.134972 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Project-Name: tempest-VolumesNegativeTest-1636154340 Oct 15 13:48:34.134972 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Role: member,reader Oct 15 13:48:34.134972 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Roles: member,reader Oct 15 13:48:34.136756 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_080f5405f5a44718858ccbc99dc49680", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/080f5405f5a44718858ccbc99dc49680"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/080f5405f5a44718858ccbc99dc49680"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/080f5405f5a44718858ccbc99dc49680"}]}] Oct 15 13:48:34.136756 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Tenant: tempest-VolumesNegativeTest-1636154340 Oct 15 13:48:34.136756 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Tenant-Id: 080f5405f5a44718858ccbc99dc49680 Oct 15 13:48:34.136756 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Tenant-Name: tempest-VolumesNegativeTest-1636154340 Oct 15 13:48:34.136756 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-User: tempest-VolumesNegativeTest-1636154340-project Oct 15 13:48:34.136756 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-User-Domain-Id: default Oct 15 13:48:34.136756 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-User-Domain-Name: Default Oct 15 13:48:34.136756 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-User-Id: 8b3f059dc7e04446a8f04da22761c30f Oct 15 13:48:34.136756 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-User-Name: tempest-VolumesNegativeTest-1636154340-project Oct 15 13:48:34.136756 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: method: Oct 15 13:48:34.136756 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: exception: Volume b2be6ddc-f3cc-4857-bf8b-6e34b63901ed could not be found. Oct 15 13:48:34.136756 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: action_args: {'id': 'b2be6ddc-f3cc-4857-bf8b-6e34b63901ed'} Oct 15 13:48:34.136756 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 15 13:48:34.138308 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 13:48:34.138308 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 15 13:48:34.138308 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 15 13:48:34.138308 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 15 13:48:34.138308 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 15 13:48:34.138308 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 15 13:48:34.138308 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 15 13:48:34.138308 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 15 13:48:34.138308 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 15 13:48:34.138308 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 15 13:48:34.138308 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 15 13:48:34.138308 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 15 13:48:34.138308 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 15 13:48:34.138308 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 15 13:48:34.138308 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 15 13:48:34.138308 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b2be6ddc-f3cc-4857-bf8b-6e34b63901ed could not be found. (HTTP 404) (Request-ID: req-383aee4f-be66-4fed-b8d2-0c447b4bf1bf) Oct 15 13:48:34.138308 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Oct 15 13:48:34.138308 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 13:48:34.138308 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Oct 15 13:48:34.140196 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 13:48:34.140196 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 15 13:48:34.140196 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 15 13:48:34.140196 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 15 13:48:34.140196 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 15 13:48:34.140196 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 15 13:48:34.140196 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 15 13:48:34.140196 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 15 13:48:34.140196 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 15 13:48:34.140196 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 15 13:48:34.140196 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 15 13:48:34.140196 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 15 13:48:34.140196 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 15 13:48:34.140196 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 15 13:48:34.140196 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 15 13:48:34.140196 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 15 13:48:34.140196 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 15 13:48:34.140196 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 15 13:48:34.140196 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 15 13:48:34.144254 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 15 13:48:34.144254 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 15 13:48:34.144254 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 15 13:48:34.144254 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 15 13:48:34.144254 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b2be6ddc-f3cc-4857-bf8b-6e34b63901ed could not be found. Oct 15 13:48:34.144254 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Oct 15 13:48:34.144254 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 13:48:34.144254 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Oct 15 13:48:34.144254 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 13:48:34.144254 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 13:48:34.144254 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 13:48:34.144254 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 15 13:48:34.144254 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 15 13:48:34.144254 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 15 13:48:34.144254 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 15 13:48:34.144254 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 15 13:48:34.144254 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 15 13:48:34.144254 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 15 13:48:34.144254 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 15 13:48:34.145820 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b2be6ddc-f3cc-4857-bf8b-6e34b63901ed could not be found. Oct 15 13:48:34.145820 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Oct 15 13:48:34.145820 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 13:48:34.145820 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Oct 15 13:48:34.145820 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 13:48:34.145820 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 13:48:34.145820 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 13:48:34.145820 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 15 13:48:34.145820 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 15 13:48:34.145820 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b2be6ddc-f3cc-4857-bf8b-6e34b63901ed could not be found. Oct 15 13:48:34.145820 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Oct 15 13:48:34.145820 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-47350908-cda6-4038-bcef-a6cab9ae7545 tempest-VolumesNegativeTest-1636154340 tempest-VolumesNegativeTest-1636154340-project] Returning 404 to user: Volume b2be6ddc-f3cc-4857-bf8b-6e34b63901ed could not be found. {{(pid=125243) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 15 13:48:34.145820 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-47350908-cda6-4038-bcef-a6cab9ae7545 tempest-VolumesNegativeTest-1636154340 tempest-VolumesNegativeTest-1636154340-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/b2be6ddc-f3cc-4857-bf8b-6e34b63901ed" status: 404 len: 109 microversion: 2.1 time: 0.065973 Oct 15 13:48:34.145820 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 7/12] 10.222.0.36 () {58 vars in 1245 bytes} [Sat Oct 15 13:48:34 2022] GET /compute/v2.1/os-volumes/b2be6ddc-f3cc-4857-bf8b-6e34b63901ed => generated 109 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 15 13:48:34.760777 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-b98dcfa2-7fc5-4b45-85e7-e73ef7c677a9 tempest-VolumesSnapshotsTestJSON-1222309969 tempest-VolumesSnapshotsTestJSON-1222309969-project] Calling method '.version_select at 0x7f1b5f165790>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:48:34.957486 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-b98dcfa2-7fc5-4b45-85e7-e73ef7c677a9 tempest-VolumesSnapshotsTestJSON-1222309969 tempest-VolumesSnapshotsTestJSON-1222309969-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/53c6122a-415b-429a-a33f-0fb85604c6c4" status: 200 len: 345 microversion: 2.1 time: 0.201306 Oct 15 13:48:34.958347 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 6/13] 10.222.0.36 () {58 vars in 1245 bytes} [Sat Oct 15 13:48:34 2022] GET /compute/v2.1/os-volumes/53c6122a-415b-429a-a33f-0fb85604c6c4 => generated 345 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 13:48:34.975081 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-f2933f89-a146-4dfa-8007-cedaf04a4afe tempest-VolumesGetTestJSON-825535435 tempest-VolumesGetTestJSON-825535435-project] Calling method '.version_select at 0x7f1b5f087040>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:48:35.195510 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-f2933f89-a146-4dfa-8007-cedaf04a4afe tempest-VolumesGetTestJSON-825535435 tempest-VolumesGetTestJSON-825535435-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/c7e4b27b-6b5c-4947-814d-3630c7c470d2" status: 200 len: 353 microversion: 2.1 time: 0.232428 Oct 15 13:48:35.196140 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 8/14] 10.222.0.36 () {58 vars in 1245 bytes} [Sat Oct 15 13:48:34 2022] GET /compute/v2.1/os-volumes/c7e4b27b-6b5c-4947-814d-3630c7c470d2 => generated 353 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 13:48:35.982523 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-9c8b35f9-bb06-4d0c-b2e1-39e22da2d4b9 tempest-VolumesSnapshotsTestJSON-1222309969 tempest-VolumesSnapshotsTestJSON-1222309969-project] Calling method '.version_select at 0x7f1b5f087790>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:48:36.113751 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-9c8b35f9-bb06-4d0c-b2e1-39e22da2d4b9 tempest-VolumesSnapshotsTestJSON-1222309969 tempest-VolumesSnapshotsTestJSON-1222309969-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/53c6122a-415b-429a-a33f-0fb85604c6c4" status: 200 len: 346 microversion: 2.1 time: 0.136697 Oct 15 13:48:36.115010 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 7/15] 10.222.0.36 () {58 vars in 1245 bytes} [Sat Oct 15 13:48:35 2022] GET /compute/v2.1/os-volumes/53c6122a-415b-429a-a33f-0fb85604c6c4 => generated 346 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 13:48:36.143193 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-60d039a3-9177-4eab-ae2e-dfd74fa43422 tempest-VolumesSnapshotsTestJSON-1222309969 tempest-VolumesSnapshotsTestJSON-1222309969-project] Action: 'create', calling method: .version_select at 0x7f1b5f087700>, body: {"snapshot": {"volume_id": "53c6122a-415b-429a-a33f-0fb85604c6c4", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1277425266"}} {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 13:48:36.216571 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-c1f9e0be-b9ee-4252-b91c-ba99817864c9 tempest-VolumesGetTestJSON-825535435 tempest-VolumesGetTestJSON-825535435-project] Calling method '.version_select at 0x7f1b5f087e50>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:48:36.348636 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-c1f9e0be-b9ee-4252-b91c-ba99817864c9 tempest-VolumesGetTestJSON-825535435 tempest-VolumesGetTestJSON-825535435-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/c7e4b27b-6b5c-4947-814d-3630c7c470d2" status: 200 len: 354 microversion: 2.1 time: 0.136427 Oct 15 13:48:36.349906 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 8/16] 10.222.0.36 () {58 vars in 1245 bytes} [Sat Oct 15 13:48:36 2022] GET /compute/v2.1/os-volumes/c7e4b27b-6b5c-4947-814d-3630c7c470d2 => generated 354 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 13:48:36.377850 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-8981b564-42ca-44e9-9606-178e7a753f33 tempest-VolumesGetTestJSON-825535435 tempest-VolumesGetTestJSON-825535435-project] Calling method '.version_select at 0x7f1b5f087790>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:48:36.513901 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-8981b564-42ca-44e9-9606-178e7a753f33 tempest-VolumesGetTestJSON-825535435 tempest-VolumesGetTestJSON-825535435-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/c7e4b27b-6b5c-4947-814d-3630c7c470d2" status: 200 len: 354 microversion: 2.1 time: 0.143922 Oct 15 13:48:36.514684 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 9/17] 10.222.0.36 () {58 vars in 1245 bytes} [Sat Oct 15 13:48:36 2022] GET /compute/v2.1/os-volumes/c7e4b27b-6b5c-4947-814d-3630c7c470d2 => generated 354 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 13:48:36.559567 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-99eea76a-7715-41ee-a14f-c7d952e9af80 tempest-VolumesGetTestJSON-825535435 tempest-VolumesGetTestJSON-825535435-project] Calling method '.version_select at 0x7f1b5f290550>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:48:36.723853 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-60d039a3-9177-4eab-ae2e-dfd74fa43422 tempest-VolumesSnapshotsTestJSON-1222309969 tempest-VolumesSnapshotsTestJSON-1222309969-project] 10.222.0.36 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.589775 Oct 15 13:48:36.724889 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 9/18] 10.222.0.36 () {60 vars in 1162 bytes} [Sat Oct 15 13:48:36 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 13:48:36.740714 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-19937cdc-b033-4184-94b0-99c7d7551686 tempest-VolumesSnapshotsTestJSON-1222309969 tempest-VolumesSnapshotsTestJSON-1222309969-project] Calling method '.version_select at 0x7f1b5f0879d0>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:48:36.815662 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-19937cdc-b033-4184-94b0-99c7d7551686 tempest-VolumesSnapshotsTestJSON-1222309969 tempest-VolumesSnapshotsTestJSON-1222309969-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/102cc44e-bf27-4d3d-ad27-026b6d352aec" status: 200 len: 287 microversion: 2.1 time: 0.079075 Oct 15 13:48:36.817652 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 10/19] 10.222.0.36 () {58 vars in 1251 bytes} [Sat Oct 15 13:48:36 2022] GET /compute/v2.1/os-snapshots/102cc44e-bf27-4d3d-ad27-026b6d352aec => generated 287 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 13:48:36.832979 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-fc91ac8c-202a-4952-b085-49837c6773f9 tempest-VolumesSnapshotsTestJSON-1222309969 tempest-VolumesSnapshotsTestJSON-1222309969-project] Calling method '.version_select at 0x7f1b5f087040>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:48:36.960021 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-fc91ac8c-202a-4952-b085-49837c6773f9 tempest-VolumesSnapshotsTestJSON-1222309969 tempest-VolumesSnapshotsTestJSON-1222309969-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.130787 Oct 15 13:48:36.964765 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 11/20] 10.222.0.36 () {58 vars in 1140 bytes} [Sat Oct 15 13:48:36 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 15 13:48:36.985719 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-09474a91-a4de-480d-a971-81ed5f5c91bd tempest-VolumesSnapshotsTestJSON-1222309969 tempest-VolumesSnapshotsTestJSON-1222309969-project] Calling method '.version_select at 0x7f1b5f08cb80>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:48:37.046709 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-09474a91-a4de-480d-a971-81ed5f5c91bd tempest-VolumesSnapshotsTestJSON-1222309969 tempest-VolumesSnapshotsTestJSON-1222309969-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/102cc44e-bf27-4d3d-ad27-026b6d352aec" status: 200 len: 287 microversion: 2.1 time: 0.066110 Oct 15 13:48:37.048552 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 12/21] 10.222.0.36 () {58 vars in 1251 bytes} [Sat Oct 15 13:48:36 2022] GET /compute/v2.1/os-snapshots/102cc44e-bf27-4d3d-ad27-026b6d352aec => generated 287 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 15 13:48:37.169395 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-99eea76a-7715-41ee-a14f-c7d952e9af80 tempest-VolumesGetTestJSON-825535435 tempest-VolumesGetTestJSON-825535435-project] 10.222.0.36 "DELETE /compute/v2.1/os-volumes/c7e4b27b-6b5c-4947-814d-3630c7c470d2" status: 202 len: 0 microversion: 2.1 time: 0.614221 Oct 15 13:48:37.172035 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 10/22] 10.222.0.36 () {58 vars in 1248 bytes} [Sat Oct 15 13:48:36 2022] DELETE /compute/v2.1/os-volumes/c7e4b27b-6b5c-4947-814d-3630c7c470d2 => generated 0 bytes in 618 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 15 13:48:37.182355 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-b3a34aa1-217b-47aa-9a61-392f874caa9c tempest-VolumesGetTestJSON-825535435 tempest-VolumesGetTestJSON-825535435-project] Calling method '.version_select at 0x7f1b5f087ee0>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:48:37.583579 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-b3a34aa1-217b-47aa-9a61-392f874caa9c tempest-VolumesGetTestJSON-825535435 tempest-VolumesGetTestJSON-825535435-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/c7e4b27b-6b5c-4947-814d-3630c7c470d2" status: 200 len: 353 microversion: 2.1 time: 0.405623 Oct 15 13:48:37.585247 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 13/23] 10.222.0.36 () {58 vars in 1245 bytes} [Sat Oct 15 13:48:37 2022] GET /compute/v2.1/os-volumes/c7e4b27b-6b5c-4947-814d-3630c7c470d2 => generated 353 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 13:48:38.073297 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-86eaf7d4-62e6-464c-85cb-7fb2a7710f7b tempest-VolumesSnapshotsTestJSON-1222309969 tempest-VolumesSnapshotsTestJSON-1222309969-project] Calling method '.version_select at 0x7f1b5f1651f0>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:48:38.241219 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-86eaf7d4-62e6-464c-85cb-7fb2a7710f7b tempest-VolumesSnapshotsTestJSON-1222309969 tempest-VolumesSnapshotsTestJSON-1222309969-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/102cc44e-bf27-4d3d-ad27-026b6d352aec" status: 200 len: 287 microversion: 2.1 time: 0.177253 Oct 15 13:48:38.242373 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 11/24] 10.222.0.36 () {58 vars in 1251 bytes} [Sat Oct 15 13:48:38 2022] GET /compute/v2.1/os-snapshots/102cc44e-bf27-4d3d-ad27-026b6d352aec => generated 287 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 13:48:38.608854 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-dd0d4d88-58f3-49c7-83ea-23f9a33f19ac tempest-VolumesGetTestJSON-825535435 tempest-VolumesGetTestJSON-825535435-project] Calling method '.version_select at 0x7f1b5f087160>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:48:38.742957 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-dd0d4d88-58f3-49c7-83ea-23f9a33f19ac tempest-VolumesGetTestJSON-825535435 tempest-VolumesGetTestJSON-825535435-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/c7e4b27b-6b5c-4947-814d-3630c7c470d2" status: 200 len: 353 microversion: 2.1 time: 0.141922 Oct 15 13:48:38.744505 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 14/25] 10.222.0.36 () {58 vars in 1245 bytes} [Sat Oct 15 13:48:38 2022] GET /compute/v2.1/os-volumes/c7e4b27b-6b5c-4947-814d-3630c7c470d2 => generated 353 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 15 13:48:39.297830 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-aa6e9082-4bed-4917-aede-9ec6721f4807 tempest-VolumesSnapshotsTestJSON-1222309969 tempest-VolumesSnapshotsTestJSON-1222309969-project] Calling method '.version_select at 0x7f1b5f0f7d30>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:48:39.465242 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-aa6e9082-4bed-4917-aede-9ec6721f4807 tempest-VolumesSnapshotsTestJSON-1222309969 tempest-VolumesSnapshotsTestJSON-1222309969-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/102cc44e-bf27-4d3d-ad27-026b6d352aec" status: 200 len: 287 microversion: 2.1 time: 0.208938 Oct 15 13:48:39.466608 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 12/26] 10.222.0.36 () {58 vars in 1251 bytes} [Sat Oct 15 13:48:39 2022] GET /compute/v2.1/os-snapshots/102cc44e-bf27-4d3d-ad27-026b6d352aec => generated 287 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 13:48:39.763921 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-0f968338-2e25-4bb8-a30e-561e63e51332 tempest-VolumesGetTestJSON-825535435 tempest-VolumesGetTestJSON-825535435-project] Calling method '.version_select at 0x7f1b5f087a60>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:48:40.083741 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-0f968338-2e25-4bb8-a30e-561e63e51332 tempest-VolumesGetTestJSON-825535435 tempest-VolumesGetTestJSON-825535435-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/c7e4b27b-6b5c-4947-814d-3630c7c470d2" status: 200 len: 353 microversion: 2.1 time: 0.327432 Oct 15 13:48:40.098825 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 15/27] 10.222.0.36 () {58 vars in 1245 bytes} [Sat Oct 15 13:48:39 2022] GET /compute/v2.1/os-volumes/c7e4b27b-6b5c-4947-814d-3630c7c470d2 => generated 353 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 13:48:40.499245 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-dfb61817-82e1-44a3-9d60-53cea23c6d10 tempest-VolumesSnapshotsTestJSON-1222309969 tempest-VolumesSnapshotsTestJSON-1222309969-project] Calling method '.version_select at 0x7f1b5f087ee0>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:48:40.631522 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-dfb61817-82e1-44a3-9d60-53cea23c6d10 tempest-VolumesSnapshotsTestJSON-1222309969 tempest-VolumesSnapshotsTestJSON-1222309969-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/102cc44e-bf27-4d3d-ad27-026b6d352aec" status: 200 len: 287 microversion: 2.1 time: 0.155383 Oct 15 13:48:40.635117 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 13/28] 10.222.0.36 () {58 vars in 1251 bytes} [Sat Oct 15 13:48:40 2022] GET /compute/v2.1/os-snapshots/102cc44e-bf27-4d3d-ad27-026b6d352aec => generated 287 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 13:48:41.105741 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-4feaca85-0b88-447d-abc9-e07824a42e52 tempest-VolumesGetTestJSON-825535435 tempest-VolumesGetTestJSON-825535435-project] Calling method '.version_select at 0x7f1b5f08c8b0>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:48:41.266108 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-4feaca85-0b88-447d-abc9-e07824a42e52 tempest-VolumesGetTestJSON-825535435 tempest-VolumesGetTestJSON-825535435-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/c7e4b27b-6b5c-4947-814d-3630c7c470d2" status: 200 len: 353 microversion: 2.1 time: 0.165430 Oct 15 13:48:41.266703 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 16/29] 10.222.0.36 () {58 vars in 1245 bytes} [Sat Oct 15 13:48:41 2022] GET /compute/v2.1/os-volumes/c7e4b27b-6b5c-4947-814d-3630c7c470d2 => generated 353 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 15 13:48:41.648020 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-f1290c95-83e6-48d3-959e-914180b6377c tempest-VolumesSnapshotsTestJSON-1222309969 tempest-VolumesSnapshotsTestJSON-1222309969-project] Calling method '.version_select at 0x7f1b5f087280>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:48:41.769898 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-f1290c95-83e6-48d3-959e-914180b6377c tempest-VolumesSnapshotsTestJSON-1222309969 tempest-VolumesSnapshotsTestJSON-1222309969-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/102cc44e-bf27-4d3d-ad27-026b6d352aec" status: 200 len: 287 microversion: 2.1 time: 0.127356 Oct 15 13:48:41.775809 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 14/30] 10.222.0.36 () {58 vars in 1251 bytes} [Sat Oct 15 13:48:41 2022] GET /compute/v2.1/os-snapshots/102cc44e-bf27-4d3d-ad27-026b6d352aec => generated 287 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 13:48:42.285450 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-ee89b929-ceb2-436e-8bc4-5bca85e714b2 tempest-VolumesGetTestJSON-825535435 tempest-VolumesGetTestJSON-825535435-project] Calling method '.version_select at 0x7f1b5f087160>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:48:42.475752 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-ee89b929-ceb2-436e-8bc4-5bca85e714b2 tempest-VolumesGetTestJSON-825535435 tempest-VolumesGetTestJSON-825535435-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/c7e4b27b-6b5c-4947-814d-3630c7c470d2" status: 200 len: 353 microversion: 2.1 time: 0.197327 Oct 15 13:48:42.476825 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 17/31] 10.222.0.36 () {58 vars in 1245 bytes} [Sat Oct 15 13:48:42 2022] GET /compute/v2.1/os-volumes/c7e4b27b-6b5c-4947-814d-3630c7c470d2 => generated 353 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 13:48:42.784142 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-551d9165-6bb5-496f-a52f-6a9a93d71b6d tempest-VolumesSnapshotsTestJSON-1222309969 tempest-VolumesSnapshotsTestJSON-1222309969-project] Calling method '.version_select at 0x7f1b5f093160>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:48:42.931785 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-551d9165-6bb5-496f-a52f-6a9a93d71b6d tempest-VolumesSnapshotsTestJSON-1222309969 tempest-VolumesSnapshotsTestJSON-1222309969-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/102cc44e-bf27-4d3d-ad27-026b6d352aec" status: 200 len: 287 microversion: 2.1 time: 0.152083 Oct 15 13:48:42.945143 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 15/32] 10.222.0.36 () {58 vars in 1251 bytes} [Sat Oct 15 13:48:42 2022] GET /compute/v2.1/os-snapshots/102cc44e-bf27-4d3d-ad27-026b6d352aec => generated 287 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 13:48:43.497076 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-29b83907-5ff0-4038-82c3-adeb437f44da tempest-VolumesGetTestJSON-825535435 tempest-VolumesGetTestJSON-825535435-project] Calling method '.version_select at 0x7f1b5f087ee0>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:48:43.631813 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.wsgi [None req-29b83907-5ff0-4038-82c3-adeb437f44da tempest-VolumesGetTestJSON-825535435 tempest-VolumesGetTestJSON-825535435-project] HTTP exception thrown: Volume c7e4b27b-6b5c-4947-814d-3630c7c470d2 could not be found. Oct 15 13:48:43.636303 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-29b83907-5ff0-4038-82c3-adeb437f44da tempest-VolumesGetTestJSON-825535435 tempest-VolumesGetTestJSON-825535435-project] Request method failure captured: Oct 15 13:48:43.636303 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: request: GET /compute/v2.1/os-volumes/c7e4b27b-6b5c-4947-814d-3630c7c470d2 HTTP/1.1 Oct 15 13:48:43.636303 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: Accept: application/json Oct 15 13:48:43.636303 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: Accept-Encoding: identity Oct 15 13:48:43.636303 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: Connection: close Oct 15 13:48:43.636303 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: Content-Length: 0 Oct 15 13:48:43.636303 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: Content-Type: application/json Oct 15 13:48:43.636303 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: Host: 10.222.0.36 Oct 15 13:48:43.636303 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: Openstack-System-Scope: None Oct 15 13:48:43.636303 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: User-Agent: python-urllib3/1.26.12 Oct 15 13:48:43.636303 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Auth-Token: gAAAAABjSrou_B65bzRPZLxW9lRKpie_vd4v5SFVkGdkd_OAR20mg-r6Z09FQMp2RIl5iFRAsRE-McEU5ewrGBzqz-l18TWo1uIu7N3o7FMw5mPkejxSO58V8tlZyV_l6g1Ns9dkybq2YzmLlFRBStCVqS6qVdHOhsLHb-30rJydeceotrOTHd0 Oct 15 13:48:43.636303 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Domain-Id: None Oct 15 13:48:43.636303 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Domain-Name: None Oct 15 13:48:43.636303 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Identity-Status: Confirmed Oct 15 13:48:43.636303 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Is-Admin-Project: True Oct 15 13:48:43.636303 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Project-Domain-Id: default Oct 15 13:48:43.636303 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Project-Domain-Name: Default Oct 15 13:48:43.636303 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Project-Id: 0c29d86a22514388bd9465a4e2fb9daa Oct 15 13:48:43.636303 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Project-Name: tempest-VolumesGetTestJSON-825535435 Oct 15 13:48:43.636303 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Role: member,reader Oct 15 13:48:43.636303 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Roles: member,reader Oct 15 13:48:43.639413 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_0c29d86a22514388bd9465a4e2fb9daa", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0c29d86a22514388bd9465a4e2fb9daa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0c29d86a22514388bd9465a4e2fb9daa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/0c29d86a22514388bd9465a4e2fb9daa"}]}] Oct 15 13:48:43.639413 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Tenant: tempest-VolumesGetTestJSON-825535435 Oct 15 13:48:43.639413 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Tenant-Id: 0c29d86a22514388bd9465a4e2fb9daa Oct 15 13:48:43.639413 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Tenant-Name: tempest-VolumesGetTestJSON-825535435 Oct 15 13:48:43.639413 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-User: tempest-VolumesGetTestJSON-825535435-project Oct 15 13:48:43.639413 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-User-Domain-Id: default Oct 15 13:48:43.639413 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-User-Domain-Name: Default Oct 15 13:48:43.639413 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-User-Id: 2c28b2c8bf424d938d875a1af9a7608c Oct 15 13:48:43.639413 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-User-Name: tempest-VolumesGetTestJSON-825535435-project Oct 15 13:48:43.639413 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: method: Oct 15 13:48:43.639413 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: exception: Volume c7e4b27b-6b5c-4947-814d-3630c7c470d2 could not be found. Oct 15 13:48:43.639413 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: action_args: {'id': 'c7e4b27b-6b5c-4947-814d-3630c7c470d2'} Oct 15 13:48:43.639413 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 15 13:48:43.641130 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 13:48:43.641130 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 15 13:48:43.641130 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 15 13:48:43.641130 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 15 13:48:43.641130 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 15 13:48:43.641130 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 15 13:48:43.641130 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 15 13:48:43.641130 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 15 13:48:43.641130 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 15 13:48:43.641130 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 15 13:48:43.641130 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 15 13:48:43.641130 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 15 13:48:43.641130 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 15 13:48:43.641130 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 15 13:48:43.641130 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 15 13:48:43.641130 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c7e4b27b-6b5c-4947-814d-3630c7c470d2 could not be found. (HTTP 404) (Request-ID: req-9357b9ed-34ad-4944-941a-6bd65d3f5a00) Oct 15 13:48:43.641130 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Oct 15 13:48:43.641130 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 13:48:43.641130 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Oct 15 13:48:43.643505 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 13:48:43.643505 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 15 13:48:43.643505 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 15 13:48:43.643505 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 15 13:48:43.643505 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 15 13:48:43.643505 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 15 13:48:43.643505 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 15 13:48:43.643505 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 15 13:48:43.643505 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 15 13:48:43.643505 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 15 13:48:43.643505 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 15 13:48:43.643505 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 15 13:48:43.643505 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 15 13:48:43.643505 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 15 13:48:43.643505 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 15 13:48:43.643505 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 15 13:48:43.643505 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 15 13:48:43.643505 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 15 13:48:43.643505 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 15 13:48:43.645739 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 15 13:48:43.645739 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 15 13:48:43.645739 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 15 13:48:43.645739 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 15 13:48:43.645739 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c7e4b27b-6b5c-4947-814d-3630c7c470d2 could not be found. Oct 15 13:48:43.645739 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Oct 15 13:48:43.645739 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 13:48:43.645739 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Oct 15 13:48:43.645739 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 13:48:43.645739 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 13:48:43.645739 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 13:48:43.645739 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 15 13:48:43.645739 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 15 13:48:43.645739 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 15 13:48:43.645739 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 15 13:48:43.645739 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 15 13:48:43.645739 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 15 13:48:43.645739 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 15 13:48:43.645739 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 15 13:48:43.652396 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c7e4b27b-6b5c-4947-814d-3630c7c470d2 could not be found. Oct 15 13:48:43.652396 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Oct 15 13:48:43.652396 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 13:48:43.652396 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Oct 15 13:48:43.652396 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 13:48:43.652396 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 13:48:43.652396 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 13:48:43.652396 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 15 13:48:43.652396 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 15 13:48:43.652396 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c7e4b27b-6b5c-4947-814d-3630c7c470d2 could not be found. Oct 15 13:48:43.652396 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Oct 15 13:48:43.652396 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-29b83907-5ff0-4038-82c3-adeb437f44da tempest-VolumesGetTestJSON-825535435 tempest-VolumesGetTestJSON-825535435-project] Returning 404 to user: Volume c7e4b27b-6b5c-4947-814d-3630c7c470d2 could not be found. {{(pid=125243) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 15 13:48:43.652396 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-29b83907-5ff0-4038-82c3-adeb437f44da tempest-VolumesGetTestJSON-825535435 tempest-VolumesGetTestJSON-825535435-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/c7e4b27b-6b5c-4947-814d-3630c7c470d2" status: 404 len: 109 microversion: 2.1 time: 0.161772 Oct 15 13:48:43.658864 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 18/33] 10.222.0.36 () {58 vars in 1245 bytes} [Sat Oct 15 13:48:43 2022] GET /compute/v2.1/os-volumes/c7e4b27b-6b5c-4947-814d-3630c7c470d2 => generated 109 bytes in 172 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 15 13:48:43.949887 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-91b672d7-5f5d-43cf-8f99-f39c93bdbe53 tempest-VolumesSnapshotsTestJSON-1222309969 tempest-VolumesSnapshotsTestJSON-1222309969-project] Calling method '.version_select at 0x7f1b5f087700>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:48:44.090173 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-91b672d7-5f5d-43cf-8f99-f39c93bdbe53 tempest-VolumesSnapshotsTestJSON-1222309969 tempest-VolumesSnapshotsTestJSON-1222309969-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/102cc44e-bf27-4d3d-ad27-026b6d352aec" status: 200 len: 288 microversion: 2.1 time: 0.143681 Oct 15 13:48:44.108661 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 16/34] 10.222.0.36 () {58 vars in 1251 bytes} [Sat Oct 15 13:48:43 2022] GET /compute/v2.1/os-snapshots/102cc44e-bf27-4d3d-ad27-026b6d352aec => generated 288 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 15 13:48:44.120601 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-a3c83ebe-dac3-465e-9cc0-7b449005947b tempest-VolumesSnapshotsTestJSON-1222309969 tempest-VolumesSnapshotsTestJSON-1222309969-project] Calling method '.version_select at 0x7f1b5f133940>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:48:44.494768 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-a3c83ebe-dac3-465e-9cc0-7b449005947b tempest-VolumesSnapshotsTestJSON-1222309969 tempest-VolumesSnapshotsTestJSON-1222309969-project] 10.222.0.36 "DELETE /compute/v2.1/os-snapshots/102cc44e-bf27-4d3d-ad27-026b6d352aec" status: 202 len: 0 microversion: 2.1 time: 0.380803 Oct 15 13:48:44.495466 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 19/35] 10.222.0.36 () {58 vars in 1254 bytes} [Sat Oct 15 13:48:44 2022] DELETE /compute/v2.1/os-snapshots/102cc44e-bf27-4d3d-ad27-026b6d352aec => generated 0 bytes in 383 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 15 13:48:44.504475 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-ebb32820-4b08-4c7d-a8b4-4d04237f9ac8 tempest-VolumesSnapshotsTestJSON-1222309969 tempest-VolumesSnapshotsTestJSON-1222309969-project] Calling method '.version_select at 0x7f1b5f290550>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:48:44.675852 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-ebb32820-4b08-4c7d-a8b4-4d04237f9ac8 tempest-VolumesSnapshotsTestJSON-1222309969 tempest-VolumesSnapshotsTestJSON-1222309969-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/102cc44e-bf27-4d3d-ad27-026b6d352aec" status: 200 len: 287 microversion: 2.1 time: 0.175407 Oct 15 13:48:44.682241 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 17/36] 10.222.0.36 () {58 vars in 1251 bytes} [Sat Oct 15 13:48:44 2022] GET /compute/v2.1/os-snapshots/102cc44e-bf27-4d3d-ad27-026b6d352aec => generated 287 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 15 13:48:45.694432 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-09855939-376f-4ec5-98b8-0ed138ae2d96 tempest-VolumesSnapshotsTestJSON-1222309969 tempest-VolumesSnapshotsTestJSON-1222309969-project] Calling method '.version_select at 0x7f1b5f087f70>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:48:45.781673 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.wsgi [None req-09855939-376f-4ec5-98b8-0ed138ae2d96 tempest-VolumesSnapshotsTestJSON-1222309969 tempest-VolumesSnapshotsTestJSON-1222309969-project] HTTP exception thrown: Snapshot 102cc44e-bf27-4d3d-ad27-026b6d352aec could not be found. Oct 15 13:48:45.785938 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-09855939-376f-4ec5-98b8-0ed138ae2d96 tempest-VolumesSnapshotsTestJSON-1222309969 tempest-VolumesSnapshotsTestJSON-1222309969-project] Request method failure captured: Oct 15 13:48:45.785938 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: request: GET /compute/v2.1/os-snapshots/102cc44e-bf27-4d3d-ad27-026b6d352aec HTTP/1.1 Oct 15 13:48:45.785938 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: Accept: application/json Oct 15 13:48:45.785938 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: Accept-Encoding: identity Oct 15 13:48:45.785938 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: Connection: close Oct 15 13:48:45.785938 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: Content-Length: 0 Oct 15 13:48:45.785938 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: Content-Type: application/json Oct 15 13:48:45.785938 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: Host: 10.222.0.36 Oct 15 13:48:45.785938 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: Openstack-System-Scope: None Oct 15 13:48:45.785938 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: User-Agent: python-urllib3/1.26.12 Oct 15 13:48:45.785938 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Auth-Token: gAAAAABjSrov3QwDBxBbjLoxUtAtQ4qUXd93gM3DMkyTXEMmU7Zg5q2UMXyiE2GlZ0g20tI-l7Wsk2Zlh84aRyZwwUA_mOLrvhRutXycrvZ1W1bYiDCAWrPkO-S3tBYeG0anBRSbhyKnLXcEFZccLLKOsgg5orn1J1BSq-etDzrfif3AXj4u9fE Oct 15 13:48:45.785938 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Domain-Id: None Oct 15 13:48:45.785938 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Domain-Name: None Oct 15 13:48:45.785938 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Identity-Status: Confirmed Oct 15 13:48:45.785938 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Is-Admin-Project: True Oct 15 13:48:45.785938 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Project-Domain-Id: default Oct 15 13:48:45.785938 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Project-Domain-Name: Default Oct 15 13:48:45.785938 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Project-Id: 735c94e76c1e4aca8c1b82ea5d744e62 Oct 15 13:48:45.785938 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1222309969 Oct 15 13:48:45.785938 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Role: member,reader Oct 15 13:48:45.785938 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Roles: member,reader Oct 15 13:48:45.789018 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_735c94e76c1e4aca8c1b82ea5d744e62", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/735c94e76c1e4aca8c1b82ea5d744e62"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/735c94e76c1e4aca8c1b82ea5d744e62"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/735c94e76c1e4aca8c1b82ea5d744e62"}]}] Oct 15 13:48:45.789018 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1222309969 Oct 15 13:48:45.789018 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Tenant-Id: 735c94e76c1e4aca8c1b82ea5d744e62 Oct 15 13:48:45.789018 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1222309969 Oct 15 13:48:45.789018 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-User: tempest-VolumesSnapshotsTestJSON-1222309969-project Oct 15 13:48:45.789018 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-User-Domain-Id: default Oct 15 13:48:45.789018 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-User-Domain-Name: Default Oct 15 13:48:45.789018 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-User-Id: 4d5c3d2aebd94d34a335d685343fe129 Oct 15 13:48:45.789018 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1222309969-project Oct 15 13:48:45.789018 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: method: Oct 15 13:48:45.789018 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: exception: Snapshot 102cc44e-bf27-4d3d-ad27-026b6d352aec could not be found. Oct 15 13:48:45.789018 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: action_args: {'id': '102cc44e-bf27-4d3d-ad27-026b6d352aec'} Oct 15 13:48:45.789018 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 15 13:48:45.790927 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 13:48:45.790927 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 15 13:48:45.790927 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 15 13:48:45.790927 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 15 13:48:45.790927 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 15 13:48:45.790927 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 15 13:48:45.790927 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 15 13:48:45.790927 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 15 13:48:45.790927 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 15 13:48:45.790927 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 15 13:48:45.790927 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 15 13:48:45.790927 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 15 13:48:45.790927 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 15 13:48:45.790927 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 15 13:48:45.790927 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 15 13:48:45.790927 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 102cc44e-bf27-4d3d-ad27-026b6d352aec could not be found. (HTTP 404) (Request-ID: req-f0c72efe-aee7-4b02-b350-9cee7945a199) Oct 15 13:48:45.790927 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Oct 15 13:48:45.790927 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 13:48:45.793390 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Oct 15 13:48:45.793390 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 13:48:45.793390 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Oct 15 13:48:45.793390 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Oct 15 13:48:45.793390 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 15 13:48:45.793390 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 15 13:48:45.793390 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Oct 15 13:48:45.793390 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Oct 15 13:48:45.793390 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 15 13:48:45.793390 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 15 13:48:45.793390 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 15 13:48:45.793390 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 15 13:48:45.793390 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 15 13:48:45.793390 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 15 13:48:45.793390 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 15 13:48:45.793390 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 15 13:48:45.793390 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 15 13:48:45.793390 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 15 13:48:45.793390 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 15 13:48:45.796035 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 15 13:48:45.796035 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 15 13:48:45.796035 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 15 13:48:45.796035 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 15 13:48:45.796035 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 15 13:48:45.796035 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 102cc44e-bf27-4d3d-ad27-026b6d352aec could not be found. Oct 15 13:48:45.796035 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Oct 15 13:48:45.796035 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 13:48:45.796035 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Oct 15 13:48:45.796035 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 13:48:45.796035 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 13:48:45.796035 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 13:48:45.796035 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 15 13:48:45.796035 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 15 13:48:45.796035 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 15 13:48:45.796035 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 15 13:48:45.796035 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 15 13:48:45.796035 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 15 13:48:45.796035 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Oct 15 13:48:45.796035 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 15 13:48:45.798496 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 102cc44e-bf27-4d3d-ad27-026b6d352aec could not be found. Oct 15 13:48:45.798496 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Oct 15 13:48:45.798496 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 13:48:45.798496 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Oct 15 13:48:45.798496 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 13:48:45.798496 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 13:48:45.798496 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 13:48:45.798496 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 15 13:48:45.798496 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 15 13:48:45.798496 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 102cc44e-bf27-4d3d-ad27-026b6d352aec could not be found. Oct 15 13:48:45.798496 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Oct 15 13:48:45.798496 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-09855939-376f-4ec5-98b8-0ed138ae2d96 tempest-VolumesSnapshotsTestJSON-1222309969 tempest-VolumesSnapshotsTestJSON-1222309969-project] Returning 404 to user: Snapshot 102cc44e-bf27-4d3d-ad27-026b6d352aec could not be found. {{(pid=125243) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 15 13:48:45.798496 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-09855939-376f-4ec5-98b8-0ed138ae2d96 tempest-VolumesSnapshotsTestJSON-1222309969 tempest-VolumesSnapshotsTestJSON-1222309969-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/102cc44e-bf27-4d3d-ad27-026b6d352aec" status: 404 len: 111 microversion: 2.1 time: 0.103829 Oct 15 13:48:45.821096 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-0dec051a-f88f-46db-9868-7f3832599bfd tempest-VolumesSnapshotsTestJSON-1222309969 tempest-VolumesSnapshotsTestJSON-1222309969-project] Calling method '.version_select at 0x7f1b5f1655e0>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:48:45.829179 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 20/37] 10.222.0.36 () {58 vars in 1251 bytes} [Sat Oct 15 13:48:45 2022] GET /compute/v2.1/os-snapshots/102cc44e-bf27-4d3d-ad27-026b6d352aec => generated 111 bytes in 143 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 15 13:48:46.066586 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-0dec051a-f88f-46db-9868-7f3832599bfd tempest-VolumesSnapshotsTestJSON-1222309969 tempest-VolumesSnapshotsTestJSON-1222309969-project] 10.222.0.36 "DELETE /compute/v2.1/os-volumes/53c6122a-415b-429a-a33f-0fb85604c6c4" status: 202 len: 0 microversion: 2.1 time: 0.252184 Oct 15 13:48:46.067454 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 18/38] 10.222.0.36 () {58 vars in 1248 bytes} [Sat Oct 15 13:48:45 2022] DELETE /compute/v2.1/os-volumes/53c6122a-415b-429a-a33f-0fb85604c6c4 => generated 0 bytes in 255 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 15 13:48:46.080132 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-71707d33-e130-4ab3-8c1a-1348579168cd tempest-VolumesSnapshotsTestJSON-1222309969 tempest-VolumesSnapshotsTestJSON-1222309969-project] Calling method '.version_select at 0x7f1b5f08cdc0>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:48:46.276740 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-71707d33-e130-4ab3-8c1a-1348579168cd tempest-VolumesSnapshotsTestJSON-1222309969 tempest-VolumesSnapshotsTestJSON-1222309969-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/53c6122a-415b-429a-a33f-0fb85604c6c4" status: 200 len: 345 microversion: 2.1 time: 0.203617 Oct 15 13:48:46.278319 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 21/39] 10.222.0.36 () {58 vars in 1245 bytes} [Sat Oct 15 13:48:46 2022] GET /compute/v2.1/os-volumes/53c6122a-415b-429a-a33f-0fb85604c6c4 => generated 345 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 13:48:47.295491 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-c9faed58-c2e4-4b08-8c9d-0057ed307c97 tempest-VolumesSnapshotsTestJSON-1222309969 tempest-VolumesSnapshotsTestJSON-1222309969-project] Calling method '.version_select at 0x7f1b5f093280>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:48:47.416530 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.wsgi [None req-c9faed58-c2e4-4b08-8c9d-0057ed307c97 tempest-VolumesSnapshotsTestJSON-1222309969 tempest-VolumesSnapshotsTestJSON-1222309969-project] HTTP exception thrown: Volume 53c6122a-415b-429a-a33f-0fb85604c6c4 could not be found. Oct 15 13:48:47.420283 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-c9faed58-c2e4-4b08-8c9d-0057ed307c97 tempest-VolumesSnapshotsTestJSON-1222309969 tempest-VolumesSnapshotsTestJSON-1222309969-project] Request method failure captured: Oct 15 13:48:47.420283 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: request: GET /compute/v2.1/os-volumes/53c6122a-415b-429a-a33f-0fb85604c6c4 HTTP/1.1 Oct 15 13:48:47.420283 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Accept: application/json Oct 15 13:48:47.420283 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Accept-Encoding: identity Oct 15 13:48:47.420283 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Connection: close Oct 15 13:48:47.420283 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Content-Length: 0 Oct 15 13:48:47.420283 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Content-Type: application/json Oct 15 13:48:47.420283 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Host: 10.222.0.36 Oct 15 13:48:47.420283 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Openstack-System-Scope: None Oct 15 13:48:47.420283 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: User-Agent: python-urllib3/1.26.12 Oct 15 13:48:47.420283 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Auth-Token: gAAAAABjSrov3QwDBxBbjLoxUtAtQ4qUXd93gM3DMkyTXEMmU7Zg5q2UMXyiE2GlZ0g20tI-l7Wsk2Zlh84aRyZwwUA_mOLrvhRutXycrvZ1W1bYiDCAWrPkO-S3tBYeG0anBRSbhyKnLXcEFZccLLKOsgg5orn1J1BSq-etDzrfif3AXj4u9fE Oct 15 13:48:47.420283 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Domain-Id: None Oct 15 13:48:47.420283 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Domain-Name: None Oct 15 13:48:47.420283 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Identity-Status: Confirmed Oct 15 13:48:47.420283 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Is-Admin-Project: True Oct 15 13:48:47.420283 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Project-Domain-Id: default Oct 15 13:48:47.420283 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Project-Domain-Name: Default Oct 15 13:48:47.420283 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Project-Id: 735c94e76c1e4aca8c1b82ea5d744e62 Oct 15 13:48:47.420283 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1222309969 Oct 15 13:48:47.420283 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Role: member,reader Oct 15 13:48:47.420283 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Roles: member,reader Oct 15 13:48:47.423312 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_735c94e76c1e4aca8c1b82ea5d744e62", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/735c94e76c1e4aca8c1b82ea5d744e62"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/735c94e76c1e4aca8c1b82ea5d744e62"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/735c94e76c1e4aca8c1b82ea5d744e62"}]}] Oct 15 13:48:47.423312 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1222309969 Oct 15 13:48:47.423312 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Tenant-Id: 735c94e76c1e4aca8c1b82ea5d744e62 Oct 15 13:48:47.423312 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1222309969 Oct 15 13:48:47.423312 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-User: tempest-VolumesSnapshotsTestJSON-1222309969-project Oct 15 13:48:47.423312 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-User-Domain-Id: default Oct 15 13:48:47.423312 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-User-Domain-Name: Default Oct 15 13:48:47.423312 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-User-Id: 4d5c3d2aebd94d34a335d685343fe129 Oct 15 13:48:47.423312 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1222309969-project Oct 15 13:48:47.423312 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: method: Oct 15 13:48:47.423312 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: exception: Volume 53c6122a-415b-429a-a33f-0fb85604c6c4 could not be found. Oct 15 13:48:47.423312 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: action_args: {'id': '53c6122a-415b-429a-a33f-0fb85604c6c4'} Oct 15 13:48:47.423312 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 15 13:48:47.425895 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 13:48:47.425895 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 15 13:48:47.425895 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 15 13:48:47.425895 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 15 13:48:47.425895 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 15 13:48:47.425895 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 15 13:48:47.425895 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 15 13:48:47.425895 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 15 13:48:47.425895 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 15 13:48:47.425895 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 15 13:48:47.425895 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 15 13:48:47.425895 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 15 13:48:47.425895 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 15 13:48:47.425895 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 15 13:48:47.425895 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 15 13:48:47.425895 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 53c6122a-415b-429a-a33f-0fb85604c6c4 could not be found. (HTTP 404) (Request-ID: req-89af3553-379e-4fd0-b55c-3706ee3e8be5) Oct 15 13:48:47.425895 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Oct 15 13:48:47.425895 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 13:48:47.425895 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Oct 15 13:48:47.428450 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 13:48:47.428450 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 15 13:48:47.428450 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 15 13:48:47.428450 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 15 13:48:47.428450 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 15 13:48:47.428450 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 15 13:48:47.428450 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 15 13:48:47.428450 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 15 13:48:47.428450 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 15 13:48:47.428450 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 15 13:48:47.428450 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 15 13:48:47.428450 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 15 13:48:47.428450 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 15 13:48:47.428450 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 15 13:48:47.428450 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 15 13:48:47.428450 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 15 13:48:47.428450 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 15 13:48:47.428450 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 15 13:48:47.428450 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 15 13:48:47.430831 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 15 13:48:47.430831 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 15 13:48:47.430831 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 15 13:48:47.430831 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 15 13:48:47.430831 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 53c6122a-415b-429a-a33f-0fb85604c6c4 could not be found. Oct 15 13:48:47.430831 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Oct 15 13:48:47.430831 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 13:48:47.430831 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Oct 15 13:48:47.430831 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 13:48:47.430831 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 13:48:47.430831 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 13:48:47.430831 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 15 13:48:47.430831 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 15 13:48:47.430831 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 15 13:48:47.430831 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 15 13:48:47.430831 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 15 13:48:47.430831 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 15 13:48:47.430831 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 15 13:48:47.430831 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 15 13:48:47.435639 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 53c6122a-415b-429a-a33f-0fb85604c6c4 could not be found. Oct 15 13:48:47.435639 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Oct 15 13:48:47.435639 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 13:48:47.435639 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Oct 15 13:48:47.435639 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 13:48:47.435639 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 13:48:47.435639 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 13:48:47.435639 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 15 13:48:47.435639 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 15 13:48:47.435639 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 53c6122a-415b-429a-a33f-0fb85604c6c4 could not be found. Oct 15 13:48:47.435639 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Oct 15 13:48:47.435639 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-c9faed58-c2e4-4b08-8c9d-0057ed307c97 tempest-VolumesSnapshotsTestJSON-1222309969 tempest-VolumesSnapshotsTestJSON-1222309969-project] Returning 404 to user: Volume 53c6122a-415b-429a-a33f-0fb85604c6c4 could not be found. {{(pid=125242) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 15 13:48:47.435639 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-c9faed58-c2e4-4b08-8c9d-0057ed307c97 tempest-VolumesSnapshotsTestJSON-1222309969 tempest-VolumesSnapshotsTestJSON-1222309969-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/53c6122a-415b-429a-a33f-0fb85604c6c4" status: 404 len: 109 microversion: 2.1 time: 0.133341 Oct 15 13:48:47.435639 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 19/40] 10.222.0.36 () {58 vars in 1245 bytes} [Sat Oct 15 13:48:47 2022] GET /compute/v2.1/os-volumes/53c6122a-415b-429a-a33f-0fb85604c6c4 => generated 109 bytes in 136 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 15 13:48:47.442096 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-1e4756c7-dda5-4f15-9b4e-f4037bf5b990 tempest-VolumesSnapshotsTestJSON-1222309969 tempest-VolumesSnapshotsTestJSON-1222309969-project] Calling method '.version_select at 0x7f1b5f087280>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:48:47.587372 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.wsgi [None req-1e4756c7-dda5-4f15-9b4e-f4037bf5b990 tempest-VolumesSnapshotsTestJSON-1222309969 tempest-VolumesSnapshotsTestJSON-1222309969-project] HTTP exception thrown: Volume 53c6122a-415b-429a-a33f-0fb85604c6c4 could not be found. Oct 15 13:48:47.591065 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-1e4756c7-dda5-4f15-9b4e-f4037bf5b990 tempest-VolumesSnapshotsTestJSON-1222309969 tempest-VolumesSnapshotsTestJSON-1222309969-project] Request method failure captured: Oct 15 13:48:47.591065 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: request: DELETE /compute/v2.1/os-volumes/53c6122a-415b-429a-a33f-0fb85604c6c4 HTTP/1.1 Oct 15 13:48:47.591065 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: Accept: application/json Oct 15 13:48:47.591065 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: Accept-Encoding: identity Oct 15 13:48:47.591065 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: Connection: close Oct 15 13:48:47.591065 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: Content-Length: 0 Oct 15 13:48:47.591065 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: Content-Type: application/json Oct 15 13:48:47.591065 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: Host: 10.222.0.36 Oct 15 13:48:47.591065 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: Openstack-System-Scope: None Oct 15 13:48:47.591065 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: User-Agent: python-urllib3/1.26.12 Oct 15 13:48:47.591065 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Auth-Token: gAAAAABjSrov3QwDBxBbjLoxUtAtQ4qUXd93gM3DMkyTXEMmU7Zg5q2UMXyiE2GlZ0g20tI-l7Wsk2Zlh84aRyZwwUA_mOLrvhRutXycrvZ1W1bYiDCAWrPkO-S3tBYeG0anBRSbhyKnLXcEFZccLLKOsgg5orn1J1BSq-etDzrfif3AXj4u9fE Oct 15 13:48:47.591065 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Domain-Id: None Oct 15 13:48:47.591065 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Domain-Name: None Oct 15 13:48:47.591065 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Identity-Status: Confirmed Oct 15 13:48:47.591065 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Is-Admin-Project: True Oct 15 13:48:47.591065 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Project-Domain-Id: default Oct 15 13:48:47.591065 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Project-Domain-Name: Default Oct 15 13:48:47.591065 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Project-Id: 735c94e76c1e4aca8c1b82ea5d744e62 Oct 15 13:48:47.591065 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1222309969 Oct 15 13:48:47.591065 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Role: member,reader Oct 15 13:48:47.591065 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Roles: member,reader Oct 15 13:48:47.593001 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_735c94e76c1e4aca8c1b82ea5d744e62", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/735c94e76c1e4aca8c1b82ea5d744e62"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/735c94e76c1e4aca8c1b82ea5d744e62"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/735c94e76c1e4aca8c1b82ea5d744e62"}]}] Oct 15 13:48:47.593001 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1222309969 Oct 15 13:48:47.593001 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Tenant-Id: 735c94e76c1e4aca8c1b82ea5d744e62 Oct 15 13:48:47.593001 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1222309969 Oct 15 13:48:47.593001 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-User: tempest-VolumesSnapshotsTestJSON-1222309969-project Oct 15 13:48:47.593001 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-User-Domain-Id: default Oct 15 13:48:47.593001 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-User-Domain-Name: Default Oct 15 13:48:47.593001 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-User-Id: 4d5c3d2aebd94d34a335d685343fe129 Oct 15 13:48:47.593001 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1222309969-project Oct 15 13:48:47.593001 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: method: Oct 15 13:48:47.593001 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: exception: Volume 53c6122a-415b-429a-a33f-0fb85604c6c4 could not be found. Oct 15 13:48:47.593001 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: action_args: {'id': '53c6122a-415b-429a-a33f-0fb85604c6c4'} Oct 15 13:48:47.593001 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 15 13:48:47.597732 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 13:48:47.597732 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 15 13:48:47.597732 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 15 13:48:47.597732 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 15 13:48:47.597732 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 15 13:48:47.597732 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 15 13:48:47.597732 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 15 13:48:47.597732 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 15 13:48:47.597732 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 15 13:48:47.597732 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 15 13:48:47.597732 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 15 13:48:47.597732 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 15 13:48:47.597732 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 15 13:48:47.597732 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 15 13:48:47.597732 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 15 13:48:47.597732 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 53c6122a-415b-429a-a33f-0fb85604c6c4 could not be found. (HTTP 404) (Request-ID: req-07983629-1fb1-4b7e-ad62-dea0a7a44dfa) Oct 15 13:48:47.597732 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Oct 15 13:48:47.597732 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 13:48:47.597732 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Oct 15 13:48:47.599029 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 13:48:47.599029 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 15 13:48:47.599029 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 15 13:48:47.599029 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 15 13:48:47.599029 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 15 13:48:47.599029 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 15 13:48:47.599029 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 15 13:48:47.599029 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 15 13:48:47.599029 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 15 13:48:47.599029 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 15 13:48:47.599029 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 15 13:48:47.599029 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 15 13:48:47.599029 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 15 13:48:47.599029 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 15 13:48:47.599029 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 15 13:48:47.599029 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 15 13:48:47.599029 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 15 13:48:47.599029 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 15 13:48:47.599029 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 15 13:48:47.602576 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 15 13:48:47.602576 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 15 13:48:47.602576 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 15 13:48:47.602576 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 15 13:48:47.602576 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 53c6122a-415b-429a-a33f-0fb85604c6c4 could not be found. Oct 15 13:48:47.602576 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Oct 15 13:48:47.602576 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 13:48:47.602576 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Oct 15 13:48:47.602576 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 13:48:47.602576 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 13:48:47.602576 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 13:48:47.602576 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 15 13:48:47.602576 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 15 13:48:47.602576 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 15 13:48:47.602576 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 15 13:48:47.602576 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 15 13:48:47.602576 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 15 13:48:47.602576 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 15 13:48:47.602576 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 15 13:48:47.605794 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 53c6122a-415b-429a-a33f-0fb85604c6c4 could not be found. Oct 15 13:48:47.605794 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Oct 15 13:48:47.605794 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 13:48:47.605794 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Oct 15 13:48:47.605794 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 13:48:47.605794 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 13:48:47.605794 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 13:48:47.605794 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 15 13:48:47.605794 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 15 13:48:47.605794 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 53c6122a-415b-429a-a33f-0fb85604c6c4 could not be found. Oct 15 13:48:47.605794 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Oct 15 13:48:47.605794 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-1e4756c7-dda5-4f15-9b4e-f4037bf5b990 tempest-VolumesSnapshotsTestJSON-1222309969 tempest-VolumesSnapshotsTestJSON-1222309969-project] Returning 404 to user: Volume 53c6122a-415b-429a-a33f-0fb85604c6c4 could not be found. {{(pid=125243) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 15 13:48:47.605794 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-1e4756c7-dda5-4f15-9b4e-f4037bf5b990 tempest-VolumesSnapshotsTestJSON-1222309969 tempest-VolumesSnapshotsTestJSON-1222309969-project] 10.222.0.36 "DELETE /compute/v2.1/os-volumes/53c6122a-415b-429a-a33f-0fb85604c6c4" status: 404 len: 109 microversion: 2.1 time: 0.158100 Oct 15 13:48:47.608014 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-0dd551ce-5177-4730-8c29-8135d9173751 tempest-VolumesSnapshotsTestJSON-1222309969 tempest-VolumesSnapshotsTestJSON-1222309969-project] Calling method '.version_select at 0x7f1b5f0f7790>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:48:47.611996 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 22/41] 10.222.0.36 () {58 vars in 1248 bytes} [Sat Oct 15 13:48:47 2022] DELETE /compute/v2.1/os-volumes/53c6122a-415b-429a-a33f-0fb85604c6c4 => generated 109 bytes in 163 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 15 13:48:47.691031 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.wsgi [None req-0dd551ce-5177-4730-8c29-8135d9173751 tempest-VolumesSnapshotsTestJSON-1222309969 tempest-VolumesSnapshotsTestJSON-1222309969-project] HTTP exception thrown: Volume 53c6122a-415b-429a-a33f-0fb85604c6c4 could not be found. Oct 15 13:48:47.694705 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-0dd551ce-5177-4730-8c29-8135d9173751 tempest-VolumesSnapshotsTestJSON-1222309969 tempest-VolumesSnapshotsTestJSON-1222309969-project] Request method failure captured: Oct 15 13:48:47.694705 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: request: GET /compute/v2.1/os-volumes/53c6122a-415b-429a-a33f-0fb85604c6c4 HTTP/1.1 Oct 15 13:48:47.694705 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Accept: application/json Oct 15 13:48:47.694705 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Accept-Encoding: identity Oct 15 13:48:47.694705 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Connection: close Oct 15 13:48:47.694705 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Content-Length: 0 Oct 15 13:48:47.694705 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Content-Type: application/json Oct 15 13:48:47.694705 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Host: 10.222.0.36 Oct 15 13:48:47.694705 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Openstack-System-Scope: None Oct 15 13:48:47.694705 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: User-Agent: python-urllib3/1.26.12 Oct 15 13:48:47.694705 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Auth-Token: gAAAAABjSrov3QwDBxBbjLoxUtAtQ4qUXd93gM3DMkyTXEMmU7Zg5q2UMXyiE2GlZ0g20tI-l7Wsk2Zlh84aRyZwwUA_mOLrvhRutXycrvZ1W1bYiDCAWrPkO-S3tBYeG0anBRSbhyKnLXcEFZccLLKOsgg5orn1J1BSq-etDzrfif3AXj4u9fE Oct 15 13:48:47.694705 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Domain-Id: None Oct 15 13:48:47.694705 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Domain-Name: None Oct 15 13:48:47.694705 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Identity-Status: Confirmed Oct 15 13:48:47.694705 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Is-Admin-Project: True Oct 15 13:48:47.694705 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Project-Domain-Id: default Oct 15 13:48:47.694705 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Project-Domain-Name: Default Oct 15 13:48:47.694705 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Project-Id: 735c94e76c1e4aca8c1b82ea5d744e62 Oct 15 13:48:47.694705 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1222309969 Oct 15 13:48:47.694705 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Role: member,reader Oct 15 13:48:47.694705 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Roles: member,reader Oct 15 13:48:47.697294 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_735c94e76c1e4aca8c1b82ea5d744e62", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/735c94e76c1e4aca8c1b82ea5d744e62"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/735c94e76c1e4aca8c1b82ea5d744e62"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/735c94e76c1e4aca8c1b82ea5d744e62"}]}] Oct 15 13:48:47.697294 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1222309969 Oct 15 13:48:47.697294 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Tenant-Id: 735c94e76c1e4aca8c1b82ea5d744e62 Oct 15 13:48:47.697294 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1222309969 Oct 15 13:48:47.697294 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-User: tempest-VolumesSnapshotsTestJSON-1222309969-project Oct 15 13:48:47.697294 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-User-Domain-Id: default Oct 15 13:48:47.697294 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-User-Domain-Name: Default Oct 15 13:48:47.697294 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-User-Id: 4d5c3d2aebd94d34a335d685343fe129 Oct 15 13:48:47.697294 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1222309969-project Oct 15 13:48:47.697294 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: method: Oct 15 13:48:47.697294 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: exception: Volume 53c6122a-415b-429a-a33f-0fb85604c6c4 could not be found. Oct 15 13:48:47.697294 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: action_args: {'id': '53c6122a-415b-429a-a33f-0fb85604c6c4'} Oct 15 13:48:47.697294 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 15 13:48:47.698069 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 13:48:47.698069 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 15 13:48:47.698069 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 15 13:48:47.698069 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 15 13:48:47.698069 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 15 13:48:47.698069 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 15 13:48:47.698069 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 15 13:48:47.698069 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 15 13:48:47.698069 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 15 13:48:47.698069 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 15 13:48:47.698069 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 15 13:48:47.698069 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 15 13:48:47.698069 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 15 13:48:47.698069 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 15 13:48:47.698069 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 15 13:48:47.698069 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 53c6122a-415b-429a-a33f-0fb85604c6c4 could not be found. (HTTP 404) (Request-ID: req-d6218f12-1e7b-4572-a9c5-6338166089cb) Oct 15 13:48:47.698069 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Oct 15 13:48:47.698069 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 13:48:47.698069 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Oct 15 13:48:47.699282 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 13:48:47.699282 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 15 13:48:47.699282 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 15 13:48:47.699282 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 15 13:48:47.699282 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 15 13:48:47.699282 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 15 13:48:47.699282 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 15 13:48:47.699282 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 15 13:48:47.699282 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 15 13:48:47.699282 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 15 13:48:47.699282 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 15 13:48:47.699282 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 15 13:48:47.699282 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 15 13:48:47.699282 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 15 13:48:47.699282 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 15 13:48:47.699282 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 15 13:48:47.699282 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 15 13:48:47.699282 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 15 13:48:47.699282 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 15 13:48:47.703537 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 15 13:48:47.703537 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 15 13:48:47.703537 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 15 13:48:47.703537 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 15 13:48:47.703537 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 53c6122a-415b-429a-a33f-0fb85604c6c4 could not be found. Oct 15 13:48:47.703537 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Oct 15 13:48:47.703537 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 13:48:47.703537 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Oct 15 13:48:47.703537 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 13:48:47.703537 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 13:48:47.703537 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 13:48:47.703537 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 15 13:48:47.703537 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 15 13:48:47.703537 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 15 13:48:47.703537 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 15 13:48:47.703537 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 15 13:48:47.703537 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 15 13:48:47.703537 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 15 13:48:47.703537 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 15 13:48:47.706635 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 53c6122a-415b-429a-a33f-0fb85604c6c4 could not be found. Oct 15 13:48:47.706635 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Oct 15 13:48:47.706635 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 13:48:47.706635 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Oct 15 13:48:47.706635 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 13:48:47.706635 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 13:48:47.706635 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 13:48:47.706635 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 15 13:48:47.706635 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 15 13:48:47.706635 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 53c6122a-415b-429a-a33f-0fb85604c6c4 could not be found. Oct 15 13:48:47.706635 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Oct 15 13:48:47.706635 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-0dd551ce-5177-4730-8c29-8135d9173751 tempest-VolumesSnapshotsTestJSON-1222309969 tempest-VolumesSnapshotsTestJSON-1222309969-project] Returning 404 to user: Volume 53c6122a-415b-429a-a33f-0fb85604c6c4 could not be found. {{(pid=125242) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 15 13:48:47.706635 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-0dd551ce-5177-4730-8c29-8135d9173751 tempest-VolumesSnapshotsTestJSON-1222309969 tempest-VolumesSnapshotsTestJSON-1222309969-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/53c6122a-415b-429a-a33f-0fb85604c6c4" status: 404 len: 109 microversion: 2.1 time: 0.097664 Oct 15 13:48:47.706635 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 20/42] 10.222.0.36 () {58 vars in 1245 bytes} [Sat Oct 15 13:48:47 2022] GET /compute/v2.1/os-volumes/53c6122a-415b-429a-a33f-0fb85604c6c4 => generated 109 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 15 13:48:53.448810 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-f4e914f7-44de-468e-bb04-c68ff31a73bd tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1475947805", "imageRef": "26e64909-1cae-49ca-af5e-adea40c062d7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 13:48:53.567164 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-48ec74a0-4017-4c51-85e7-86386a56ba86 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Action: 'create', calling method: .version_select at 0x7f1b5f0f79d0>, body: {"keypair": {"name": "tempest-keypair-1788976729", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKrJh5Ip6knX+s+b4lYKSAgqhvpoDAR1EEEamAi6E7m1s0btIwVR2M6Rcp25tZZlbl7WSWl8//IzC5MUcvAHk+ZAdPlvziSIvm6FC9jJgUVZcNMy+K2IlgsLLeW+QjBMQA=="}} {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 13:48:53.909104 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.quota [None req-48ec74a0-4017-4c51-85e7-86386a56ba86 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Getting quotas for project 35f8b5024a194f70a9f7689ac44ab07b. Resources: {'key_pairs'} {{(pid=125242) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 15 13:48:53.951008 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.quota [None req-48ec74a0-4017-4c51-85e7-86386a56ba86 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Getting quotas for user 583cce1547144e11978f20a3193ceba4 and project 35f8b5024a194f70a9f7689ac44ab07b. Resources: {'key_pairs'} {{(pid=125242) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 15 13:48:54.074958 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.network.neutron [None req-f4e914f7-44de-468e-bb04-c68ff31a73bd tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] validate_networks() for [('c1b0ef41-77c8-4965-9ff6-7478183c5789', None, None, None, None, None)] {{(pid=125243) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 15 13:48:54.142883 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-48ec74a0-4017-4c51-85e7-86386a56ba86 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.350897 Oct 15 13:48:54.146393 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 21/43] 10.222.0.36 () {60 vars in 1159 bytes} [Sat Oct 15 13:48:52 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1356 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 13:48:56.929767 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.virt.hardware [None req-f4e914f7-44de-468e-bb04-c68ff31a73bd tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Flavor limits 0:0:0 {{(pid=125243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 15 13:48:56.930559 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.virt.hardware [None req-f4e914f7-44de-468e-bb04-c68ff31a73bd tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Image limits 0:0:0 {{(pid=125243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 15 13:48:56.932686 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.virt.hardware [None req-f4e914f7-44de-468e-bb04-c68ff31a73bd tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Flavor pref 0:0:0 {{(pid=125243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 15 13:48:56.933118 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.virt.hardware [None req-f4e914f7-44de-468e-bb04-c68ff31a73bd tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Image pref 0:0:0 {{(pid=125243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 15 13:48:56.933541 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.virt.hardware [None req-f4e914f7-44de-468e-bb04-c68ff31a73bd tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 15 13:48:56.987096 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-f4e914f7-44de-468e-bb04-c68ff31a73bd tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:48:56.987611 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-f4e914f7-44de-468e-bb04-c68ff31a73bd tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:48:56.988452 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-f4e914f7-44de-468e-bb04-c68ff31a73bd tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:48:57.006394 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-f4e914f7-44de-468e-bb04-c68ff31a73bd tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:48:57.006933 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-f4e914f7-44de-468e-bb04-c68ff31a73bd tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:48:57.007318 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-f4e914f7-44de-468e-bb04-c68ff31a73bd tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:48:57.047979 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.quota [None req-f4e914f7-44de-468e-bb04-c68ff31a73bd tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Getting quotas for project 09a0813bae074cd2aa552be82abe8493. Resources: {'cores', 'ram', 'instances'} {{(pid=125243) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 15 13:48:57.056437 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.quota [None req-f4e914f7-44de-468e-bb04-c68ff31a73bd tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Getting quotas for user 5150c06020594efe957359f641eba5da and project 09a0813bae074cd2aa552be82abe8493. Resources: {'cores', 'ram', 'instances'} {{(pid=125243) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 15 13:48:57.081899 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-f4e914f7-44de-468e-bb04-c68ff31a73bd tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Going to run 1 instances... {{(pid=125243) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 15 13:48:57.087030 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-f4e914f7-44de-468e-bb04-c68ff31a73bd tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] [instance: 242ed9b0-fe03-4583-ad2f-4760e86d2031] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='26e64909-1cae-49ca-af5e-adea40c062d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125243) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 15 13:48:57.203084 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-f4e914f7-44de-468e-bb04-c68ff31a73bd tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.776400 Oct 15 13:48:57.204493 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 23/44] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 15 13:48:52 2022] POST /compute/v2.1/servers => generated 383 bytes in 4779 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 15 13:48:57.225945 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-753651ae-a04b-4ad5-b2cc-fd2aad71eebe tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:48:57.231214 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-753651ae-a04b-4ad5-b2cc-fd2aad71eebe tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] [instance: 242ed9b0-fe03-4583-ad2f-4760e86d2031] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:48:57.424654 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-753651ae-a04b-4ad5-b2cc-fd2aad71eebe tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5150c06020594efe957359f641eba5da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a0813bae074cd2aa552be82abe8493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:48:57.458195 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-753651ae-a04b-4ad5-b2cc-fd2aad71eebe tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] 10.222.0.36 "GET /compute/v2.1/servers/242ed9b0-fe03-4583-ad2f-4760e86d2031" status: 200 len: 1222 microversion: 2.1 time: 0.243954 Oct 15 13:48:57.459394 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 22/45] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:48:57 2022] GET /compute/v2.1/servers/242ed9b0-fe03-4583-ad2f-4760e86d2031 => generated 1222 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:48:58.270872 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-b7c9fde3-5452-4d8d-a234-c2a9321fd575 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-331859202", "imageRef": "26e64909-1cae-49ca-af5e-adea40c062d7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 13:48:58.461852 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.network.neutron [None req-b7c9fde3-5452-4d8d-a234-c2a9321fd575 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] validate_networks() for [('c1b0ef41-77c8-4965-9ff6-7478183c5789', None, None, None, None, None)] {{(pid=125243) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 15 13:48:59.631729 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-23b25bc3-642e-4945-add8-b641611192c2 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Action: 'create', calling method: .version_select at 0x7f1b5f014ee0>, body: {"keypair": {"name": "tempest-keypair-492973963", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNMAoi5A847kalh/7cLvBzWt+ve+7y5rUVz/h7SA8U+ajYWODHV1EjXLQ5XRACMxRNTWpToycF1AP1twyrGZcsPdC142EbuHTWsktDdwVrZbI2qRcLQiuRgQK1Z7/bGyAg=="}} {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 13:48:59.740709 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.quota [None req-23b25bc3-642e-4945-add8-b641611192c2 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Getting quotas for project aabf1193b43040948317be442c5c16f7. Resources: {'key_pairs'} {{(pid=125242) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 15 13:48:59.777777 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.quota [None req-23b25bc3-642e-4945-add8-b641611192c2 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Getting quotas for user 0b01e277944d4edcb8625ebf4544e340 and project aabf1193b43040948317be442c5c16f7. Resources: {'key_pairs'} {{(pid=125242) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 15 13:48:59.925142 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-23b25bc3-642e-4945-add8-b641611192c2 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 1.295446 Oct 15 13:48:59.932557 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 23/46] 10.222.0.36 () {62 vars in 1200 bytes} [Sat Oct 15 13:48:58 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 1304 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 15 13:49:00.211004 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.virt.hardware [None req-b7c9fde3-5452-4d8d-a234-c2a9321fd575 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Flavor limits 0:0:0 {{(pid=125243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 15 13:49:00.213045 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.virt.hardware [None req-b7c9fde3-5452-4d8d-a234-c2a9321fd575 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Image limits 0:0:0 {{(pid=125243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 15 13:49:00.214320 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.virt.hardware [None req-b7c9fde3-5452-4d8d-a234-c2a9321fd575 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Flavor pref 0:0:0 {{(pid=125243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 15 13:49:00.215520 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.virt.hardware [None req-b7c9fde3-5452-4d8d-a234-c2a9321fd575 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Image pref 0:0:0 {{(pid=125243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 15 13:49:00.218686 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.virt.hardware [None req-b7c9fde3-5452-4d8d-a234-c2a9321fd575 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 15 13:49:00.265627 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-b7c9fde3-5452-4d8d-a234-c2a9321fd575 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:00.267867 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-b7c9fde3-5452-4d8d-a234-c2a9321fd575 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:00.269231 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-b7c9fde3-5452-4d8d-a234-c2a9321fd575 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:00.280314 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-b7c9fde3-5452-4d8d-a234-c2a9321fd575 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:00.281586 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-b7c9fde3-5452-4d8d-a234-c2a9321fd575 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:00.282657 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-b7c9fde3-5452-4d8d-a234-c2a9321fd575 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:00.390987 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.quota [None req-b7c9fde3-5452-4d8d-a234-c2a9321fd575 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Getting quotas for project 09a0813bae074cd2aa552be82abe8493. Resources: {'cores', 'ram', 'instances'} {{(pid=125243) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 15 13:49:00.413196 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.quota [None req-b7c9fde3-5452-4d8d-a234-c2a9321fd575 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Getting quotas for user 5150c06020594efe957359f641eba5da and project 09a0813bae074cd2aa552be82abe8493. Resources: {'cores', 'ram', 'instances'} {{(pid=125243) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 15 13:49:00.468575 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-b7c9fde3-5452-4d8d-a234-c2a9321fd575 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Going to run 1 instances... {{(pid=125243) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 15 13:49:00.486873 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-b7c9fde3-5452-4d8d-a234-c2a9321fd575 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] [instance: a8976a74-703a-4fa4-9cc7-760a3e3f226b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='26e64909-1cae-49ca-af5e-adea40c062d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125243) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 15 13:49:00.807300 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-b7c9fde3-5452-4d8d-a234-c2a9321fd575 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.552764 Oct 15 13:49:00.811433 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 24/47] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 15 13:48:58 2022] POST /compute/v2.1/servers => generated 383 bytes in 2560 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 15 13:49:00.822253 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-61794fa2-fe88-437e-84b9-885472efc196 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:49:00.822890 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-61794fa2-fe88-437e-84b9-885472efc196 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] [instance: a8976a74-703a-4fa4-9cc7-760a3e3f226b] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:49:00.938023 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-3c4d1103-510c-48f9-8795-78b0bd532cc8 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1508326406", "imageRef": "26e64909-1cae-49ca-af5e-adea40c062d7", "flavorRef": "452", "networks": [{"uuid": "ee310ecf-be11-4c15-91ef-9612882639c9"}]}} {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 13:49:01.183325 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-61794fa2-fe88-437e-84b9-885472efc196 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5150c06020594efe957359f641eba5da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a0813bae074cd2aa552be82abe8493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:49:01.243367 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-61794fa2-fe88-437e-84b9-885472efc196 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] 10.222.0.36 "GET /compute/v2.1/servers/a8976a74-703a-4fa4-9cc7-760a3e3f226b" status: 200 len: 1221 microversion: 2.1 time: 0.424523 Oct 15 13:49:01.272372 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 25/48] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:49:00 2022] GET /compute/v2.1/servers/a8976a74-703a-4fa4-9cc7-760a3e3f226b => generated 1221 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:49:01.358342 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.network.neutron [None req-3c4d1103-510c-48f9-8795-78b0bd532cc8 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] validate_networks() for [('ee310ecf-be11-4c15-91ef-9612882639c9', None, None, None, None, None)] {{(pid=125242) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 15 13:49:02.300101 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-8197127f-baa4-4085-8ecb-7f65cb0ed05f tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:49:02.301005 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-8197127f-baa4-4085-8ecb-7f65cb0ed05f tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] [instance: a8976a74-703a-4fa4-9cc7-760a3e3f226b] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:49:02.667206 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-8197127f-baa4-4085-8ecb-7f65cb0ed05f tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5150c06020594efe957359f641eba5da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a0813bae074cd2aa552be82abe8493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:49:02.705530 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-8197127f-baa4-4085-8ecb-7f65cb0ed05f tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] 10.222.0.36 "GET /compute/v2.1/servers/a8976a74-703a-4fa4-9cc7-760a3e3f226b" status: 200 len: 1221 microversion: 2.1 time: 0.408953 Oct 15 13:49:02.709558 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 26/49] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:49:02 2022] GET /compute/v2.1/servers/a8976a74-703a-4fa4-9cc7-760a3e3f226b => generated 1221 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:49:03.441432 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-fa4e006f-d0f1-49af-9fe7-18fd45b81f01 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1862218295", "imageRef": "26e64909-1cae-49ca-af5e-adea40c062d7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "429e755e-8108-4b4c-9eb4-bd9e6c7ffcca"}], "security_groups": [{"name": "tempest-securitygroup--600096120"}], "key_name": "tempest-keypair-1788976729", "user_data": "}} {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 13:49:03.938406 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.network.neutron [None req-fa4e006f-d0f1-49af-9fe7-18fd45b81f01 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] validate_networks() for [('429e755e-8108-4b4c-9eb4-bd9e6c7ffcca', None, None, None, None, None)] {{(pid=125243) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 15 13:49:05.556127 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.virt.hardware [None req-3c4d1103-510c-48f9-8795-78b0bd532cc8 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Flavor limits 0:0:0 {{(pid=125242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 15 13:49:05.556922 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.virt.hardware [None req-3c4d1103-510c-48f9-8795-78b0bd532cc8 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Image limits 0:0:0 {{(pid=125242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 15 13:49:05.558004 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.virt.hardware [None req-3c4d1103-510c-48f9-8795-78b0bd532cc8 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Flavor pref 0:0:0 {{(pid=125242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 15 13:49:05.558890 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.virt.hardware [None req-3c4d1103-510c-48f9-8795-78b0bd532cc8 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Image pref 0:0:0 {{(pid=125242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 15 13:49:05.561167 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.virt.hardware [None req-3c4d1103-510c-48f9-8795-78b0bd532cc8 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 15 13:49:05.636640 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-3c4d1103-510c-48f9-8795-78b0bd532cc8 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:05.638156 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-3c4d1103-510c-48f9-8795-78b0bd532cc8 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:05.643069 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-3c4d1103-510c-48f9-8795-78b0bd532cc8 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:05.647821 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-3c4d1103-510c-48f9-8795-78b0bd532cc8 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:05.653781 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-3c4d1103-510c-48f9-8795-78b0bd532cc8 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:05.656812 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-3c4d1103-510c-48f9-8795-78b0bd532cc8 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:05.777175 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.quota [None req-3c4d1103-510c-48f9-8795-78b0bd532cc8 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Getting quotas for project 984a02b8dfd446879438d29b5efdd996. Resources: {'cores', 'ram', 'instances'} {{(pid=125242) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 15 13:49:05.802959 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.quota [None req-3c4d1103-510c-48f9-8795-78b0bd532cc8 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Getting quotas for user bc29734859a5460faee189b1726b50b4 and project 984a02b8dfd446879438d29b5efdd996. Resources: {'cores', 'ram', 'instances'} {{(pid=125242) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 15 13:49:05.849402 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-3c4d1103-510c-48f9-8795-78b0bd532cc8 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Going to run 1 instances... {{(pid=125242) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 15 13:49:05.862267 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-3c4d1103-510c-48f9-8795-78b0bd532cc8 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] [instance: 8fb76141-70a4-4501-b928-7502a13c3cb4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='26e64909-1cae-49ca-af5e-adea40c062d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125242) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 15 13:49:06.194694 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-3c4d1103-510c-48f9-8795-78b0bd532cc8 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 6.258096 Oct 15 13:49:06.205990 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 24/50] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 15 13:48:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 6270 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 15 13:49:06.236889 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-74b90647-d8f6-48a2-802a-fe4f4038c9c2 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:49:06.238037 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-74b90647-d8f6-48a2-802a-fe4f4038c9c2 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] [instance: a8976a74-703a-4fa4-9cc7-760a3e3f226b] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:49:06.271484 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-74b90647-d8f6-48a2-802a-fe4f4038c9c2 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:06.282445 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-74b90647-d8f6-48a2-802a-fe4f4038c9c2 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:06.286772 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-74b90647-d8f6-48a2-802a-fe4f4038c9c2 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:06.290076 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-74b90647-d8f6-48a2-802a-fe4f4038c9c2 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:06.292762 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-74b90647-d8f6-48a2-802a-fe4f4038c9c2 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:06.295582 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-74b90647-d8f6-48a2-802a-fe4f4038c9c2 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:07.402924 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-74b90647-d8f6-48a2-802a-fe4f4038c9c2 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5150c06020594efe957359f641eba5da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a0813bae074cd2aa552be82abe8493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:49:07.449179 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-74b90647-d8f6-48a2-802a-fe4f4038c9c2 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] 10.222.0.36 "GET /compute/v2.1/servers/a8976a74-703a-4fa4-9cc7-760a3e3f226b" status: 200 len: 1279 microversion: 2.1 time: 1.241298 Oct 15 13:49:07.451965 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 25/51] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:49:06 2022] GET /compute/v2.1/servers/a8976a74-703a-4fa4-9cc7-760a3e3f226b => generated 1279 bytes in 1245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:49:07.491578 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-66100eb0-0b01-4865-8d4e-fdb2f4462fe0 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:49:07.494917 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-66100eb0-0b01-4865-8d4e-fdb2f4462fe0 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] [instance: 8fb76141-70a4-4501-b928-7502a13c3cb4] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:49:07.740314 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.virt.hardware [None req-fa4e006f-d0f1-49af-9fe7-18fd45b81f01 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Flavor limits 0:0:0 {{(pid=125243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 15 13:49:07.741054 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.virt.hardware [None req-fa4e006f-d0f1-49af-9fe7-18fd45b81f01 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Image limits 0:0:0 {{(pid=125243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 15 13:49:07.741554 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.virt.hardware [None req-fa4e006f-d0f1-49af-9fe7-18fd45b81f01 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Flavor pref 0:0:0 {{(pid=125243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 15 13:49:07.742099 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.virt.hardware [None req-fa4e006f-d0f1-49af-9fe7-18fd45b81f01 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Image pref 0:0:0 {{(pid=125243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 15 13:49:07.742785 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.virt.hardware [None req-fa4e006f-d0f1-49af-9fe7-18fd45b81f01 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 15 13:49:07.790743 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-fa4e006f-d0f1-49af-9fe7-18fd45b81f01 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:07.795544 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-fa4e006f-d0f1-49af-9fe7-18fd45b81f01 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:07.797921 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-fa4e006f-d0f1-49af-9fe7-18fd45b81f01 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:07.805981 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-fa4e006f-d0f1-49af-9fe7-18fd45b81f01 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:07.810548 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-fa4e006f-d0f1-49af-9fe7-18fd45b81f01 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:07.812518 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-fa4e006f-d0f1-49af-9fe7-18fd45b81f01 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:07.909787 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-66100eb0-0b01-4865-8d4e-fdb2f4462fe0 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc29734859a5460faee189b1726b50b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984a02b8dfd446879438d29b5efdd996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:49:07.922357 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-66100eb0-0b01-4865-8d4e-fdb2f4462fe0 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] 10.222.0.36 "GET /compute/v2.1/servers/8fb76141-70a4-4501-b928-7502a13c3cb4" status: 200 len: 1215 microversion: 2.1 time: 0.463932 Oct 15 13:49:07.941661 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 26/52] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:49:07 2022] GET /compute/v2.1/servers/8fb76141-70a4-4501-b928-7502a13c3cb4 => generated 1215 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:49:07.990033 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.quota [None req-fa4e006f-d0f1-49af-9fe7-18fd45b81f01 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Getting quotas for project 35f8b5024a194f70a9f7689ac44ab07b. Resources: {'cores', 'ram', 'instances'} {{(pid=125243) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 15 13:49:08.035292 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.quota [None req-fa4e006f-d0f1-49af-9fe7-18fd45b81f01 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Getting quotas for user 583cce1547144e11978f20a3193ceba4 and project 35f8b5024a194f70a9f7689ac44ab07b. Resources: {'cores', 'ram', 'instances'} {{(pid=125243) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 15 13:49:08.128200 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-fa4e006f-d0f1-49af-9fe7-18fd45b81f01 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Going to run 1 instances... {{(pid=125243) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 15 13:49:08.140843 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-fa4e006f-d0f1-49af-9fe7-18fd45b81f01 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] [instance: 40d67d09-379e-4c12-b36c-21edf3b23e45] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='26e64909-1cae-49ca-af5e-adea40c062d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125243) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 15 13:49:08.480974 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-033c78a9-8bb9-4e67-a882-7a746e13be75 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:49:08.482081 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-033c78a9-8bb9-4e67-a882-7a746e13be75 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] [instance: a8976a74-703a-4fa4-9cc7-760a3e3f226b] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:49:08.502606 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-033c78a9-8bb9-4e67-a882-7a746e13be75 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:08.510098 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-033c78a9-8bb9-4e67-a882-7a746e13be75 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:08.512143 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-033c78a9-8bb9-4e67-a882-7a746e13be75 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:08.518809 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-033c78a9-8bb9-4e67-a882-7a746e13be75 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:08.521750 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-033c78a9-8bb9-4e67-a882-7a746e13be75 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:08.522283 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-033c78a9-8bb9-4e67-a882-7a746e13be75 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:08.553335 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-fa4e006f-d0f1-49af-9fe7-18fd45b81f01 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 5.115384 Oct 15 13:49:08.563244 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 27/53] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 15 13:49:03 2022] POST /compute/v2.1/servers => generated 401 bytes in 5127 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 15 13:49:08.643603 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-c2df71fd-da5b-4a27-891c-ee26eea1a52f tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:49:08.651378 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-c2df71fd-da5b-4a27-891c-ee26eea1a52f tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] [instance: 40d67d09-379e-4c12-b36c-21edf3b23e45] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:49:09.592416 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-c2df71fd-da5b-4a27-891c-ee26eea1a52f tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583cce1547144e11978f20a3193ceba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f8b5024a194f70a9f7689ac44ab07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:49:09.624738 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-c2df71fd-da5b-4a27-891c-ee26eea1a52f tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] 10.222.0.36 "GET /compute/v2.1/servers/40d67d09-379e-4c12-b36c-21edf3b23e45" status: 200 len: 1238 microversion: 2.1 time: 1.050687 Oct 15 13:49:09.645326 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 28/54] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:49:08 2022] GET /compute/v2.1/servers/40d67d09-379e-4c12-b36c-21edf3b23e45 => generated 1238 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:49:09.677110 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-dacf22bc-d255-4e93-91ff-5d753c0ddbd1 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:49:09.697893 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-dacf22bc-d255-4e93-91ff-5d753c0ddbd1 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] [instance: 8fb76141-70a4-4501-b928-7502a13c3cb4] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:49:09.755579 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-dacf22bc-d255-4e93-91ff-5d753c0ddbd1 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:09.756573 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-dacf22bc-d255-4e93-91ff-5d753c0ddbd1 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:09.757285 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-dacf22bc-d255-4e93-91ff-5d753c0ddbd1 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:09.758580 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-dacf22bc-d255-4e93-91ff-5d753c0ddbd1 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:09.759342 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-dacf22bc-d255-4e93-91ff-5d753c0ddbd1 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:09.760136 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-dacf22bc-d255-4e93-91ff-5d753c0ddbd1 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:10.440704 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-dacf22bc-d255-4e93-91ff-5d753c0ddbd1 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc29734859a5460faee189b1726b50b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984a02b8dfd446879438d29b5efdd996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:49:10.488200 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-dacf22bc-d255-4e93-91ff-5d753c0ddbd1 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] 10.222.0.36 "GET /compute/v2.1/servers/8fb76141-70a4-4501-b928-7502a13c3cb4" status: 200 len: 1267 microversion: 2.1 time: 0.840562 Oct 15 13:49:10.497890 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 29/55] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:49:09 2022] GET /compute/v2.1/servers/8fb76141-70a4-4501-b928-7502a13c3cb4 => generated 1267 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:49:10.687025 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-2d50d06f-58f3-48e5-a162-4dc2c9c52c70 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:49:10.688782 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-2d50d06f-58f3-48e5-a162-4dc2c9c52c70 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] [instance: 40d67d09-379e-4c12-b36c-21edf3b23e45] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:49:10.707604 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-2d50d06f-58f3-48e5-a162-4dc2c9c52c70 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:10.708682 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-2d50d06f-58f3-48e5-a162-4dc2c9c52c70 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:10.709966 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-2d50d06f-58f3-48e5-a162-4dc2c9c52c70 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:10.715071 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-2d50d06f-58f3-48e5-a162-4dc2c9c52c70 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:10.717164 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-2d50d06f-58f3-48e5-a162-4dc2c9c52c70 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:10.720105 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-2d50d06f-58f3-48e5-a162-4dc2c9c52c70 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:11.250885 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-2d50d06f-58f3-48e5-a162-4dc2c9c52c70 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583cce1547144e11978f20a3193ceba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f8b5024a194f70a9f7689ac44ab07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:49:11.267324 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-2d50d06f-58f3-48e5-a162-4dc2c9c52c70 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] 10.222.0.36 "GET /compute/v2.1/servers/40d67d09-379e-4c12-b36c-21edf3b23e45" status: 200 len: 1242 microversion: 2.1 time: 0.586185 Oct 15 13:49:11.301919 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 30/56] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:49:10 2022] GET /compute/v2.1/servers/40d67d09-379e-4c12-b36c-21edf3b23e45 => generated 1242 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 13:49:11.426626 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-033c78a9-8bb9-4e67-a882-7a746e13be75 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5150c06020594efe957359f641eba5da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a0813bae074cd2aa552be82abe8493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:49:11.484702 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-033c78a9-8bb9-4e67-a882-7a746e13be75 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] 10.222.0.36 "GET /compute/v2.1/servers/a8976a74-703a-4fa4-9cc7-760a3e3f226b" status: 200 len: 1321 microversion: 2.1 time: 3.008960 Oct 15 13:49:11.488029 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 27/57] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:49:08 2022] GET /compute/v2.1/servers/a8976a74-703a-4fa4-9cc7-760a3e3f226b => generated 1321 bytes in 3014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:49:11.525132 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-17aba8d7-26c8-400f-a3e8-8de260d04c62 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:49:11.526072 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-17aba8d7-26c8-400f-a3e8-8de260d04c62 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] [instance: 8fb76141-70a4-4501-b928-7502a13c3cb4] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:49:11.542705 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-17aba8d7-26c8-400f-a3e8-8de260d04c62 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:11.543643 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-17aba8d7-26c8-400f-a3e8-8de260d04c62 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:11.548959 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-17aba8d7-26c8-400f-a3e8-8de260d04c62 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:11.550193 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-17aba8d7-26c8-400f-a3e8-8de260d04c62 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:11.551305 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-17aba8d7-26c8-400f-a3e8-8de260d04c62 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:11.552089 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-17aba8d7-26c8-400f-a3e8-8de260d04c62 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:12.128625 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-17aba8d7-26c8-400f-a3e8-8de260d04c62 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc29734859a5460faee189b1726b50b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984a02b8dfd446879438d29b5efdd996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:49:12.157717 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-17aba8d7-26c8-400f-a3e8-8de260d04c62 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] 10.222.0.36 "GET /compute/v2.1/servers/8fb76141-70a4-4501-b928-7502a13c3cb4" status: 200 len: 1273 microversion: 2.1 time: 0.637774 Oct 15 13:49:12.175140 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 31/58] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:49:11 2022] GET /compute/v2.1/servers/8fb76141-70a4-4501-b928-7502a13c3cb4 => generated 1273 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:49:12.344137 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-08ed1ca1-f755-4631-9ac0-02b0d55e40b2 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:49:12.353658 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-08ed1ca1-f755-4631-9ac0-02b0d55e40b2 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] [instance: 40d67d09-379e-4c12-b36c-21edf3b23e45] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:49:12.381857 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-08ed1ca1-f755-4631-9ac0-02b0d55e40b2 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:12.383100 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-08ed1ca1-f755-4631-9ac0-02b0d55e40b2 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:12.389342 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-08ed1ca1-f755-4631-9ac0-02b0d55e40b2 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:12.391236 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-08ed1ca1-f755-4631-9ac0-02b0d55e40b2 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:12.392291 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-08ed1ca1-f755-4631-9ac0-02b0d55e40b2 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:12.396681 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-08ed1ca1-f755-4631-9ac0-02b0d55e40b2 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:12.546474 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-f2cffacf-94c5-4d05-a777-9638e5b70b86 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:49:12.548263 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-f2cffacf-94c5-4d05-a777-9638e5b70b86 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] [instance: a8976a74-703a-4fa4-9cc7-760a3e3f226b] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:49:12.570843 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-f2cffacf-94c5-4d05-a777-9638e5b70b86 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:12.594241 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-f2cffacf-94c5-4d05-a777-9638e5b70b86 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:12.595476 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-f2cffacf-94c5-4d05-a777-9638e5b70b86 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:12.597068 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-f2cffacf-94c5-4d05-a777-9638e5b70b86 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:12.598176 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-f2cffacf-94c5-4d05-a777-9638e5b70b86 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:12.609058 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-f2cffacf-94c5-4d05-a777-9638e5b70b86 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:13.055720 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-08ed1ca1-f755-4631-9ac0-02b0d55e40b2 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583cce1547144e11978f20a3193ceba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f8b5024a194f70a9f7689ac44ab07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:49:13.082072 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-08ed1ca1-f755-4631-9ac0-02b0d55e40b2 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] 10.222.0.36 "GET /compute/v2.1/servers/40d67d09-379e-4c12-b36c-21edf3b23e45" status: 200 len: 1290 microversion: 2.1 time: 0.770169 Oct 15 13:49:13.096633 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 28/59] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:49:12 2022] GET /compute/v2.1/servers/40d67d09-379e-4c12-b36c-21edf3b23e45 => generated 1290 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:49:13.199104 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-16a467b7-fc6b-4494-8e67-b83627103344 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:49:13.205660 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-16a467b7-fc6b-4494-8e67-b83627103344 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] [instance: 8fb76141-70a4-4501-b928-7502a13c3cb4] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:49:13.234466 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-16a467b7-fc6b-4494-8e67-b83627103344 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:13.235942 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-16a467b7-fc6b-4494-8e67-b83627103344 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:13.237167 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-16a467b7-fc6b-4494-8e67-b83627103344 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:13.238804 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-16a467b7-fc6b-4494-8e67-b83627103344 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:13.242890 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-16a467b7-fc6b-4494-8e67-b83627103344 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:13.245803 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-16a467b7-fc6b-4494-8e67-b83627103344 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:14.249783 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-16a467b7-fc6b-4494-8e67-b83627103344 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc29734859a5460faee189b1726b50b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984a02b8dfd446879438d29b5efdd996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:49:14.268550 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-16a467b7-fc6b-4494-8e67-b83627103344 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] 10.222.0.36 "GET /compute/v2.1/servers/8fb76141-70a4-4501-b928-7502a13c3cb4" status: 200 len: 1273 microversion: 2.1 time: 1.076979 Oct 15 13:49:14.272694 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 29/60] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:49:13 2022] GET /compute/v2.1/servers/8fb76141-70a4-4501-b928-7502a13c3cb4 => generated 1273 bytes in 1082 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 13:49:14.281431 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-31f94d7f-4f7d-4d5b-ade6-4376aafaefc4 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:49:14.282303 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-31f94d7f-4f7d-4d5b-ade6-4376aafaefc4 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] [instance: 40d67d09-379e-4c12-b36c-21edf3b23e45] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:49:14.301674 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-31f94d7f-4f7d-4d5b-ade6-4376aafaefc4 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:14.302206 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-31f94d7f-4f7d-4d5b-ade6-4376aafaefc4 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:14.303574 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-31f94d7f-4f7d-4d5b-ade6-4376aafaefc4 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:14.304523 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-31f94d7f-4f7d-4d5b-ade6-4376aafaefc4 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:14.305012 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-31f94d7f-4f7d-4d5b-ade6-4376aafaefc4 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:14.305452 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-31f94d7f-4f7d-4d5b-ade6-4376aafaefc4 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:14.531573 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-f2cffacf-94c5-4d05-a777-9638e5b70b86 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5150c06020594efe957359f641eba5da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a0813bae074cd2aa552be82abe8493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:49:14.546475 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-f2cffacf-94c5-4d05-a777-9638e5b70b86 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] 10.222.0.36 "GET /compute/v2.1/servers/a8976a74-703a-4fa4-9cc7-760a3e3f226b" status: 200 len: 1321 microversion: 2.1 time: 2.007252 Oct 15 13:49:14.549920 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 32/61] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:49:12 2022] GET /compute/v2.1/servers/a8976a74-703a-4fa4-9cc7-760a3e3f226b => generated 1321 bytes in 2012 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:49:15.313202 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-fd0b8100-365e-46d8-8935-7c2f768bde77 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:49:15.317860 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-fd0b8100-365e-46d8-8935-7c2f768bde77 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] [instance: 8fb76141-70a4-4501-b928-7502a13c3cb4] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:49:15.359944 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-fd0b8100-365e-46d8-8935-7c2f768bde77 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:15.362821 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-fd0b8100-365e-46d8-8935-7c2f768bde77 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:15.368163 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-fd0b8100-365e-46d8-8935-7c2f768bde77 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:15.370057 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-fd0b8100-365e-46d8-8935-7c2f768bde77 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:15.375313 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-fd0b8100-365e-46d8-8935-7c2f768bde77 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:15.380143 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-fd0b8100-365e-46d8-8935-7c2f768bde77 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:15.702809 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-31f94d7f-4f7d-4d5b-ade6-4376aafaefc4 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583cce1547144e11978f20a3193ceba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f8b5024a194f70a9f7689ac44ab07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:49:15.745810 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-31f94d7f-4f7d-4d5b-ade6-4376aafaefc4 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] 10.222.0.36 "GET /compute/v2.1/servers/40d67d09-379e-4c12-b36c-21edf3b23e45" status: 200 len: 1296 microversion: 2.1 time: 1.469432 Oct 15 13:49:15.759925 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 30/62] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:49:14 2022] GET /compute/v2.1/servers/40d67d09-379e-4c12-b36c-21edf3b23e45 => generated 1296 bytes in 1483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:49:15.763230 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG dbcounter [-] [125242] Writing DB stats nova_cell0:SELECT=2 {{(pid=125242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:49:15.799921 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-04bf38d7-a3a3-4a7b-86a7-a4627ffb3ee3 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:49:15.802109 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-04bf38d7-a3a3-4a7b-86a7-a4627ffb3ee3 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] [instance: a8976a74-703a-4fa4-9cc7-760a3e3f226b] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:49:15.829304 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-04bf38d7-a3a3-4a7b-86a7-a4627ffb3ee3 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:15.834996 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-04bf38d7-a3a3-4a7b-86a7-a4627ffb3ee3 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:15.838019 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-04bf38d7-a3a3-4a7b-86a7-a4627ffb3ee3 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:15.839997 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-04bf38d7-a3a3-4a7b-86a7-a4627ffb3ee3 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:15.841626 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-04bf38d7-a3a3-4a7b-86a7-a4627ffb3ee3 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:15.842833 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-04bf38d7-a3a3-4a7b-86a7-a4627ffb3ee3 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:15.925096 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-fd0b8100-365e-46d8-8935-7c2f768bde77 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc29734859a5460faee189b1726b50b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984a02b8dfd446879438d29b5efdd996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:49:15.973270 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-fd0b8100-365e-46d8-8935-7c2f768bde77 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] 10.222.0.36 "GET /compute/v2.1/servers/8fb76141-70a4-4501-b928-7502a13c3cb4" status: 200 len: 1273 microversion: 2.1 time: 0.675785 Oct 15 13:49:15.974402 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 33/63] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:49:15 2022] GET /compute/v2.1/servers/8fb76141-70a4-4501-b928-7502a13c3cb4 => generated 1273 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:49:16.801939 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-67c8f87c-6042-4792-b847-cc5c3311e0a5 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:49:16.808445 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-67c8f87c-6042-4792-b847-cc5c3311e0a5 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] [instance: 40d67d09-379e-4c12-b36c-21edf3b23e45] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:49:16.842315 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-67c8f87c-6042-4792-b847-cc5c3311e0a5 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:16.850998 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-67c8f87c-6042-4792-b847-cc5c3311e0a5 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:16.852173 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-67c8f87c-6042-4792-b847-cc5c3311e0a5 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:16.854073 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-67c8f87c-6042-4792-b847-cc5c3311e0a5 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:16.855111 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-67c8f87c-6042-4792-b847-cc5c3311e0a5 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:16.856043 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-67c8f87c-6042-4792-b847-cc5c3311e0a5 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:17.599304 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-67c8f87c-6042-4792-b847-cc5c3311e0a5 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583cce1547144e11978f20a3193ceba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f8b5024a194f70a9f7689ac44ab07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:49:17.675498 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-67c8f87c-6042-4792-b847-cc5c3311e0a5 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] 10.222.0.36 "GET /compute/v2.1/servers/40d67d09-379e-4c12-b36c-21edf3b23e45" status: 200 len: 1296 microversion: 2.1 time: 0.883348 Oct 15 13:49:17.675960 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-04bf38d7-a3a3-4a7b-86a7-a4627ffb3ee3 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5150c06020594efe957359f641eba5da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a0813bae074cd2aa552be82abe8493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:49:17.688184 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-04bf38d7-a3a3-4a7b-86a7-a4627ffb3ee3 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] 10.222.0.36 "GET /compute/v2.1/servers/a8976a74-703a-4fa4-9cc7-760a3e3f226b" status: 200 len: 1321 microversion: 2.1 time: 1.927024 Oct 15 13:49:17.689121 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 31/64] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:49:15 2022] GET /compute/v2.1/servers/a8976a74-703a-4fa4-9cc7-760a3e3f226b => generated 1321 bytes in 1932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:49:17.713964 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 34/65] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:49:16 2022] GET /compute/v2.1/servers/40d67d09-379e-4c12-b36c-21edf3b23e45 => generated 1296 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:49:17.723217 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-d63bc5bf-a116-45a6-b375-526fe9211efd tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-826370409", "imageRef": "26e64909-1cae-49ca-af5e-adea40c062d7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2be587d7-2a5c-4c32-9783-ff3a198697e5"}], "security_groups": [{"name": "tempest-securitygroup--1894306072"}], "key_name": "tempest-keypair-492973963", "user_data": "}} {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 13:49:17.759318 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-8263ea2e-f8bd-45af-b7d1-a2535cfb38ed tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:49:17.766270 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-8263ea2e-f8bd-45af-b7d1-a2535cfb38ed tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] [instance: 8fb76141-70a4-4501-b928-7502a13c3cb4] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:49:17.811605 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-8263ea2e-f8bd-45af-b7d1-a2535cfb38ed tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:17.813983 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-8263ea2e-f8bd-45af-b7d1-a2535cfb38ed tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:17.815896 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-8263ea2e-f8bd-45af-b7d1-a2535cfb38ed tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:17.818012 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-8263ea2e-f8bd-45af-b7d1-a2535cfb38ed tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:17.819633 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-8263ea2e-f8bd-45af-b7d1-a2535cfb38ed tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:17.822189 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-8263ea2e-f8bd-45af-b7d1-a2535cfb38ed tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:17.904817 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG dbcounter [-] [125243] Writing DB stats nova_cell0:SELECT=6 {{(pid=125243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:49:17.927314 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG dbcounter [-] [125242] Writing DB stats nova_cell0:SELECT=18 {{(pid=125242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:49:18.886214 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.network.neutron [None req-d63bc5bf-a116-45a6-b375-526fe9211efd tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] validate_networks() for [('2be587d7-2a5c-4c32-9783-ff3a198697e5', None, None, None, None, None)] {{(pid=125243) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 15 13:49:19.523966 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-8263ea2e-f8bd-45af-b7d1-a2535cfb38ed tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc29734859a5460faee189b1726b50b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984a02b8dfd446879438d29b5efdd996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:49:19.590475 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-8263ea2e-f8bd-45af-b7d1-a2535cfb38ed tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] 10.222.0.36 "GET /compute/v2.1/servers/8fb76141-70a4-4501-b928-7502a13c3cb4" status: 200 len: 1315 microversion: 2.1 time: 1.866588 Oct 15 13:49:19.597210 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 32/66] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:49:17 2022] GET /compute/v2.1/servers/8fb76141-70a4-4501-b928-7502a13c3cb4 => generated 1315 bytes in 1908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:49:19.610570 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG dbcounter [-] [125243] Writing DB stats nova_cell0:SELECT=24 {{(pid=125243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:49:19.641172 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-b3c0b9be-eb0a-43d9-b668-7fa2bacca8cf tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:49:19.643578 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-b3c0b9be-eb0a-43d9-b668-7fa2bacca8cf tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] [instance: 40d67d09-379e-4c12-b36c-21edf3b23e45] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:49:19.671017 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-b3c0b9be-eb0a-43d9-b668-7fa2bacca8cf tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:19.672504 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-b3c0b9be-eb0a-43d9-b668-7fa2bacca8cf tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:19.673676 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-b3c0b9be-eb0a-43d9-b668-7fa2bacca8cf tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:19.676415 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-b3c0b9be-eb0a-43d9-b668-7fa2bacca8cf tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:19.680068 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-b3c0b9be-eb0a-43d9-b668-7fa2bacca8cf tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:19.682513 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-b3c0b9be-eb0a-43d9-b668-7fa2bacca8cf tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:20.762744 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-b3c0b9be-eb0a-43d9-b668-7fa2bacca8cf tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583cce1547144e11978f20a3193ceba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f8b5024a194f70a9f7689ac44ab07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:49:20.797831 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-b3c0b9be-eb0a-43d9-b668-7fa2bacca8cf tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] 10.222.0.36 "GET /compute/v2.1/servers/40d67d09-379e-4c12-b36c-21edf3b23e45" status: 200 len: 1296 microversion: 2.1 time: 1.191872 Oct 15 13:49:20.801254 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 33/67] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:49:19 2022] GET /compute/v2.1/servers/40d67d09-379e-4c12-b36c-21edf3b23e45 => generated 1296 bytes in 1203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:49:20.814165 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-a8391f03-5b70-4ca6-925d-c99630feef93 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:49:20.818626 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-a8391f03-5b70-4ca6-925d-c99630feef93 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] [instance: a8976a74-703a-4fa4-9cc7-760a3e3f226b] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:49:20.837056 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-a8391f03-5b70-4ca6-925d-c99630feef93 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:20.837803 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-a8391f03-5b70-4ca6-925d-c99630feef93 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:20.838418 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-a8391f03-5b70-4ca6-925d-c99630feef93 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:20.839404 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-a8391f03-5b70-4ca6-925d-c99630feef93 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:20.840062 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-a8391f03-5b70-4ca6-925d-c99630feef93 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:20.840647 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-a8391f03-5b70-4ca6-925d-c99630feef93 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:21.765928 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-a8391f03-5b70-4ca6-925d-c99630feef93 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5150c06020594efe957359f641eba5da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a0813bae074cd2aa552be82abe8493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:49:21.790079 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-a8391f03-5b70-4ca6-925d-c99630feef93 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] 10.222.0.36 "GET /compute/v2.1/servers/a8976a74-703a-4fa4-9cc7-760a3e3f226b" status: 200 len: 1321 microversion: 2.1 time: 0.981536 Oct 15 13:49:21.793850 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 34/68] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:49:20 2022] GET /compute/v2.1/servers/a8976a74-703a-4fa4-9cc7-760a3e3f226b => generated 1321 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:49:22.223121 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [req-23f9fdb6-0c57-483f-908c-3e7eb614c62c req-282d236c-324d-4f9a-915d-ce31785560ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "242ed9b0-fe03-4583-ad2f-4760e86d2031", "tag": "b700737e-c8a7-40a1-96f2-1665f19a9778"}]} {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 13:49:22.258208 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [req-23f9fdb6-0c57-483f-908c-3e7eb614c62c req-282d236c-324d-4f9a-915d-ce31785560ae service nova] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:22.262050 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [req-23f9fdb6-0c57-483f-908c-3e7eb614c62c req-282d236c-324d-4f9a-915d-ce31785560ae service nova] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:22.263307 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [req-23f9fdb6-0c57-483f-908c-3e7eb614c62c req-282d236c-324d-4f9a-915d-ce31785560ae service nova] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:22.309666 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.compute.server_external_events [req-23f9fdb6-0c57-483f-908c-3e7eb614c62c req-282d236c-324d-4f9a-915d-ce31785560ae service nova] Creating event network-changed:b700737e-c8a7-40a1-96f2-1665f19a9778 for instance 242ed9b0-fe03-4583-ad2f-4760e86d2031 on hv-cinder-86149 Oct 15 13:49:22.310822 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [req-23f9fdb6-0c57-483f-908c-3e7eb614c62c req-282d236c-324d-4f9a-915d-ce31785560ae service nova] Acquiring lock "compute-rpcapi-router" {{(pid=125242) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 15 13:49:22.311624 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [req-23f9fdb6-0c57-483f-908c-3e7eb614c62c req-282d236c-324d-4f9a-915d-ce31785560ae service nova] Acquired lock "compute-rpcapi-router" {{(pid=125242) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 15 13:49:22.315460 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-b1c61e99-defb-417c-8cdf-6179f3a14e0e None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:22.316666 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-b1c61e99-defb-417c-8cdf-6179f3a14e0e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:22.318110 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-b1c61e99-defb-417c-8cdf-6179f3a14e0e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:22.320371 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-b1c61e99-defb-417c-8cdf-6179f3a14e0e None None] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:22.321556 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-b1c61e99-defb-417c-8cdf-6179f3a14e0e None None] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:22.322579 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-b1c61e99-defb-417c-8cdf-6179f3a14e0e None None] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:22.342446 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.compute.rpcapi [None req-b1c61e99-defb-417c-8cdf-6179f3a14e0e None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 15 13:49:22.344477 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-b1c61e99-defb-417c-8cdf-6179f3a14e0e None None] Releasing lock "compute-rpcapi-router" {{(pid=125242) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 15 13:49:22.372650 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-b1c61e99-defb-417c-8cdf-6179f3a14e0e None None] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.576277 Oct 15 13:49:22.374211 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 35/69] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 15 13:49:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 13:49:22.384660 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-0c461afe-2540-4497-8332-c52e82c2b79c tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:49:22.386005 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-0c461afe-2540-4497-8332-c52e82c2b79c tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] [instance: 8fb76141-70a4-4501-b928-7502a13c3cb4] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:49:22.397701 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-0c461afe-2540-4497-8332-c52e82c2b79c tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:22.398696 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-0c461afe-2540-4497-8332-c52e82c2b79c tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:22.399578 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-0c461afe-2540-4497-8332-c52e82c2b79c tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:22.400990 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-0c461afe-2540-4497-8332-c52e82c2b79c tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:22.401872 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-0c461afe-2540-4497-8332-c52e82c2b79c tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:22.403248 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-0c461afe-2540-4497-8332-c52e82c2b79c tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:22.600957 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.virt.hardware [None req-d63bc5bf-a116-45a6-b375-526fe9211efd tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Flavor limits 0:0:0 {{(pid=125243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 15 13:49:22.602111 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.virt.hardware [None req-d63bc5bf-a116-45a6-b375-526fe9211efd tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Image limits 0:0:0 {{(pid=125243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 15 13:49:22.602984 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.virt.hardware [None req-d63bc5bf-a116-45a6-b375-526fe9211efd tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Flavor pref 0:0:0 {{(pid=125243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 15 13:49:22.603612 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.virt.hardware [None req-d63bc5bf-a116-45a6-b375-526fe9211efd tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Image pref 0:0:0 {{(pid=125243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 15 13:49:22.604172 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.virt.hardware [None req-d63bc5bf-a116-45a6-b375-526fe9211efd tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 15 13:49:22.607791 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG dbcounter [-] [125243] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=9 {{(pid=125243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:49:22.616340 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-d63bc5bf-a116-45a6-b375-526fe9211efd tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:22.624491 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-d63bc5bf-a116-45a6-b375-526fe9211efd tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:22.625249 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-d63bc5bf-a116-45a6-b375-526fe9211efd tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:22.626063 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-d63bc5bf-a116-45a6-b375-526fe9211efd tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:22.626765 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-d63bc5bf-a116-45a6-b375-526fe9211efd tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:22.627144 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-d63bc5bf-a116-45a6-b375-526fe9211efd tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:22.640300 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG dbcounter [-] [125243] Writing DB stats nova_cell1:SELECT=43 {{(pid=125243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:49:22.665934 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.quota [None req-d63bc5bf-a116-45a6-b375-526fe9211efd tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Getting quotas for project aabf1193b43040948317be442c5c16f7. Resources: {'cores', 'ram', 'instances'} {{(pid=125243) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 15 13:49:22.675413 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.quota [None req-d63bc5bf-a116-45a6-b375-526fe9211efd tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Getting quotas for user 0b01e277944d4edcb8625ebf4544e340 and project aabf1193b43040948317be442c5c16f7. Resources: {'cores', 'ram', 'instances'} {{(pid=125243) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 15 13:49:22.698439 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-d63bc5bf-a116-45a6-b375-526fe9211efd tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Going to run 1 instances... {{(pid=125243) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 15 13:49:22.702889 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-d63bc5bf-a116-45a6-b375-526fe9211efd tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 5fc359cf-ff2c-4189-b058-31eb3c97568c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='26e64909-1cae-49ca-af5e-adea40c062d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125243) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 15 13:49:22.828032 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-0c461afe-2540-4497-8332-c52e82c2b79c tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc29734859a5460faee189b1726b50b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984a02b8dfd446879438d29b5efdd996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:49:22.836710 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-d63bc5bf-a116-45a6-b375-526fe9211efd tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 5.121154 Oct 15 13:49:22.838063 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 35/70] 10.222.0.36 () {62 vars in 1188 bytes} [Sat Oct 15 13:49:17 2022] POST /compute/v2.1/servers => generated 402 bytes in 5124 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 15 13:49:22.851059 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-1fd6581f-3a32-4f1c-b97a-b0c38cf65a0c tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:49:22.852160 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-1fd6581f-3a32-4f1c-b97a-b0c38cf65a0c tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] [instance: 40d67d09-379e-4c12-b36c-21edf3b23e45] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:49:22.858394 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-0c461afe-2540-4497-8332-c52e82c2b79c tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] 10.222.0.36 "GET /compute/v2.1/servers/8fb76141-70a4-4501-b928-7502a13c3cb4" status: 200 len: 1315 microversion: 2.1 time: 0.481951 Oct 15 13:49:22.859402 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 36/71] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:49:22 2022] GET /compute/v2.1/servers/8fb76141-70a4-4501-b928-7502a13c3cb4 => generated 1315 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:49:22.860875 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-1fd6581f-3a32-4f1c-b97a-b0c38cf65a0c tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:22.861624 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-1fd6581f-3a32-4f1c-b97a-b0c38cf65a0c tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:22.862243 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-1fd6581f-3a32-4f1c-b97a-b0c38cf65a0c tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:22.863379 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-1fd6581f-3a32-4f1c-b97a-b0c38cf65a0c tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:22.864043 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-1fd6581f-3a32-4f1c-b97a-b0c38cf65a0c tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:22.864672 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-1fd6581f-3a32-4f1c-b97a-b0c38cf65a0c tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:22.894048 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-42df25ca-a3a4-4d99-b326-a11626c5a798 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:49:22.897995 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-42df25ca-a3a4-4d99-b326-a11626c5a798 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] [instance: a8976a74-703a-4fa4-9cc7-760a3e3f226b] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:49:22.922165 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG dbcounter [-] [125242] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=5 {{(pid=125242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:49:22.924010 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-42df25ca-a3a4-4d99-b326-a11626c5a798 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:22.924779 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-42df25ca-a3a4-4d99-b326-a11626c5a798 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:22.925424 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-42df25ca-a3a4-4d99-b326-a11626c5a798 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:22.926300 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-42df25ca-a3a4-4d99-b326-a11626c5a798 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:22.926951 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-42df25ca-a3a4-4d99-b326-a11626c5a798 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:22.927720 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-42df25ca-a3a4-4d99-b326-a11626c5a798 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:23.912008 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-42df25ca-a3a4-4d99-b326-a11626c5a798 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5150c06020594efe957359f641eba5da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a0813bae074cd2aa552be82abe8493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:49:23.958448 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-42df25ca-a3a4-4d99-b326-a11626c5a798 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] 10.222.0.36 "GET /compute/v2.1/servers/a8976a74-703a-4fa4-9cc7-760a3e3f226b" status: 200 len: 1321 microversion: 2.1 time: 1.092890 Oct 15 13:49:23.962981 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 37/72] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:49:22 2022] GET /compute/v2.1/servers/a8976a74-703a-4fa4-9cc7-760a3e3f226b => generated 1321 bytes in 1103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:49:23.992208 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-7a11f448-a4db-4895-aaf4-80e49d87e4f4 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:49:23.998269 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-7a11f448-a4db-4895-aaf4-80e49d87e4f4 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 5fc359cf-ff2c-4189-b058-31eb3c97568c] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:49:24.009269 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-1fd6581f-3a32-4f1c-b97a-b0c38cf65a0c tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583cce1547144e11978f20a3193ceba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f8b5024a194f70a9f7689ac44ab07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:49:24.029854 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-1fd6581f-3a32-4f1c-b97a-b0c38cf65a0c tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] 10.222.0.36 "GET /compute/v2.1/servers/40d67d09-379e-4c12-b36c-21edf3b23e45" status: 200 len: 1363 microversion: 2.1 time: 1.182838 Oct 15 13:49:24.035127 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-7a11f448-a4db-4895-aaf4-80e49d87e4f4 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:24.037375 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-7a11f448-a4db-4895-aaf4-80e49d87e4f4 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:24.039658 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-7a11f448-a4db-4895-aaf4-80e49d87e4f4 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:24.043300 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-7a11f448-a4db-4895-aaf4-80e49d87e4f4 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:24.044895 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-7a11f448-a4db-4895-aaf4-80e49d87e4f4 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:24.045717 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 36/73] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:49:22 2022] GET /compute/v2.1/servers/40d67d09-379e-4c12-b36c-21edf3b23e45 => generated 1363 bytes in 1200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:49:24.046526 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-7a11f448-a4db-4895-aaf4-80e49d87e4f4 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:24.210300 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-7a11f448-a4db-4895-aaf4-80e49d87e4f4 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:49:24.239396 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-7a11f448-a4db-4895-aaf4-80e49d87e4f4 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:49:24.249740 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-7a11f448-a4db-4895-aaf4-80e49d87e4f4 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:49:24.255942 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-7a11f448-a4db-4895-aaf4-80e49d87e4f4 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c" status: 200 len: 1284 microversion: 2.20 time: 0.287735 Oct 15 13:49:24.264001 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 38/74] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:49:23 2022] GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c => generated 1284 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 13:49:24.295157 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-b2a38e80-6f5a-4a3b-a931-6b31ba656a49 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:49:24.296260 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-b2a38e80-6f5a-4a3b-a931-6b31ba656a49 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] [instance: 8fb76141-70a4-4501-b928-7502a13c3cb4] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:49:24.316376 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-b2a38e80-6f5a-4a3b-a931-6b31ba656a49 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:24.317642 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-b2a38e80-6f5a-4a3b-a931-6b31ba656a49 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:24.318675 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-b2a38e80-6f5a-4a3b-a931-6b31ba656a49 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:24.322992 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-b2a38e80-6f5a-4a3b-a931-6b31ba656a49 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:24.324254 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-b2a38e80-6f5a-4a3b-a931-6b31ba656a49 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:24.326367 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-b2a38e80-6f5a-4a3b-a931-6b31ba656a49 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:24.427405 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [req-397fa6b4-4fad-4f1c-950d-f97cbec01803 req-6c887da4-1230-4e4b-9ddf-514bc74c535a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8fb76141-70a4-4501-b928-7502a13c3cb4", "tag": "22d267b5-2636-4dae-87c7-578106faed38"}]} {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 13:49:24.455933 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [req-397fa6b4-4fad-4f1c-950d-f97cbec01803 req-6c887da4-1230-4e4b-9ddf-514bc74c535a service nova] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:24.458046 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [req-397fa6b4-4fad-4f1c-950d-f97cbec01803 req-6c887da4-1230-4e4b-9ddf-514bc74c535a service nova] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:24.459291 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [req-397fa6b4-4fad-4f1c-950d-f97cbec01803 req-6c887da4-1230-4e4b-9ddf-514bc74c535a service nova] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:24.514261 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.compute.server_external_events [req-397fa6b4-4fad-4f1c-950d-f97cbec01803 req-6c887da4-1230-4e4b-9ddf-514bc74c535a service nova] Creating event network-changed:22d267b5-2636-4dae-87c7-578106faed38 for instance 8fb76141-70a4-4501-b928-7502a13c3cb4 on hv-cinder-86149 Oct 15 13:49:24.515507 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [req-397fa6b4-4fad-4f1c-950d-f97cbec01803 req-6c887da4-1230-4e4b-9ddf-514bc74c535a service nova] Acquiring lock "compute-rpcapi-router" {{(pid=125243) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 15 13:49:24.516465 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [req-397fa6b4-4fad-4f1c-950d-f97cbec01803 req-6c887da4-1230-4e4b-9ddf-514bc74c535a service nova] Acquired lock "compute-rpcapi-router" {{(pid=125243) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 15 13:49:24.518563 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-60888bb2-155f-4333-b765-b5977728b886 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:24.519655 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-60888bb2-155f-4333-b765-b5977728b886 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:24.520693 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-60888bb2-155f-4333-b765-b5977728b886 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:24.522016 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-60888bb2-155f-4333-b765-b5977728b886 None None] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:24.523025 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-60888bb2-155f-4333-b765-b5977728b886 None None] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:24.523772 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-60888bb2-155f-4333-b765-b5977728b886 None None] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:24.536581 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.compute.rpcapi [None req-60888bb2-155f-4333-b765-b5977728b886 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 15 13:49:24.537545 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-60888bb2-155f-4333-b765-b5977728b886 None None] Releasing lock "compute-rpcapi-router" {{(pid=125243) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 15 13:49:24.574117 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-60888bb2-155f-4333-b765-b5977728b886 None None] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.524747 Oct 15 13:49:24.575310 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 37/75] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 15 13:49:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 13:49:24.587107 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [req-abe6e1a7-69d6-45bf-b5be-23a9914ebcbe req-2683d0a0-cf14-4619-8e29-d9dbca898ba0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8976a74-703a-4fa4-9cc7-760a3e3f226b", "tag": "5141cb8c-0fe9-45ee-84cc-9c59a65bca83"}]} {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 13:49:24.601340 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [req-abe6e1a7-69d6-45bf-b5be-23a9914ebcbe req-2683d0a0-cf14-4619-8e29-d9dbca898ba0 service nova] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:24.601872 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [req-abe6e1a7-69d6-45bf-b5be-23a9914ebcbe req-2683d0a0-cf14-4619-8e29-d9dbca898ba0 service nova] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:24.602514 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [req-abe6e1a7-69d6-45bf-b5be-23a9914ebcbe req-2683d0a0-cf14-4619-8e29-d9dbca898ba0 service nova] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:24.624308 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.compute.server_external_events [req-abe6e1a7-69d6-45bf-b5be-23a9914ebcbe req-2683d0a0-cf14-4619-8e29-d9dbca898ba0 service nova] Creating event network-changed:5141cb8c-0fe9-45ee-84cc-9c59a65bca83 for instance a8976a74-703a-4fa4-9cc7-760a3e3f226b on hv-cinder-86149 Oct 15 13:49:24.631238 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [req-abe6e1a7-69d6-45bf-b5be-23a9914ebcbe req-2683d0a0-cf14-4619-8e29-d9dbca898ba0 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051235 Oct 15 13:49:24.632577 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 38/76] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 15 13:49:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 13:49:24.993494 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-176309ac-099c-41ca-bc7d-0f6ecb2c59bf tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:49:24.996473 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-176309ac-099c-41ca-bc7d-0f6ecb2c59bf tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] [instance: a8976a74-703a-4fa4-9cc7-760a3e3f226b] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:49:25.011659 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-176309ac-099c-41ca-bc7d-0f6ecb2c59bf tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:25.015713 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-176309ac-099c-41ca-bc7d-0f6ecb2c59bf tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:25.019560 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-176309ac-099c-41ca-bc7d-0f6ecb2c59bf tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:25.021879 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-176309ac-099c-41ca-bc7d-0f6ecb2c59bf tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:25.025646 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-176309ac-099c-41ca-bc7d-0f6ecb2c59bf tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:25.026934 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-176309ac-099c-41ca-bc7d-0f6ecb2c59bf tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:25.267924 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-b2a38e80-6f5a-4a3b-a931-6b31ba656a49 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc29734859a5460faee189b1726b50b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984a02b8dfd446879438d29b5efdd996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:49:25.279179 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-b2a38e80-6f5a-4a3b-a931-6b31ba656a49 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] 10.222.0.36 "GET /compute/v2.1/servers/8fb76141-70a4-4501-b928-7502a13c3cb4" status: 200 len: 1315 microversion: 2.1 time: 1.013066 Oct 15 13:49:25.284313 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 39/77] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:49:24 2022] GET /compute/v2.1/servers/8fb76141-70a4-4501-b928-7502a13c3cb4 => generated 1315 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:49:25.289632 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-e9d1f0e6-09dd-4ae1-8c2e-f66b435d3d71 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:49:25.298106 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-e9d1f0e6-09dd-4ae1-8c2e-f66b435d3d71 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] [instance: 40d67d09-379e-4c12-b36c-21edf3b23e45] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:49:25.315070 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-e9d1f0e6-09dd-4ae1-8c2e-f66b435d3d71 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:25.316058 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-e9d1f0e6-09dd-4ae1-8c2e-f66b435d3d71 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:25.316792 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-e9d1f0e6-09dd-4ae1-8c2e-f66b435d3d71 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:25.317801 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-e9d1f0e6-09dd-4ae1-8c2e-f66b435d3d71 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:25.318510 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-e9d1f0e6-09dd-4ae1-8c2e-f66b435d3d71 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:25.319075 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-e9d1f0e6-09dd-4ae1-8c2e-f66b435d3d71 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:25.625454 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-176309ac-099c-41ca-bc7d-0f6ecb2c59bf tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5150c06020594efe957359f641eba5da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a0813bae074cd2aa552be82abe8493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:49:25.633907 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-176309ac-099c-41ca-bc7d-0f6ecb2c59bf tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] 10.222.0.36 "GET /compute/v2.1/servers/a8976a74-703a-4fa4-9cc7-760a3e3f226b" status: 200 len: 1321 microversion: 2.1 time: 0.646173 Oct 15 13:49:25.640705 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 39/78] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:49:24 2022] GET /compute/v2.1/servers/a8976a74-703a-4fa4-9cc7-760a3e3f226b => generated 1321 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:49:25.646279 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-af2fcf3c-a259-4f77-a215-a7b2a9942181 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:49:25.647283 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-af2fcf3c-a259-4f77-a215-a7b2a9942181 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 5fc359cf-ff2c-4189-b058-31eb3c97568c] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:49:25.655481 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-af2fcf3c-a259-4f77-a215-a7b2a9942181 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:25.656281 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-af2fcf3c-a259-4f77-a215-a7b2a9942181 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:25.657051 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-af2fcf3c-a259-4f77-a215-a7b2a9942181 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:25.657990 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-af2fcf3c-a259-4f77-a215-a7b2a9942181 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:25.658664 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-af2fcf3c-a259-4f77-a215-a7b2a9942181 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:25.659523 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-af2fcf3c-a259-4f77-a215-a7b2a9942181 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:25.687196 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-e9d1f0e6-09dd-4ae1-8c2e-f66b435d3d71 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583cce1547144e11978f20a3193ceba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f8b5024a194f70a9f7689ac44ab07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:49:25.714661 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-e9d1f0e6-09dd-4ae1-8c2e-f66b435d3d71 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] 10.222.0.36 "GET /compute/v2.1/servers/40d67d09-379e-4c12-b36c-21edf3b23e45" status: 200 len: 1363 microversion: 2.1 time: 0.428673 Oct 15 13:49:25.715623 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 40/79] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:49:25 2022] GET /compute/v2.1/servers/40d67d09-379e-4c12-b36c-21edf3b23e45 => generated 1363 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:49:25.807282 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-af2fcf3c-a259-4f77-a215-a7b2a9942181 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:49:25.844236 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-af2fcf3c-a259-4f77-a215-a7b2a9942181 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:49:25.850115 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-af2fcf3c-a259-4f77-a215-a7b2a9942181 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:49:25.856644 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-af2fcf3c-a259-4f77-a215-a7b2a9942181 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c" status: 200 len: 1284 microversion: 2.20 time: 0.211725 Oct 15 13:49:25.865623 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 40/80] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:49:25 2022] GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c => generated 1284 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 13:49:26.309166 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-6631f3fa-6ad6-4c7e-9b27-c06293c8f6a6 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:49:26.311805 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-6631f3fa-6ad6-4c7e-9b27-c06293c8f6a6 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] [instance: 8fb76141-70a4-4501-b928-7502a13c3cb4] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:49:26.327644 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-6631f3fa-6ad6-4c7e-9b27-c06293c8f6a6 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:26.328989 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-6631f3fa-6ad6-4c7e-9b27-c06293c8f6a6 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:26.330078 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-6631f3fa-6ad6-4c7e-9b27-c06293c8f6a6 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:26.331735 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-6631f3fa-6ad6-4c7e-9b27-c06293c8f6a6 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:26.333036 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-6631f3fa-6ad6-4c7e-9b27-c06293c8f6a6 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:26.335738 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-6631f3fa-6ad6-4c7e-9b27-c06293c8f6a6 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:26.613980 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [req-374c4431-2c66-411a-a77c-fca59cbf9cb4 req-2198880e-516b-4cb0-a964-b1a653b0f7a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40d67d09-379e-4c12-b36c-21edf3b23e45", "tag": "00b42a41-b63e-414a-944b-f58697650617"}]} {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 13:49:26.664497 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [req-374c4431-2c66-411a-a77c-fca59cbf9cb4 req-2198880e-516b-4cb0-a964-b1a653b0f7a8 service nova] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:26.678588 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [req-374c4431-2c66-411a-a77c-fca59cbf9cb4 req-2198880e-516b-4cb0-a964-b1a653b0f7a8 service nova] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:26.682525 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [req-374c4431-2c66-411a-a77c-fca59cbf9cb4 req-2198880e-516b-4cb0-a964-b1a653b0f7a8 service nova] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:26.744145 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.compute.server_external_events [req-374c4431-2c66-411a-a77c-fca59cbf9cb4 req-2198880e-516b-4cb0-a964-b1a653b0f7a8 service nova] Creating event network-changed:00b42a41-b63e-414a-944b-f58697650617 for instance 40d67d09-379e-4c12-b36c-21edf3b23e45 on hv-cinder-86149 Oct 15 13:49:26.762962 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [req-374c4431-2c66-411a-a77c-fca59cbf9cb4 req-2198880e-516b-4cb0-a964-b1a653b0f7a8 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.156375 Oct 15 13:49:26.768034 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 41/81] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 15 13:49:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 13:49:26.785671 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-ea82b92a-3559-4f7a-9c07-88554c750f93 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:49:26.786879 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-ea82b92a-3559-4f7a-9c07-88554c750f93 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] [instance: a8976a74-703a-4fa4-9cc7-760a3e3f226b] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:49:26.827936 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-ea82b92a-3559-4f7a-9c07-88554c750f93 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:26.827936 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-ea82b92a-3559-4f7a-9c07-88554c750f93 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:26.831602 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-ea82b92a-3559-4f7a-9c07-88554c750f93 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:26.834466 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-ea82b92a-3559-4f7a-9c07-88554c750f93 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:26.842446 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-6631f3fa-6ad6-4c7e-9b27-c06293c8f6a6 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc29734859a5460faee189b1726b50b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984a02b8dfd446879438d29b5efdd996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:49:26.849802 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-ea82b92a-3559-4f7a-9c07-88554c750f93 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:26.850762 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-ea82b92a-3559-4f7a-9c07-88554c750f93 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:26.868806 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-6631f3fa-6ad6-4c7e-9b27-c06293c8f6a6 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] 10.222.0.36 "GET /compute/v2.1/servers/8fb76141-70a4-4501-b928-7502a13c3cb4" status: 200 len: 1315 microversion: 2.1 time: 0.567601 Oct 15 13:49:26.885057 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 41/82] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:49:26 2022] GET /compute/v2.1/servers/8fb76141-70a4-4501-b928-7502a13c3cb4 => generated 1315 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:49:26.920761 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-84de811d-bb9e-4221-a663-415627f315be tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:49:26.922173 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-84de811d-bb9e-4221-a663-415627f315be tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] [instance: 40d67d09-379e-4c12-b36c-21edf3b23e45] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:49:26.939759 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-84de811d-bb9e-4221-a663-415627f315be tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:26.940705 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-84de811d-bb9e-4221-a663-415627f315be tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:26.942123 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-84de811d-bb9e-4221-a663-415627f315be tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:26.943099 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-84de811d-bb9e-4221-a663-415627f315be tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:26.943796 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-84de811d-bb9e-4221-a663-415627f315be tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:26.944467 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-84de811d-bb9e-4221-a663-415627f315be tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:26.971090 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG dbcounter [-] [125242] Writing DB stats nova_cell1:SELECT=100 {{(pid=125242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:49:27.301200 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-ea82b92a-3559-4f7a-9c07-88554c750f93 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5150c06020594efe957359f641eba5da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a0813bae074cd2aa552be82abe8493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:49:27.314284 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-84de811d-bb9e-4221-a663-415627f315be tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583cce1547144e11978f20a3193ceba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f8b5024a194f70a9f7689ac44ab07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:49:27.316542 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-ea82b92a-3559-4f7a-9c07-88554c750f93 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] 10.222.0.36 "GET /compute/v2.1/servers/a8976a74-703a-4fa4-9cc7-760a3e3f226b" status: 200 len: 1321 microversion: 2.1 time: 0.545853 Oct 15 13:49:27.317603 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 42/83] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:49:26 2022] GET /compute/v2.1/servers/a8976a74-703a-4fa4-9cc7-760a3e3f226b => generated 1321 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:49:27.327376 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-6bad651b-f92d-4750-836a-d90a7404a737 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:49:27.328488 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-6bad651b-f92d-4750-836a-d90a7404a737 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 5fc359cf-ff2c-4189-b058-31eb3c97568c] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:49:27.337561 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-84de811d-bb9e-4221-a663-415627f315be tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] 10.222.0.36 "GET /compute/v2.1/servers/40d67d09-379e-4c12-b36c-21edf3b23e45" status: 200 len: 1363 microversion: 2.1 time: 0.450037 Oct 15 13:49:27.339211 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 42/84] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:49:26 2022] GET /compute/v2.1/servers/40d67d09-379e-4c12-b36c-21edf3b23e45 => generated 1363 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:49:27.340147 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-6bad651b-f92d-4750-836a-d90a7404a737 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:27.341611 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-6bad651b-f92d-4750-836a-d90a7404a737 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:27.342887 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-6bad651b-f92d-4750-836a-d90a7404a737 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:27.344190 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-6bad651b-f92d-4750-836a-d90a7404a737 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:27.345179 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-6bad651b-f92d-4750-836a-d90a7404a737 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:27.345911 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-6bad651b-f92d-4750-836a-d90a7404a737 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:27.465763 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-6bad651b-f92d-4750-836a-d90a7404a737 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:49:27.482909 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-6bad651b-f92d-4750-836a-d90a7404a737 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:49:27.486931 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-6bad651b-f92d-4750-836a-d90a7404a737 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:49:27.489122 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-6bad651b-f92d-4750-836a-d90a7404a737 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c" status: 200 len: 1284 microversion: 2.20 time: 0.169845 Oct 15 13:49:27.490165 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 43/85] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:49:27 2022] GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c => generated 1284 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 13:49:27.925884 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-2fabd2a5-dfbf-4e08-97f1-bc05bb7af6c3 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:49:27.928051 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-2fabd2a5-dfbf-4e08-97f1-bc05bb7af6c3 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] [instance: 8fb76141-70a4-4501-b928-7502a13c3cb4] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:49:27.941348 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-2fabd2a5-dfbf-4e08-97f1-bc05bb7af6c3 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:27.945561 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-2fabd2a5-dfbf-4e08-97f1-bc05bb7af6c3 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:27.947648 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-2fabd2a5-dfbf-4e08-97f1-bc05bb7af6c3 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:27.950405 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-2fabd2a5-dfbf-4e08-97f1-bc05bb7af6c3 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:27.952687 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-2fabd2a5-dfbf-4e08-97f1-bc05bb7af6c3 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:27.953651 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-2fabd2a5-dfbf-4e08-97f1-bc05bb7af6c3 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:28.181792 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-2fabd2a5-dfbf-4e08-97f1-bc05bb7af6c3 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc29734859a5460faee189b1726b50b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984a02b8dfd446879438d29b5efdd996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:49:28.192810 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-2fabd2a5-dfbf-4e08-97f1-bc05bb7af6c3 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] 10.222.0.36 "GET /compute/v2.1/servers/8fb76141-70a4-4501-b928-7502a13c3cb4" status: 200 len: 1315 microversion: 2.1 time: 0.273193 Oct 15 13:49:28.193916 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 43/86] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:49:27 2022] GET /compute/v2.1/servers/8fb76141-70a4-4501-b928-7502a13c3cb4 => generated 1315 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:49:28.379850 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-6287d353-0201-4301-9ba7-a727362eeb53 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:49:28.384335 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-6287d353-0201-4301-9ba7-a727362eeb53 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] [instance: a8976a74-703a-4fa4-9cc7-760a3e3f226b] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:49:28.386368 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-6654218f-64a4-45f6-be40-f5f79a4a4941 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:49:28.387099 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-6654218f-64a4-45f6-be40-f5f79a4a4941 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] [instance: 40d67d09-379e-4c12-b36c-21edf3b23e45] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:49:28.407758 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-6654218f-64a4-45f6-be40-f5f79a4a4941 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:28.410272 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-6654218f-64a4-45f6-be40-f5f79a4a4941 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:28.410932 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-6654218f-64a4-45f6-be40-f5f79a4a4941 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:28.412140 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-6287d353-0201-4301-9ba7-a727362eeb53 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:28.412715 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-6287d353-0201-4301-9ba7-a727362eeb53 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:28.414048 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-6654218f-64a4-45f6-be40-f5f79a4a4941 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:28.414748 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-6287d353-0201-4301-9ba7-a727362eeb53 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:28.415437 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-6654218f-64a4-45f6-be40-f5f79a4a4941 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:28.415567 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-6287d353-0201-4301-9ba7-a727362eeb53 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:28.416048 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-6287d353-0201-4301-9ba7-a727362eeb53 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:28.416787 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-6654218f-64a4-45f6-be40-f5f79a4a4941 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:28.417241 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-6287d353-0201-4301-9ba7-a727362eeb53 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:29.270274 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-6654218f-64a4-45f6-be40-f5f79a4a4941 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583cce1547144e11978f20a3193ceba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f8b5024a194f70a9f7689ac44ab07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:49:29.285932 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-6654218f-64a4-45f6-be40-f5f79a4a4941 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] 10.222.0.36 "GET /compute/v2.1/servers/40d67d09-379e-4c12-b36c-21edf3b23e45" status: 200 len: 1363 microversion: 2.1 time: 0.903176 Oct 15 13:49:29.286465 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 44/87] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:49:28 2022] GET /compute/v2.1/servers/40d67d09-379e-4c12-b36c-21edf3b23e45 => generated 1363 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:49:29.305051 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-43ad37b3-db01-44d4-8aa3-bd513efc14f1 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:49:29.305923 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-6287d353-0201-4301-9ba7-a727362eeb53 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5150c06020594efe957359f641eba5da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a0813bae074cd2aa552be82abe8493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:49:29.312660 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-43ad37b3-db01-44d4-8aa3-bd513efc14f1 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 5fc359cf-ff2c-4189-b058-31eb3c97568c] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:49:29.327399 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-43ad37b3-db01-44d4-8aa3-bd513efc14f1 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:29.328047 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-43ad37b3-db01-44d4-8aa3-bd513efc14f1 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:29.328502 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-43ad37b3-db01-44d4-8aa3-bd513efc14f1 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:29.329381 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-43ad37b3-db01-44d4-8aa3-bd513efc14f1 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:29.329879 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-43ad37b3-db01-44d4-8aa3-bd513efc14f1 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:29.331642 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-6287d353-0201-4301-9ba7-a727362eeb53 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] 10.222.0.36 "GET /compute/v2.1/servers/a8976a74-703a-4fa4-9cc7-760a3e3f226b" status: 200 len: 1321 microversion: 2.1 time: 0.960209 Oct 15 13:49:29.332316 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 44/88] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:49:28 2022] GET /compute/v2.1/servers/a8976a74-703a-4fa4-9cc7-760a3e3f226b => generated 1321 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:49:29.353864 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-2a66fdfd-5f51-4f99-aae6-4548afe1683a tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:49:29.354599 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-2a66fdfd-5f51-4f99-aae6-4548afe1683a tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] [instance: 8fb76141-70a4-4501-b928-7502a13c3cb4] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:49:29.358052 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-43ad37b3-db01-44d4-8aa3-bd513efc14f1 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:29.373572 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-2a66fdfd-5f51-4f99-aae6-4548afe1683a tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:29.374076 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-2a66fdfd-5f51-4f99-aae6-4548afe1683a tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:29.374516 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-2a66fdfd-5f51-4f99-aae6-4548afe1683a tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:29.375230 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-2a66fdfd-5f51-4f99-aae6-4548afe1683a tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:29.379501 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-2a66fdfd-5f51-4f99-aae6-4548afe1683a tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:29.380291 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-2a66fdfd-5f51-4f99-aae6-4548afe1683a tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:29.691496 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-43ad37b3-db01-44d4-8aa3-bd513efc14f1 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:49:29.707402 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-43ad37b3-db01-44d4-8aa3-bd513efc14f1 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:49:29.709304 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-43ad37b3-db01-44d4-8aa3-bd513efc14f1 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:49:29.710693 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-43ad37b3-db01-44d4-8aa3-bd513efc14f1 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c" status: 200 len: 1332 microversion: 2.20 time: 0.423116 Oct 15 13:49:29.713314 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 45/89] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:49:29 2022] GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c => generated 1332 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 13:49:30.315676 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-8c499962-b54e-44ed-ad53-bd539c50d8e5 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:49:30.316586 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-8c499962-b54e-44ed-ad53-bd539c50d8e5 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] [instance: 40d67d09-379e-4c12-b36c-21edf3b23e45] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:49:30.324487 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-8c499962-b54e-44ed-ad53-bd539c50d8e5 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:30.325444 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-8c499962-b54e-44ed-ad53-bd539c50d8e5 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:30.326408 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-8c499962-b54e-44ed-ad53-bd539c50d8e5 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:30.327395 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-8c499962-b54e-44ed-ad53-bd539c50d8e5 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:30.328130 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-8c499962-b54e-44ed-ad53-bd539c50d8e5 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:30.328872 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-8c499962-b54e-44ed-ad53-bd539c50d8e5 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:30.429244 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-2a66fdfd-5f51-4f99-aae6-4548afe1683a tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc29734859a5460faee189b1726b50b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984a02b8dfd446879438d29b5efdd996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:49:30.457676 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-2a66fdfd-5f51-4f99-aae6-4548afe1683a tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] 10.222.0.36 "GET /compute/v2.1/servers/8fb76141-70a4-4501-b928-7502a13c3cb4" status: 200 len: 1315 microversion: 2.1 time: 1.102375 Oct 15 13:49:30.459093 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 45/90] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:49:29 2022] GET /compute/v2.1/servers/8fb76141-70a4-4501-b928-7502a13c3cb4 => generated 1315 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:49:30.479503 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-1c742fc6-3963-4937-ace7-40e3cf2da37a tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:49:30.481064 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-1c742fc6-3963-4937-ace7-40e3cf2da37a tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] [instance: a8976a74-703a-4fa4-9cc7-760a3e3f226b] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:49:30.517077 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-1c742fc6-3963-4937-ace7-40e3cf2da37a tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:30.519330 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-1c742fc6-3963-4937-ace7-40e3cf2da37a tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:30.522881 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-1c742fc6-3963-4937-ace7-40e3cf2da37a tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:30.524605 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-1c742fc6-3963-4937-ace7-40e3cf2da37a tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:30.525767 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-1c742fc6-3963-4937-ace7-40e3cf2da37a tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:30.526768 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-1c742fc6-3963-4937-ace7-40e3cf2da37a tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:31.840155 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-8c499962-b54e-44ed-ad53-bd539c50d8e5 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583cce1547144e11978f20a3193ceba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f8b5024a194f70a9f7689ac44ab07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:49:31.853796 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-1c742fc6-3963-4937-ace7-40e3cf2da37a tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5150c06020594efe957359f641eba5da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a0813bae074cd2aa552be82abe8493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:49:31.877506 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-8c499962-b54e-44ed-ad53-bd539c50d8e5 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] 10.222.0.36 "GET /compute/v2.1/servers/40d67d09-379e-4c12-b36c-21edf3b23e45" status: 200 len: 1363 microversion: 2.1 time: 1.565108 Oct 15 13:49:31.878967 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 46/91] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:49:30 2022] GET /compute/v2.1/servers/40d67d09-379e-4c12-b36c-21edf3b23e45 => generated 1363 bytes in 1568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 13:49:31.888298 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-1c742fc6-3963-4937-ace7-40e3cf2da37a tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] 10.222.0.36 "GET /compute/v2.1/servers/a8976a74-703a-4fa4-9cc7-760a3e3f226b" status: 200 len: 1321 microversion: 2.1 time: 1.426934 Oct 15 13:49:31.897363 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 46/92] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:49:30 2022] GET /compute/v2.1/servers/a8976a74-703a-4fa4-9cc7-760a3e3f226b => generated 1321 bytes in 1438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:49:31.932755 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-eeb5ce61-1223-440c-848f-34bbe9f3179e tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:49:31.933850 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-eeb5ce61-1223-440c-848f-34bbe9f3179e tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 5fc359cf-ff2c-4189-b058-31eb3c97568c] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:49:31.945422 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-eeb5ce61-1223-440c-848f-34bbe9f3179e tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:31.946316 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-eeb5ce61-1223-440c-848f-34bbe9f3179e tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:31.947093 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-eeb5ce61-1223-440c-848f-34bbe9f3179e tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:31.948702 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-eeb5ce61-1223-440c-848f-34bbe9f3179e tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:31.949424 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-eeb5ce61-1223-440c-848f-34bbe9f3179e tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:31.950531 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-eeb5ce61-1223-440c-848f-34bbe9f3179e tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:32.098268 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-eeb5ce61-1223-440c-848f-34bbe9f3179e tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:49:32.129596 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-eeb5ce61-1223-440c-848f-34bbe9f3179e tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:49:32.148508 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-eeb5ce61-1223-440c-848f-34bbe9f3179e tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:49:32.149814 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-eeb5ce61-1223-440c-848f-34bbe9f3179e tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c" status: 200 len: 1338 microversion: 2.20 time: 0.255147 Oct 15 13:49:32.160154 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 47/93] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:49:31 2022] GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c => generated 1338 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 13:49:32.172160 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [req-50c1f972-c2da-42f6-ad20-af863c4098c6 req-1ebf6752-7dda-41b9-b286-2d2a91ab5e09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "242ed9b0-fe03-4583-ad2f-4760e86d2031", "name": "network-vif-plugged", "status": "completed", "tag": "b700737e-c8a7-40a1-96f2-1665f19a9778"}]} {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 13:49:32.175032 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-78f21d02-82cf-4624-b64f-184a488ba00d tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:49:32.175948 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-78f21d02-82cf-4624-b64f-184a488ba00d tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] [instance: 8fb76141-70a4-4501-b928-7502a13c3cb4] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:49:32.183303 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-78f21d02-82cf-4624-b64f-184a488ba00d tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:32.184689 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-78f21d02-82cf-4624-b64f-184a488ba00d tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:32.185368 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-78f21d02-82cf-4624-b64f-184a488ba00d tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:32.186355 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-78f21d02-82cf-4624-b64f-184a488ba00d tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:32.187043 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-78f21d02-82cf-4624-b64f-184a488ba00d tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:32.187672 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-78f21d02-82cf-4624-b64f-184a488ba00d tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:32.216825 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [req-50c1f972-c2da-42f6-ad20-af863c4098c6 req-1ebf6752-7dda-41b9-b286-2d2a91ab5e09 service nova] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:32.220465 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [req-50c1f972-c2da-42f6-ad20-af863c4098c6 req-1ebf6752-7dda-41b9-b286-2d2a91ab5e09 service nova] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:32.221825 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [req-50c1f972-c2da-42f6-ad20-af863c4098c6 req-1ebf6752-7dda-41b9-b286-2d2a91ab5e09 service nova] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:32.291583 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.compute.server_external_events [req-50c1f972-c2da-42f6-ad20-af863c4098c6 req-1ebf6752-7dda-41b9-b286-2d2a91ab5e09 service nova] Creating event network-vif-plugged:b700737e-c8a7-40a1-96f2-1665f19a9778 for instance 242ed9b0-fe03-4583-ad2f-4760e86d2031 on hv-cinder-86149 Oct 15 13:49:32.305271 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [req-50c1f972-c2da-42f6-ad20-af863c4098c6 req-1ebf6752-7dda-41b9-b286-2d2a91ab5e09 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.403581 Oct 15 13:49:32.307672 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 47/94] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 15 13:49:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 13:49:32.339603 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG dbcounter [-] [125242] Writing DB stats nova_cell0:SELECT=2 {{(pid=125242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:49:32.588395 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-78f21d02-82cf-4624-b64f-184a488ba00d tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc29734859a5460faee189b1726b50b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984a02b8dfd446879438d29b5efdd996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:49:32.599679 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-78f21d02-82cf-4624-b64f-184a488ba00d tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] 10.222.0.36 "GET /compute/v2.1/servers/8fb76141-70a4-4501-b928-7502a13c3cb4" status: 200 len: 1315 microversion: 2.1 time: 0.437881 Oct 15 13:49:32.600317 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 48/95] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:49:32 2022] GET /compute/v2.1/servers/8fb76141-70a4-4501-b928-7502a13c3cb4 => generated 1315 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:49:32.919376 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG dbcounter [-] [125243] Writing DB stats nova_cell0:SELECT=6 {{(pid=125243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:49:32.924679 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-e16008d3-258c-4cbc-ae0c-e7b2fd9e145a tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:49:32.925885 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-e16008d3-258c-4cbc-ae0c-e7b2fd9e145a tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] [instance: a8976a74-703a-4fa4-9cc7-760a3e3f226b] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:49:32.929824 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-c1f152dd-b07a-4fe8-a7c9-eee972c0ca0c tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:49:32.931078 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-c1f152dd-b07a-4fe8-a7c9-eee972c0ca0c tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] [instance: 40d67d09-379e-4c12-b36c-21edf3b23e45] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:49:32.935388 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-e16008d3-258c-4cbc-ae0c-e7b2fd9e145a tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:32.936306 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-e16008d3-258c-4cbc-ae0c-e7b2fd9e145a tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:32.936971 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-e16008d3-258c-4cbc-ae0c-e7b2fd9e145a tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:32.937974 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-e16008d3-258c-4cbc-ae0c-e7b2fd9e145a tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:32.938510 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-e16008d3-258c-4cbc-ae0c-e7b2fd9e145a tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:32.939009 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-e16008d3-258c-4cbc-ae0c-e7b2fd9e145a tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:32.947510 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-c1f152dd-b07a-4fe8-a7c9-eee972c0ca0c tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:32.952412 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-c1f152dd-b07a-4fe8-a7c9-eee972c0ca0c tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:32.953269 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-c1f152dd-b07a-4fe8-a7c9-eee972c0ca0c tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:32.954525 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-c1f152dd-b07a-4fe8-a7c9-eee972c0ca0c tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:32.959310 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-c1f152dd-b07a-4fe8-a7c9-eee972c0ca0c tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:32.961312 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-c1f152dd-b07a-4fe8-a7c9-eee972c0ca0c tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:33.269303 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-e16008d3-258c-4cbc-ae0c-e7b2fd9e145a tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5150c06020594efe957359f641eba5da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a0813bae074cd2aa552be82abe8493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:49:33.294340 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-e16008d3-258c-4cbc-ae0c-e7b2fd9e145a tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] 10.222.0.36 "GET /compute/v2.1/servers/a8976a74-703a-4fa4-9cc7-760a3e3f226b" status: 200 len: 1321 microversion: 2.1 time: 0.374979 Oct 15 13:49:33.295812 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 48/96] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:49:32 2022] GET /compute/v2.1/servers/a8976a74-703a-4fa4-9cc7-760a3e3f226b => generated 1321 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 13:49:33.306686 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-bc9b42a6-8736-488d-8bf6-d64f9a25f885 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:49:33.308097 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-bc9b42a6-8736-488d-8bf6-d64f9a25f885 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 5fc359cf-ff2c-4189-b058-31eb3c97568c] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:49:33.321121 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-bc9b42a6-8736-488d-8bf6-d64f9a25f885 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:33.322312 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-bc9b42a6-8736-488d-8bf6-d64f9a25f885 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:33.323539 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-bc9b42a6-8736-488d-8bf6-d64f9a25f885 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:33.325293 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-bc9b42a6-8736-488d-8bf6-d64f9a25f885 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:33.326313 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-bc9b42a6-8736-488d-8bf6-d64f9a25f885 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:33.327231 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-bc9b42a6-8736-488d-8bf6-d64f9a25f885 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:33.345328 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-c1f152dd-b07a-4fe8-a7c9-eee972c0ca0c tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583cce1547144e11978f20a3193ceba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f8b5024a194f70a9f7689ac44ab07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:49:33.367493 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-c1f152dd-b07a-4fe8-a7c9-eee972c0ca0c tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] 10.222.0.36 "GET /compute/v2.1/servers/40d67d09-379e-4c12-b36c-21edf3b23e45" status: 200 len: 1363 microversion: 2.1 time: 0.443349 Oct 15 13:49:33.369007 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 49/97] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:49:32 2022] GET /compute/v2.1/servers/40d67d09-379e-4c12-b36c-21edf3b23e45 => generated 1363 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 13:49:33.445489 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-bc9b42a6-8736-488d-8bf6-d64f9a25f885 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:49:33.471570 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-bc9b42a6-8736-488d-8bf6-d64f9a25f885 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:49:33.473819 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-bc9b42a6-8736-488d-8bf6-d64f9a25f885 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:49:33.475198 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-bc9b42a6-8736-488d-8bf6-d64f9a25f885 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c" status: 200 len: 1338 microversion: 2.20 time: 0.177701 Oct 15 13:49:33.475797 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 49/98] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:49:33 2022] GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c => generated 1338 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 13:49:33.624343 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-0307b225-14bc-41aa-8023-c190eb232434 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:49:33.624927 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-0307b225-14bc-41aa-8023-c190eb232434 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] [instance: 8fb76141-70a4-4501-b928-7502a13c3cb4] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:49:33.632246 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-0307b225-14bc-41aa-8023-c190eb232434 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:33.633123 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-0307b225-14bc-41aa-8023-c190eb232434 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:33.633789 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-0307b225-14bc-41aa-8023-c190eb232434 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:33.634751 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-0307b225-14bc-41aa-8023-c190eb232434 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:33.635438 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-0307b225-14bc-41aa-8023-c190eb232434 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:33.636477 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-0307b225-14bc-41aa-8023-c190eb232434 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:34.330324 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-22ff744a-4773-4dfc-a091-00dcf1036bd5 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:49:34.331376 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-22ff744a-4773-4dfc-a091-00dcf1036bd5 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] [instance: a8976a74-703a-4fa4-9cc7-760a3e3f226b] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:49:34.375753 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-22ff744a-4773-4dfc-a091-00dcf1036bd5 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:34.376662 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-22ff744a-4773-4dfc-a091-00dcf1036bd5 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:34.377444 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-22ff744a-4773-4dfc-a091-00dcf1036bd5 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:34.378733 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-22ff744a-4773-4dfc-a091-00dcf1036bd5 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:34.381471 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-22ff744a-4773-4dfc-a091-00dcf1036bd5 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:34.382262 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-22ff744a-4773-4dfc-a091-00dcf1036bd5 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:34.408861 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-0307b225-14bc-41aa-8023-c190eb232434 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc29734859a5460faee189b1726b50b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984a02b8dfd446879438d29b5efdd996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:49:34.418593 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-0307b225-14bc-41aa-8023-c190eb232434 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] 10.222.0.36 "GET /compute/v2.1/servers/8fb76141-70a4-4501-b928-7502a13c3cb4" status: 200 len: 1315 microversion: 2.1 time: 0.798974 Oct 15 13:49:34.419626 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 50/99] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:49:33 2022] GET /compute/v2.1/servers/8fb76141-70a4-4501-b928-7502a13c3cb4 => generated 1315 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:49:34.439340 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [req-009e20b4-54d9-474a-8181-1746f4c13be1 req-76bee5df-4bf4-4633-a669-e2af5db9fe0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8976a74-703a-4fa4-9cc7-760a3e3f226b", "name": "network-vif-plugged", "status": "completed", "tag": "5141cb8c-0fe9-45ee-84cc-9c59a65bca83"}]} {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 13:49:34.454135 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [req-009e20b4-54d9-474a-8181-1746f4c13be1 req-76bee5df-4bf4-4633-a669-e2af5db9fe0d service nova] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:34.455140 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [req-009e20b4-54d9-474a-8181-1746f4c13be1 req-76bee5df-4bf4-4633-a669-e2af5db9fe0d service nova] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:34.455768 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [req-009e20b4-54d9-474a-8181-1746f4c13be1 req-76bee5df-4bf4-4633-a669-e2af5db9fe0d service nova] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:34.475706 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.compute.server_external_events [req-009e20b4-54d9-474a-8181-1746f4c13be1 req-76bee5df-4bf4-4633-a669-e2af5db9fe0d service nova] Creating event network-vif-plugged:5141cb8c-0fe9-45ee-84cc-9c59a65bca83 for instance a8976a74-703a-4fa4-9cc7-760a3e3f226b on hv-cinder-86149 Oct 15 13:49:34.482713 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [req-009e20b4-54d9-474a-8181-1746f4c13be1 req-76bee5df-4bf4-4633-a669-e2af5db9fe0d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057448 Oct 15 13:49:34.484302 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 51/100] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 15 13:49:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 13:49:34.490637 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-01217878-4ba5-443d-b47e-11ef16151dd2 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:49:34.491751 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-01217878-4ba5-443d-b47e-11ef16151dd2 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] [instance: 40d67d09-379e-4c12-b36c-21edf3b23e45] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:49:34.499661 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-01217878-4ba5-443d-b47e-11ef16151dd2 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:34.501047 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-01217878-4ba5-443d-b47e-11ef16151dd2 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:34.501726 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-01217878-4ba5-443d-b47e-11ef16151dd2 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:34.502691 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-01217878-4ba5-443d-b47e-11ef16151dd2 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:34.503419 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-01217878-4ba5-443d-b47e-11ef16151dd2 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:34.504392 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-01217878-4ba5-443d-b47e-11ef16151dd2 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:34.535368 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG dbcounter [-] [125243] Writing DB stats nova_cell0:SELECT=4 {{(pid=125243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:49:35.009026 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-22ff744a-4773-4dfc-a091-00dcf1036bd5 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5150c06020594efe957359f641eba5da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a0813bae074cd2aa552be82abe8493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:49:35.025642 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-22ff744a-4773-4dfc-a091-00dcf1036bd5 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] 10.222.0.36 "GET /compute/v2.1/servers/a8976a74-703a-4fa4-9cc7-760a3e3f226b" status: 200 len: 1321 microversion: 2.1 time: 0.698672 Oct 15 13:49:35.040879 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 50/101] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:49:34 2022] GET /compute/v2.1/servers/a8976a74-703a-4fa4-9cc7-760a3e3f226b => generated 1321 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 13:49:35.052891 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-01217878-4ba5-443d-b47e-11ef16151dd2 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583cce1547144e11978f20a3193ceba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f8b5024a194f70a9f7689ac44ab07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:49:35.068414 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-60a2f7d8-fdbb-42f9-85ce-1b34bb6e54b0 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:49:35.077532 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-60a2f7d8-fdbb-42f9-85ce-1b34bb6e54b0 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 5fc359cf-ff2c-4189-b058-31eb3c97568c] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:49:35.082181 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-01217878-4ba5-443d-b47e-11ef16151dd2 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] 10.222.0.36 "GET /compute/v2.1/servers/40d67d09-379e-4c12-b36c-21edf3b23e45" status: 200 len: 1363 microversion: 2.1 time: 0.588913 Oct 15 13:49:35.083532 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 52/102] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:49:34 2022] GET /compute/v2.1/servers/40d67d09-379e-4c12-b36c-21edf3b23e45 => generated 1363 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:49:35.094597 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-60a2f7d8-fdbb-42f9-85ce-1b34bb6e54b0 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:35.096071 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-60a2f7d8-fdbb-42f9-85ce-1b34bb6e54b0 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:35.097456 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-60a2f7d8-fdbb-42f9-85ce-1b34bb6e54b0 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:35.098920 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-60a2f7d8-fdbb-42f9-85ce-1b34bb6e54b0 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:35.099945 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-60a2f7d8-fdbb-42f9-85ce-1b34bb6e54b0 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:35.100921 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-60a2f7d8-fdbb-42f9-85ce-1b34bb6e54b0 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:35.234174 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-60a2f7d8-fdbb-42f9-85ce-1b34bb6e54b0 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:49:35.247455 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-60a2f7d8-fdbb-42f9-85ce-1b34bb6e54b0 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:49:35.249414 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-60a2f7d8-fdbb-42f9-85ce-1b34bb6e54b0 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:49:35.250676 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-60a2f7d8-fdbb-42f9-85ce-1b34bb6e54b0 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c" status: 200 len: 1338 microversion: 2.20 time: 0.208063 Oct 15 13:49:35.251929 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 51/103] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:49:35 2022] GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c => generated 1338 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 13:49:35.451372 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-c3721e3e-6798-4dbc-bac6-f113d3f650c6 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:49:35.452744 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-c3721e3e-6798-4dbc-bac6-f113d3f650c6 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] [instance: 8fb76141-70a4-4501-b928-7502a13c3cb4] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:49:35.467866 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-c3721e3e-6798-4dbc-bac6-f113d3f650c6 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:35.472479 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-c3721e3e-6798-4dbc-bac6-f113d3f650c6 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:35.478272 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-c3721e3e-6798-4dbc-bac6-f113d3f650c6 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:35.482883 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-c3721e3e-6798-4dbc-bac6-f113d3f650c6 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:35.483706 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-c3721e3e-6798-4dbc-bac6-f113d3f650c6 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:35.484984 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-c3721e3e-6798-4dbc-bac6-f113d3f650c6 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:36.066933 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-4d168a05-753f-41b6-8660-469e40af74d5 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:49:36.068460 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-4d168a05-753f-41b6-8660-469e40af74d5 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] [instance: a8976a74-703a-4fa4-9cc7-760a3e3f226b] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:49:36.081654 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-4d168a05-753f-41b6-8660-469e40af74d5 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:36.084184 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-4d168a05-753f-41b6-8660-469e40af74d5 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:36.085104 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-4d168a05-753f-41b6-8660-469e40af74d5 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:36.086877 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-4d168a05-753f-41b6-8660-469e40af74d5 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:36.088654 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-4d168a05-753f-41b6-8660-469e40af74d5 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:36.089107 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-4d168a05-753f-41b6-8660-469e40af74d5 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:36.343348 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-c3721e3e-6798-4dbc-bac6-f113d3f650c6 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc29734859a5460faee189b1726b50b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984a02b8dfd446879438d29b5efdd996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:49:36.353210 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-c3721e3e-6798-4dbc-bac6-f113d3f650c6 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] 10.222.0.36 "GET /compute/v2.1/servers/8fb76141-70a4-4501-b928-7502a13c3cb4" status: 200 len: 1315 microversion: 2.1 time: 0.906970 Oct 15 13:49:36.353969 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 53/104] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:49:35 2022] GET /compute/v2.1/servers/8fb76141-70a4-4501-b928-7502a13c3cb4 => generated 1315 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 13:49:36.359630 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-3cd97c61-ef79-4f50-8a93-a0c1d74b96d0 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:49:36.360369 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-3cd97c61-ef79-4f50-8a93-a0c1d74b96d0 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] [instance: 40d67d09-379e-4c12-b36c-21edf3b23e45] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:49:36.367144 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-3cd97c61-ef79-4f50-8a93-a0c1d74b96d0 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:36.367636 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-3cd97c61-ef79-4f50-8a93-a0c1d74b96d0 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:36.368329 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-3cd97c61-ef79-4f50-8a93-a0c1d74b96d0 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:36.369454 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-3cd97c61-ef79-4f50-8a93-a0c1d74b96d0 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:36.370159 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-3cd97c61-ef79-4f50-8a93-a0c1d74b96d0 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:36.370844 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-3cd97c61-ef79-4f50-8a93-a0c1d74b96d0 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:37.049348 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-4d168a05-753f-41b6-8660-469e40af74d5 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5150c06020594efe957359f641eba5da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a0813bae074cd2aa552be82abe8493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:49:37.061215 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-4d168a05-753f-41b6-8660-469e40af74d5 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] 10.222.0.36 "GET /compute/v2.1/servers/a8976a74-703a-4fa4-9cc7-760a3e3f226b" status: 200 len: 1321 microversion: 2.1 time: 0.998756 Oct 15 13:49:37.087986 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 52/105] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:49:36 2022] GET /compute/v2.1/servers/a8976a74-703a-4fa4-9cc7-760a3e3f226b => generated 1321 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:49:37.115951 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-b7fabe23-937e-47e6-9dc7-57a9302ef88e tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:49:37.118459 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-b7fabe23-937e-47e6-9dc7-57a9302ef88e tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 5fc359cf-ff2c-4189-b058-31eb3c97568c] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:49:37.140809 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-b7fabe23-937e-47e6-9dc7-57a9302ef88e tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:37.143393 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-b7fabe23-937e-47e6-9dc7-57a9302ef88e tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:37.145096 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-b7fabe23-937e-47e6-9dc7-57a9302ef88e tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:37.147293 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-b7fabe23-937e-47e6-9dc7-57a9302ef88e tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:37.149905 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-b7fabe23-937e-47e6-9dc7-57a9302ef88e tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:37.150915 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-b7fabe23-937e-47e6-9dc7-57a9302ef88e tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:37.162632 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-3cd97c61-ef79-4f50-8a93-a0c1d74b96d0 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583cce1547144e11978f20a3193ceba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f8b5024a194f70a9f7689ac44ab07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:49:37.179617 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-3cd97c61-ef79-4f50-8a93-a0c1d74b96d0 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] 10.222.0.36 "GET /compute/v2.1/servers/40d67d09-379e-4c12-b36c-21edf3b23e45" status: 200 len: 1363 microversion: 2.1 time: 0.824176 Oct 15 13:49:37.181343 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 54/106] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:49:36 2022] GET /compute/v2.1/servers/40d67d09-379e-4c12-b36c-21edf3b23e45 => generated 1363 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:49:37.204680 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [req-40fdf78b-e8f4-4e4b-b268-871b20b53263 req-8a950956-aa68-4116-b9af-db5d6f15ee06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40d67d09-379e-4c12-b36c-21edf3b23e45", "name": "network-vif-plugged", "status": "completed", "tag": "00b42a41-b63e-414a-944b-f58697650617"}]} {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 13:49:37.259433 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [req-40fdf78b-e8f4-4e4b-b268-871b20b53263 req-8a950956-aa68-4116-b9af-db5d6f15ee06 service nova] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:37.263248 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [req-40fdf78b-e8f4-4e4b-b268-871b20b53263 req-8a950956-aa68-4116-b9af-db5d6f15ee06 service nova] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:37.263760 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [req-40fdf78b-e8f4-4e4b-b268-871b20b53263 req-8a950956-aa68-4116-b9af-db5d6f15ee06 service nova] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:37.291893 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.compute.server_external_events [req-40fdf78b-e8f4-4e4b-b268-871b20b53263 req-8a950956-aa68-4116-b9af-db5d6f15ee06 service nova] Creating event network-vif-plugged:00b42a41-b63e-414a-944b-f58697650617 for instance 40d67d09-379e-4c12-b36c-21edf3b23e45 on hv-cinder-86149 Oct 15 13:49:37.301768 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [req-40fdf78b-e8f4-4e4b-b268-871b20b53263 req-8a950956-aa68-4116-b9af-db5d6f15ee06 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118752 Oct 15 13:49:37.307356 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 55/107] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 15 13:49:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 13:49:37.383438 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-7faa7587-99c7-4079-9bbb-a2baa05309f6 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:49:37.384919 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-7faa7587-99c7-4079-9bbb-a2baa05309f6 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] [instance: 8fb76141-70a4-4501-b928-7502a13c3cb4] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:49:37.399510 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-7faa7587-99c7-4079-9bbb-a2baa05309f6 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:37.401982 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-7faa7587-99c7-4079-9bbb-a2baa05309f6 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:37.404964 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-7faa7587-99c7-4079-9bbb-a2baa05309f6 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:37.407984 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-7faa7587-99c7-4079-9bbb-a2baa05309f6 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:37.408919 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-7faa7587-99c7-4079-9bbb-a2baa05309f6 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:37.411452 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-7faa7587-99c7-4079-9bbb-a2baa05309f6 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:37.663182 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-b7fabe23-937e-47e6-9dc7-57a9302ef88e tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:49:37.689328 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-b7fabe23-937e-47e6-9dc7-57a9302ef88e tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:49:37.690950 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-b7fabe23-937e-47e6-9dc7-57a9302ef88e tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:49:37.692154 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-b7fabe23-937e-47e6-9dc7-57a9302ef88e tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c" status: 200 len: 1406 microversion: 2.20 time: 0.598735 Oct 15 13:49:37.696257 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 53/108] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:49:37 2022] GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c => generated 1406 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 13:49:37.886010 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-7faa7587-99c7-4079-9bbb-a2baa05309f6 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc29734859a5460faee189b1726b50b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984a02b8dfd446879438d29b5efdd996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:49:37.896351 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-7faa7587-99c7-4079-9bbb-a2baa05309f6 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] 10.222.0.36 "GET /compute/v2.1/servers/8fb76141-70a4-4501-b928-7502a13c3cb4" status: 200 len: 1315 microversion: 2.1 time: 0.518432 Oct 15 13:49:37.916842 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 56/109] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:49:37 2022] GET /compute/v2.1/servers/8fb76141-70a4-4501-b928-7502a13c3cb4 => generated 1315 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:49:38.093368 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-9580d7fb-d835-4725-9c03-938725175c58 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:49:38.094390 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-9580d7fb-d835-4725-9c03-938725175c58 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] [instance: a8976a74-703a-4fa4-9cc7-760a3e3f226b] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:49:38.106360 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-9580d7fb-d835-4725-9c03-938725175c58 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:38.107500 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-9580d7fb-d835-4725-9c03-938725175c58 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:38.108276 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-9580d7fb-d835-4725-9c03-938725175c58 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:38.109479 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-9580d7fb-d835-4725-9c03-938725175c58 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:38.110210 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-9580d7fb-d835-4725-9c03-938725175c58 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:38.111124 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-9580d7fb-d835-4725-9c03-938725175c58 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:38.231041 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-581694f9-4794-4491-99b3-6284ba1967b0 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:49:38.232178 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-581694f9-4794-4491-99b3-6284ba1967b0 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] [instance: 40d67d09-379e-4c12-b36c-21edf3b23e45] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:49:38.244490 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-581694f9-4794-4491-99b3-6284ba1967b0 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:38.245329 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-581694f9-4794-4491-99b3-6284ba1967b0 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:38.246082 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-581694f9-4794-4491-99b3-6284ba1967b0 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:38.248659 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-581694f9-4794-4491-99b3-6284ba1967b0 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:38.249484 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-581694f9-4794-4491-99b3-6284ba1967b0 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:38.250207 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-581694f9-4794-4491-99b3-6284ba1967b0 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:38.490423 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-9580d7fb-d835-4725-9c03-938725175c58 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5150c06020594efe957359f641eba5da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a0813bae074cd2aa552be82abe8493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:49:38.495012 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG dbcounter [-] [125243] Writing DB stats nova_cell1:SELECT=100 {{(pid=125243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:49:38.509165 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-9580d7fb-d835-4725-9c03-938725175c58 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] 10.222.0.36 "GET /compute/v2.1/servers/a8976a74-703a-4fa4-9cc7-760a3e3f226b" status: 200 len: 1321 microversion: 2.1 time: 0.422379 Oct 15 13:49:38.510450 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 54/110] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:49:38 2022] GET /compute/v2.1/servers/a8976a74-703a-4fa4-9cc7-760a3e3f226b => generated 1321 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:49:38.521165 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [req-3f91b675-7c6a-4c37-a41a-a93920a115c7 req-85d73612-42a0-433f-8ee7-c0cf56cba58f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5fc359cf-ff2c-4189-b058-31eb3c97568c", "tag": "5a131939-5800-4807-b2cc-42f66041598f"}]} {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 13:49:38.545661 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-581694f9-4794-4491-99b3-6284ba1967b0 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583cce1547144e11978f20a3193ceba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f8b5024a194f70a9f7689ac44ab07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:49:38.552130 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [req-3f91b675-7c6a-4c37-a41a-a93920a115c7 req-85d73612-42a0-433f-8ee7-c0cf56cba58f service nova] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:38.553082 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [req-3f91b675-7c6a-4c37-a41a-a93920a115c7 req-85d73612-42a0-433f-8ee7-c0cf56cba58f service nova] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:38.554495 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [req-3f91b675-7c6a-4c37-a41a-a93920a115c7 req-85d73612-42a0-433f-8ee7-c0cf56cba58f service nova] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:38.558415 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-581694f9-4794-4491-99b3-6284ba1967b0 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] 10.222.0.36 "GET /compute/v2.1/servers/40d67d09-379e-4c12-b36c-21edf3b23e45" status: 200 len: 1363 microversion: 2.1 time: 0.335362 Oct 15 13:49:38.559311 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 57/111] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:49:38 2022] GET /compute/v2.1/servers/40d67d09-379e-4c12-b36c-21edf3b23e45 => generated 1363 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:49:38.570303 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.compute.server_external_events [req-3f91b675-7c6a-4c37-a41a-a93920a115c7 req-85d73612-42a0-433f-8ee7-c0cf56cba58f service nova] Creating event network-changed:5a131939-5800-4807-b2cc-42f66041598f for instance 5fc359cf-ff2c-4189-b058-31eb3c97568c on hv-cinder-86149 Oct 15 13:49:38.579364 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [req-3f91b675-7c6a-4c37-a41a-a93920a115c7 req-85d73612-42a0-433f-8ee7-c0cf56cba58f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066803 Oct 15 13:49:38.580004 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 55/112] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 15 13:49:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 13:49:38.722543 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-ed3100e2-37c4-42d6-a16f-16b7d3f0fb31 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:49:38.724151 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-ed3100e2-37c4-42d6-a16f-16b7d3f0fb31 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 5fc359cf-ff2c-4189-b058-31eb3c97568c] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:49:38.738670 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-ed3100e2-37c4-42d6-a16f-16b7d3f0fb31 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:38.739774 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-ed3100e2-37c4-42d6-a16f-16b7d3f0fb31 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:38.740774 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-ed3100e2-37c4-42d6-a16f-16b7d3f0fb31 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:38.742731 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-ed3100e2-37c4-42d6-a16f-16b7d3f0fb31 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:38.743408 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-ed3100e2-37c4-42d6-a16f-16b7d3f0fb31 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:38.744102 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-ed3100e2-37c4-42d6-a16f-16b7d3f0fb31 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:38.925090 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-796e5aab-aaba-4f81-b3f6-e351130dd5ff tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:49:38.926178 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-796e5aab-aaba-4f81-b3f6-e351130dd5ff tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] [instance: 8fb76141-70a4-4501-b928-7502a13c3cb4] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:49:38.936606 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-796e5aab-aaba-4f81-b3f6-e351130dd5ff tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:38.937372 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-796e5aab-aaba-4f81-b3f6-e351130dd5ff tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:38.937964 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-796e5aab-aaba-4f81-b3f6-e351130dd5ff tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:38.939052 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-796e5aab-aaba-4f81-b3f6-e351130dd5ff tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:38.939322 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-796e5aab-aaba-4f81-b3f6-e351130dd5ff tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:38.939718 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-796e5aab-aaba-4f81-b3f6-e351130dd5ff tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:38.964471 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-ed3100e2-37c4-42d6-a16f-16b7d3f0fb31 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:49:38.974844 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-ed3100e2-37c4-42d6-a16f-16b7d3f0fb31 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:49:38.976478 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-ed3100e2-37c4-42d6-a16f-16b7d3f0fb31 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:49:38.978112 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-ed3100e2-37c4-42d6-a16f-16b7d3f0fb31 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c" status: 200 len: 1406 microversion: 2.20 time: 0.264321 Oct 15 13:49:38.979004 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 58/113] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:49:38 2022] GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c => generated 1406 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 15 13:49:39.158828 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-796e5aab-aaba-4f81-b3f6-e351130dd5ff tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc29734859a5460faee189b1726b50b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984a02b8dfd446879438d29b5efdd996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:49:39.168018 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-796e5aab-aaba-4f81-b3f6-e351130dd5ff tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] 10.222.0.36 "GET /compute/v2.1/servers/8fb76141-70a4-4501-b928-7502a13c3cb4" status: 200 len: 1315 microversion: 2.1 time: 0.247959 Oct 15 13:49:39.169655 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 56/114] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:49:38 2022] GET /compute/v2.1/servers/8fb76141-70a4-4501-b928-7502a13c3cb4 => generated 1315 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 13:49:39.536219 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-3cac0234-ce53-4853-92f3-b506282d4917 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:49:39.536219 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-3cac0234-ce53-4853-92f3-b506282d4917 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] [instance: a8976a74-703a-4fa4-9cc7-760a3e3f226b] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:49:39.549643 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-3cac0234-ce53-4853-92f3-b506282d4917 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:39.549643 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-3cac0234-ce53-4853-92f3-b506282d4917 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:39.549643 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-3cac0234-ce53-4853-92f3-b506282d4917 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:39.549643 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-3cac0234-ce53-4853-92f3-b506282d4917 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:39.550139 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-3cac0234-ce53-4853-92f3-b506282d4917 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:39.550139 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-3cac0234-ce53-4853-92f3-b506282d4917 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:39.585376 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-c97fa96f-9703-4790-b059-03b27f39510d tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:49:39.586211 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-c97fa96f-9703-4790-b059-03b27f39510d tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] [instance: 40d67d09-379e-4c12-b36c-21edf3b23e45] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:49:39.599737 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-c97fa96f-9703-4790-b059-03b27f39510d tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:39.600325 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-c97fa96f-9703-4790-b059-03b27f39510d tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:39.600764 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-c97fa96f-9703-4790-b059-03b27f39510d tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:39.602159 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-c97fa96f-9703-4790-b059-03b27f39510d tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:39.603180 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-c97fa96f-9703-4790-b059-03b27f39510d tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:39.604630 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-c97fa96f-9703-4790-b059-03b27f39510d tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:39.922652 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-3cac0234-ce53-4853-92f3-b506282d4917 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5150c06020594efe957359f641eba5da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a0813bae074cd2aa552be82abe8493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:49:39.955368 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-c97fa96f-9703-4790-b059-03b27f39510d tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583cce1547144e11978f20a3193ceba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f8b5024a194f70a9f7689ac44ab07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:49:39.961133 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-3cac0234-ce53-4853-92f3-b506282d4917 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] 10.222.0.36 "GET /compute/v2.1/servers/a8976a74-703a-4fa4-9cc7-760a3e3f226b" status: 200 len: 1321 microversion: 2.1 time: 0.430170 Oct 15 13:49:39.974890 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 59/115] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:49:39 2022] GET /compute/v2.1/servers/a8976a74-703a-4fa4-9cc7-760a3e3f226b => generated 1321 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:49:39.985965 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-c97fa96f-9703-4790-b059-03b27f39510d tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] 10.222.0.36 "GET /compute/v2.1/servers/40d67d09-379e-4c12-b36c-21edf3b23e45" status: 200 len: 1363 microversion: 2.1 time: 0.405636 Oct 15 13:49:39.986490 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 57/116] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:49:39 2022] GET /compute/v2.1/servers/40d67d09-379e-4c12-b36c-21edf3b23e45 => generated 1363 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:49:40.026781 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-cb5f1142-27d6-49eb-9bc6-7f12b29a19d4 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:49:40.027946 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-cb5f1142-27d6-49eb-9bc6-7f12b29a19d4 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 5fc359cf-ff2c-4189-b058-31eb3c97568c] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:49:40.038810 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-cb5f1142-27d6-49eb-9bc6-7f12b29a19d4 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:40.039657 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-cb5f1142-27d6-49eb-9bc6-7f12b29a19d4 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:40.040750 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-cb5f1142-27d6-49eb-9bc6-7f12b29a19d4 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:40.041961 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-cb5f1142-27d6-49eb-9bc6-7f12b29a19d4 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:40.042773 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-cb5f1142-27d6-49eb-9bc6-7f12b29a19d4 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:40.043549 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-cb5f1142-27d6-49eb-9bc6-7f12b29a19d4 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:40.082182 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG dbcounter [-] [125242] Writing DB stats nova_cell1:SELECT=100 {{(pid=125242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:49:40.205158 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-0ec71ae9-e503-43d3-9235-666785cb6746 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:49:40.206172 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-0ec71ae9-e503-43d3-9235-666785cb6746 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] [instance: 8fb76141-70a4-4501-b928-7502a13c3cb4] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:49:40.213328 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-0ec71ae9-e503-43d3-9235-666785cb6746 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:40.213825 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-0ec71ae9-e503-43d3-9235-666785cb6746 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:40.214261 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-0ec71ae9-e503-43d3-9235-666785cb6746 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:40.214968 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-0ec71ae9-e503-43d3-9235-666785cb6746 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:40.215621 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-0ec71ae9-e503-43d3-9235-666785cb6746 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:40.216113 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-0ec71ae9-e503-43d3-9235-666785cb6746 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:40.244030 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-cb5f1142-27d6-49eb-9bc6-7f12b29a19d4 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:49:40.259766 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-cb5f1142-27d6-49eb-9bc6-7f12b29a19d4 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:49:40.262397 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-cb5f1142-27d6-49eb-9bc6-7f12b29a19d4 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:49:40.264649 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-cb5f1142-27d6-49eb-9bc6-7f12b29a19d4 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c" status: 200 len: 1406 microversion: 2.20 time: 0.245017 Oct 15 13:49:40.265665 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 60/117] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:49:40 2022] GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c => generated 1406 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 15 13:49:40.385228 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-0ec71ae9-e503-43d3-9235-666785cb6746 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc29734859a5460faee189b1726b50b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984a02b8dfd446879438d29b5efdd996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:49:40.394308 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-0ec71ae9-e503-43d3-9235-666785cb6746 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] 10.222.0.36 "GET /compute/v2.1/servers/8fb76141-70a4-4501-b928-7502a13c3cb4" status: 200 len: 1315 microversion: 2.1 time: 0.195092 Oct 15 13:49:40.394922 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 58/118] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:49:40 2022] GET /compute/v2.1/servers/8fb76141-70a4-4501-b928-7502a13c3cb4 => generated 1315 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:49:41.003689 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-082ba9f7-cbbb-40e5-8700-6d03db00c8e6 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:49:41.004759 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-082ba9f7-cbbb-40e5-8700-6d03db00c8e6 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] [instance: a8976a74-703a-4fa4-9cc7-760a3e3f226b] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:49:41.014405 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-082ba9f7-cbbb-40e5-8700-6d03db00c8e6 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:41.015102 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-082ba9f7-cbbb-40e5-8700-6d03db00c8e6 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:41.015648 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-082ba9f7-cbbb-40e5-8700-6d03db00c8e6 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:41.016609 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-082ba9f7-cbbb-40e5-8700-6d03db00c8e6 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:41.017174 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-082ba9f7-cbbb-40e5-8700-6d03db00c8e6 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:41.018050 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-082ba9f7-cbbb-40e5-8700-6d03db00c8e6 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:41.026269 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-e1503aa9-4cd6-49d8-9366-397b50777579 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:49:41.027604 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-e1503aa9-4cd6-49d8-9366-397b50777579 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] [instance: 40d67d09-379e-4c12-b36c-21edf3b23e45] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:49:41.039012 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-e1503aa9-4cd6-49d8-9366-397b50777579 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:41.039834 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-e1503aa9-4cd6-49d8-9366-397b50777579 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:41.040595 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-e1503aa9-4cd6-49d8-9366-397b50777579 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:41.041779 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-e1503aa9-4cd6-49d8-9366-397b50777579 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:41.042557 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-e1503aa9-4cd6-49d8-9366-397b50777579 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:41.043260 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-e1503aa9-4cd6-49d8-9366-397b50777579 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:41.278609 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-082ba9f7-cbbb-40e5-8700-6d03db00c8e6 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5150c06020594efe957359f641eba5da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a0813bae074cd2aa552be82abe8493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:49:41.288158 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-082ba9f7-cbbb-40e5-8700-6d03db00c8e6 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] 10.222.0.36 "GET /compute/v2.1/servers/a8976a74-703a-4fa4-9cc7-760a3e3f226b" status: 200 len: 1321 microversion: 2.1 time: 0.291686 Oct 15 13:49:41.289018 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 61/119] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:49:40 2022] GET /compute/v2.1/servers/a8976a74-703a-4fa4-9cc7-760a3e3f226b => generated 1321 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:49:41.294015 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-2c5d35cd-1250-4aa0-9a37-2bcee3345b67 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:49:41.294835 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-2c5d35cd-1250-4aa0-9a37-2bcee3345b67 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 5fc359cf-ff2c-4189-b058-31eb3c97568c] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:49:41.299094 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-e1503aa9-4cd6-49d8-9366-397b50777579 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583cce1547144e11978f20a3193ceba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f8b5024a194f70a9f7689ac44ab07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:49:41.301436 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-2c5d35cd-1250-4aa0-9a37-2bcee3345b67 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:41.301923 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-2c5d35cd-1250-4aa0-9a37-2bcee3345b67 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:41.302361 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-2c5d35cd-1250-4aa0-9a37-2bcee3345b67 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:41.303104 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-2c5d35cd-1250-4aa0-9a37-2bcee3345b67 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:41.303529 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-2c5d35cd-1250-4aa0-9a37-2bcee3345b67 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:41.303996 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-2c5d35cd-1250-4aa0-9a37-2bcee3345b67 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:41.309008 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-e1503aa9-4cd6-49d8-9366-397b50777579 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] 10.222.0.36 "GET /compute/v2.1/servers/40d67d09-379e-4c12-b36c-21edf3b23e45" status: 200 len: 1363 microversion: 2.1 time: 0.289338 Oct 15 13:49:41.309851 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 59/120] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:49:41 2022] GET /compute/v2.1/servers/40d67d09-379e-4c12-b36c-21edf3b23e45 => generated 1363 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 13:49:41.419078 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-d25f44af-a2f4-4d22-84c1-93f6e1738df7 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:49:41.420007 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-d25f44af-a2f4-4d22-84c1-93f6e1738df7 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] [instance: 8fb76141-70a4-4501-b928-7502a13c3cb4] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:49:41.426574 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-d25f44af-a2f4-4d22-84c1-93f6e1738df7 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:41.427074 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-d25f44af-a2f4-4d22-84c1-93f6e1738df7 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:41.427510 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-d25f44af-a2f4-4d22-84c1-93f6e1738df7 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:41.428256 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-d25f44af-a2f4-4d22-84c1-93f6e1738df7 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:41.428709 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-d25f44af-a2f4-4d22-84c1-93f6e1738df7 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:41.429170 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-d25f44af-a2f4-4d22-84c1-93f6e1738df7 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:41.499601 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-2c5d35cd-1250-4aa0-9a37-2bcee3345b67 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:49:41.508902 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-2c5d35cd-1250-4aa0-9a37-2bcee3345b67 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:49:41.510372 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-2c5d35cd-1250-4aa0-9a37-2bcee3345b67 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:49:41.511525 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-2c5d35cd-1250-4aa0-9a37-2bcee3345b67 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c" status: 200 len: 1406 microversion: 2.20 time: 0.221517 Oct 15 13:49:41.512124 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 62/121] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:49:41 2022] GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c => generated 1406 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 13:49:41.624845 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-d25f44af-a2f4-4d22-84c1-93f6e1738df7 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc29734859a5460faee189b1726b50b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984a02b8dfd446879438d29b5efdd996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:49:41.639263 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-d25f44af-a2f4-4d22-84c1-93f6e1738df7 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] 10.222.0.36 "GET /compute/v2.1/servers/8fb76141-70a4-4501-b928-7502a13c3cb4" status: 200 len: 1315 microversion: 2.1 time: 0.224152 Oct 15 13:49:41.640395 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 60/122] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:49:41 2022] GET /compute/v2.1/servers/8fb76141-70a4-4501-b928-7502a13c3cb4 => generated 1315 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 13:49:42.327850 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-da81b80c-497f-4489-b63c-03030b639fd6 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:49:42.329000 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-da81b80c-497f-4489-b63c-03030b639fd6 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] [instance: a8976a74-703a-4fa4-9cc7-760a3e3f226b] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:49:42.333626 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-116890e3-44b6-4de4-86bc-dde803db3cee tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:49:42.334528 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-116890e3-44b6-4de4-86bc-dde803db3cee tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] [instance: 40d67d09-379e-4c12-b36c-21edf3b23e45] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:49:42.336654 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-da81b80c-497f-4489-b63c-03030b639fd6 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:42.337254 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-da81b80c-497f-4489-b63c-03030b639fd6 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:42.337786 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-da81b80c-497f-4489-b63c-03030b639fd6 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:42.338625 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-da81b80c-497f-4489-b63c-03030b639fd6 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:42.339289 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-da81b80c-497f-4489-b63c-03030b639fd6 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:42.339827 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-da81b80c-497f-4489-b63c-03030b639fd6 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:42.342117 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-116890e3-44b6-4de4-86bc-dde803db3cee tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:42.342809 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-116890e3-44b6-4de4-86bc-dde803db3cee tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:42.343394 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-116890e3-44b6-4de4-86bc-dde803db3cee tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:42.344488 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-116890e3-44b6-4de4-86bc-dde803db3cee tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:42.345048 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-116890e3-44b6-4de4-86bc-dde803db3cee tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:42.345640 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-116890e3-44b6-4de4-86bc-dde803db3cee tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:42.602036 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-da81b80c-497f-4489-b63c-03030b639fd6 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5150c06020594efe957359f641eba5da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a0813bae074cd2aa552be82abe8493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:49:42.619331 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-116890e3-44b6-4de4-86bc-dde803db3cee tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583cce1547144e11978f20a3193ceba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f8b5024a194f70a9f7689ac44ab07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:49:42.634890 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-da81b80c-497f-4489-b63c-03030b639fd6 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] 10.222.0.36 "GET /compute/v2.1/servers/a8976a74-703a-4fa4-9cc7-760a3e3f226b" status: 200 len: 1515 microversion: 2.1 time: 0.300734 Oct 15 13:49:42.636268 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 63/123] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:49:42 2022] GET /compute/v2.1/servers/a8976a74-703a-4fa4-9cc7-760a3e3f226b => generated 1515 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:49:42.650252 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-f9e9f0f1-b052-40a0-b2c1-8a4e6fc19fba tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:49:42.652021 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-f9e9f0f1-b052-40a0-b2c1-8a4e6fc19fba tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 5fc359cf-ff2c-4189-b058-31eb3c97568c] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:49:42.676901 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-f9e9f0f1-b052-40a0-b2c1-8a4e6fc19fba tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:42.677906 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-f9e9f0f1-b052-40a0-b2c1-8a4e6fc19fba tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:42.678681 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-f9e9f0f1-b052-40a0-b2c1-8a4e6fc19fba tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:42.679749 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-116890e3-44b6-4de4-86bc-dde803db3cee tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] 10.222.0.36 "GET /compute/v2.1/servers/40d67d09-379e-4c12-b36c-21edf3b23e45" status: 200 len: 1363 microversion: 2.1 time: 0.349676 Oct 15 13:49:42.680047 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-f9e9f0f1-b052-40a0-b2c1-8a4e6fc19fba tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:42.680867 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-f9e9f0f1-b052-40a0-b2c1-8a4e6fc19fba tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:42.681649 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-f9e9f0f1-b052-40a0-b2c1-8a4e6fc19fba tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:42.682605 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 61/124] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:49:42 2022] GET /compute/v2.1/servers/40d67d09-379e-4c12-b36c-21edf3b23e45 => generated 1363 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 13:49:42.700714 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-02e1270c-15ed-4742-81ab-0dde84f3a83b tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:49:42.702222 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-02e1270c-15ed-4742-81ab-0dde84f3a83b tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] [instance: 8fb76141-70a4-4501-b928-7502a13c3cb4] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:49:42.716505 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-02e1270c-15ed-4742-81ab-0dde84f3a83b tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:42.719785 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-02e1270c-15ed-4742-81ab-0dde84f3a83b tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:42.720841 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-02e1270c-15ed-4742-81ab-0dde84f3a83b tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:42.722340 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-02e1270c-15ed-4742-81ab-0dde84f3a83b tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:42.723564 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-02e1270c-15ed-4742-81ab-0dde84f3a83b tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:42.725341 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-02e1270c-15ed-4742-81ab-0dde84f3a83b tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:42.974316 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-f9e9f0f1-b052-40a0-b2c1-8a4e6fc19fba tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:49:42.986738 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-02e1270c-15ed-4742-81ab-0dde84f3a83b tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc29734859a5460faee189b1726b50b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984a02b8dfd446879438d29b5efdd996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:49:43.002428 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-f9e9f0f1-b052-40a0-b2c1-8a4e6fc19fba tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:49:43.005318 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-02e1270c-15ed-4742-81ab-0dde84f3a83b tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] 10.222.0.36 "GET /compute/v2.1/servers/8fb76141-70a4-4501-b928-7502a13c3cb4" status: 200 len: 1315 microversion: 2.1 time: 0.318718 Oct 15 13:49:43.005523 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-f9e9f0f1-b052-40a0-b2c1-8a4e6fc19fba tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:49:43.007177 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 62/125] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:49:42 2022] GET /compute/v2.1/servers/8fb76141-70a4-4501-b928-7502a13c3cb4 => generated 1315 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:49:43.007918 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-f9e9f0f1-b052-40a0-b2c1-8a4e6fc19fba tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c" status: 200 len: 1406 microversion: 2.20 time: 0.369078 Oct 15 13:49:43.018979 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 64/126] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:49:42 2022] GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c => generated 1406 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 13:49:43.024152 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-fcb3ddbe-b57d-47d5-aa44-0b628d7baf76 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 13:49:43.029704 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-fcb3ddbe-b57d-47d5-aa44-0b628d7baf76 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] [instance: a8976a74-703a-4fa4-9cc7-760a3e3f226b] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:49:43.045648 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-fcb3ddbe-b57d-47d5-aa44-0b628d7baf76 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:43.046810 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-fcb3ddbe-b57d-47d5-aa44-0b628d7baf76 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:43.048808 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-fcb3ddbe-b57d-47d5-aa44-0b628d7baf76 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:43.051176 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-fcb3ddbe-b57d-47d5-aa44-0b628d7baf76 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:43.052269 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-fcb3ddbe-b57d-47d5-aa44-0b628d7baf76 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:43.053335 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-fcb3ddbe-b57d-47d5-aa44-0b628d7baf76 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:43.159254 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.objects.instance [None req-fcb3ddbe-b57d-47d5-aa44-0b628d7baf76 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lazy-loading 'flavor' on Instance uuid a8976a74-703a-4fa4-9cc7-760a3e3f226b {{(pid=125243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 15 13:49:43.346257 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-fcb3ddbe-b57d-47d5-aa44-0b628d7baf76 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] 10.222.0.36 "POST /compute/v2.1/servers/a8976a74-703a-4fa4-9cc7-760a3e3f226b/action" status: 200 len: 32 microversion: 2.1 time: 0.336560 Oct 15 13:49:43.354665 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 63/127] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 15 13:49:43 2022] POST /compute/v2.1/servers/a8976a74-703a-4fa4-9cc7-760a3e3f226b/action => generated 32 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 15 13:49:43.362081 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-b3edc5d2-2a41-40c2-8dec-6e0741816551 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:49:43.363614 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-b3edc5d2-2a41-40c2-8dec-6e0741816551 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] [instance: a8976a74-703a-4fa4-9cc7-760a3e3f226b] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:49:43.374617 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-b3edc5d2-2a41-40c2-8dec-6e0741816551 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:43.375224 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-b3edc5d2-2a41-40c2-8dec-6e0741816551 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:43.376549 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-b3edc5d2-2a41-40c2-8dec-6e0741816551 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:43.378048 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-b3edc5d2-2a41-40c2-8dec-6e0741816551 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:43.379049 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-b3edc5d2-2a41-40c2-8dec-6e0741816551 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:43.379988 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-b3edc5d2-2a41-40c2-8dec-6e0741816551 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:43.599571 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-b3edc5d2-2a41-40c2-8dec-6e0741816551 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5150c06020594efe957359f641eba5da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a0813bae074cd2aa552be82abe8493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:49:43.618366 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-b3edc5d2-2a41-40c2-8dec-6e0741816551 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] 10.222.0.36 "GET /compute/v2.1/servers/a8976a74-703a-4fa4-9cc7-760a3e3f226b" status: 200 len: 1521 microversion: 2.1 time: 0.261969 Oct 15 13:49:43.619678 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 65/128] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:49:43 2022] GET /compute/v2.1/servers/a8976a74-703a-4fa4-9cc7-760a3e3f226b => generated 1521 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:49:43.717214 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-be16bd59-bb47-48a9-b366-5df32d107802 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:49:43.718261 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-be16bd59-bb47-48a9-b366-5df32d107802 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] [instance: 40d67d09-379e-4c12-b36c-21edf3b23e45] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:49:43.729066 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-be16bd59-bb47-48a9-b366-5df32d107802 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:43.729869 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-be16bd59-bb47-48a9-b366-5df32d107802 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:43.730438 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-be16bd59-bb47-48a9-b366-5df32d107802 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:43.731378 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-be16bd59-bb47-48a9-b366-5df32d107802 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:43.732291 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-be16bd59-bb47-48a9-b366-5df32d107802 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:43.732896 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-be16bd59-bb47-48a9-b366-5df32d107802 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:44.076931 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-7c2f1ac8-81a1-4dda-ba4f-1300d9d3794d tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:49:44.082839 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-7c2f1ac8-81a1-4dda-ba4f-1300d9d3794d tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 5fc359cf-ff2c-4189-b058-31eb3c97568c] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:49:44.112099 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-7c2f1ac8-81a1-4dda-ba4f-1300d9d3794d tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:44.115018 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-7c2f1ac8-81a1-4dda-ba4f-1300d9d3794d tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:44.118264 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-7c2f1ac8-81a1-4dda-ba4f-1300d9d3794d tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:44.119806 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-7c2f1ac8-81a1-4dda-ba4f-1300d9d3794d tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:44.124123 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-7c2f1ac8-81a1-4dda-ba4f-1300d9d3794d tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:44.124997 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-7c2f1ac8-81a1-4dda-ba4f-1300d9d3794d tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:44.270300 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-be16bd59-bb47-48a9-b366-5df32d107802 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583cce1547144e11978f20a3193ceba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f8b5024a194f70a9f7689ac44ab07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:49:44.291457 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-be16bd59-bb47-48a9-b366-5df32d107802 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] 10.222.0.36 "GET /compute/v2.1/servers/40d67d09-379e-4c12-b36c-21edf3b23e45" status: 200 len: 1363 microversion: 2.1 time: 0.588399 Oct 15 13:49:44.293403 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 64/129] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:49:43 2022] GET /compute/v2.1/servers/40d67d09-379e-4c12-b36c-21edf3b23e45 => generated 1363 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:49:44.303513 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-f51170ea-2f87-411b-960c-82e4a287620c tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:49:44.306699 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-f51170ea-2f87-411b-960c-82e4a287620c tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] [instance: 8fb76141-70a4-4501-b928-7502a13c3cb4] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:49:44.319649 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-f51170ea-2f87-411b-960c-82e4a287620c tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:44.321107 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-f51170ea-2f87-411b-960c-82e4a287620c tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:44.322418 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-f51170ea-2f87-411b-960c-82e4a287620c tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:44.324046 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-f51170ea-2f87-411b-960c-82e4a287620c tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:44.325154 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-f51170ea-2f87-411b-960c-82e4a287620c tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:44.327163 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-f51170ea-2f87-411b-960c-82e4a287620c tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:44.815465 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-7c2f1ac8-81a1-4dda-ba4f-1300d9d3794d tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:49:44.829610 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-7c2f1ac8-81a1-4dda-ba4f-1300d9d3794d tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:49:44.831178 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-7c2f1ac8-81a1-4dda-ba4f-1300d9d3794d tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:49:44.832427 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-7c2f1ac8-81a1-4dda-ba4f-1300d9d3794d tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c" status: 200 len: 1406 microversion: 2.20 time: 0.785317 Oct 15 13:49:44.833371 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 66/130] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:49:44 2022] GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c => generated 1406 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 13:49:44.838183 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-f51170ea-2f87-411b-960c-82e4a287620c tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc29734859a5460faee189b1726b50b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984a02b8dfd446879438d29b5efdd996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:49:44.845134 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-d49c2491-288b-4eb0-acb6-72eefe9ac3dc tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:49:44.851151 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-f51170ea-2f87-411b-960c-82e4a287620c tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] 10.222.0.36 "GET /compute/v2.1/servers/8fb76141-70a4-4501-b928-7502a13c3cb4" status: 200 len: 1315 microversion: 2.1 time: 0.555392 Oct 15 13:49:44.861885 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 65/131] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:49:44 2022] GET /compute/v2.1/servers/8fb76141-70a4-4501-b928-7502a13c3cb4 => generated 1315 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:49:44.862793 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-d49c2491-288b-4eb0-acb6-72eefe9ac3dc tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] [instance: a8976a74-703a-4fa4-9cc7-760a3e3f226b] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:49:44.875770 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-d49c2491-288b-4eb0-acb6-72eefe9ac3dc tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:44.876552 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-d49c2491-288b-4eb0-acb6-72eefe9ac3dc tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:44.877424 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-d49c2491-288b-4eb0-acb6-72eefe9ac3dc tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:44.878382 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-d49c2491-288b-4eb0-acb6-72eefe9ac3dc tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:44.879457 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-d49c2491-288b-4eb0-acb6-72eefe9ac3dc tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:44.880143 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-d49c2491-288b-4eb0-acb6-72eefe9ac3dc tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:45.064196 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-d49c2491-288b-4eb0-acb6-72eefe9ac3dc tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5150c06020594efe957359f641eba5da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a0813bae074cd2aa552be82abe8493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:49:45.073053 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-d49c2491-288b-4eb0-acb6-72eefe9ac3dc tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] 10.222.0.36 "GET /compute/v2.1/servers/a8976a74-703a-4fa4-9cc7-760a3e3f226b" status: 200 len: 1521 microversion: 2.1 time: 0.238412 Oct 15 13:49:45.073679 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 67/132] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:49:44 2022] GET /compute/v2.1/servers/a8976a74-703a-4fa4-9cc7-760a3e3f226b => generated 1521 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:49:45.327146 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-f025ca3c-b857-4ff9-a621-2e5d1c5304d2 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:49:45.328273 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-f025ca3c-b857-4ff9-a621-2e5d1c5304d2 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] [instance: 40d67d09-379e-4c12-b36c-21edf3b23e45] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:49:45.338924 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-f025ca3c-b857-4ff9-a621-2e5d1c5304d2 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:45.339762 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-f025ca3c-b857-4ff9-a621-2e5d1c5304d2 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:45.340573 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-f025ca3c-b857-4ff9-a621-2e5d1c5304d2 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:45.341783 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-f025ca3c-b857-4ff9-a621-2e5d1c5304d2 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:45.342581 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-f025ca3c-b857-4ff9-a621-2e5d1c5304d2 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:45.343294 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-f025ca3c-b857-4ff9-a621-2e5d1c5304d2 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:45.517519 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-f025ca3c-b857-4ff9-a621-2e5d1c5304d2 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583cce1547144e11978f20a3193ceba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f8b5024a194f70a9f7689ac44ab07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:49:45.526252 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-f025ca3c-b857-4ff9-a621-2e5d1c5304d2 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] 10.222.0.36 "GET /compute/v2.1/servers/40d67d09-379e-4c12-b36c-21edf3b23e45" status: 200 len: 1363 microversion: 2.1 time: 0.207177 Oct 15 13:49:45.526846 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 66/133] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:49:45 2022] GET /compute/v2.1/servers/40d67d09-379e-4c12-b36c-21edf3b23e45 => generated 1363 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 13:49:45.880260 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-b41be73a-8875-4eef-a20e-4926f1b180b9 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:49:45.880958 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-154ff99f-0dbb-4ad8-86fb-46f6aff8e20a tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:49:45.882143 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-b41be73a-8875-4eef-a20e-4926f1b180b9 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] [instance: 8fb76141-70a4-4501-b928-7502a13c3cb4] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:49:45.886827 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-154ff99f-0dbb-4ad8-86fb-46f6aff8e20a tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 5fc359cf-ff2c-4189-b058-31eb3c97568c] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:49:45.894148 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-b41be73a-8875-4eef-a20e-4926f1b180b9 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:45.894644 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-b41be73a-8875-4eef-a20e-4926f1b180b9 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:45.895089 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-b41be73a-8875-4eef-a20e-4926f1b180b9 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:45.895802 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-b41be73a-8875-4eef-a20e-4926f1b180b9 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:45.896307 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-b41be73a-8875-4eef-a20e-4926f1b180b9 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:45.896728 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-b41be73a-8875-4eef-a20e-4926f1b180b9 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:45.907765 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-154ff99f-0dbb-4ad8-86fb-46f6aff8e20a tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:45.909083 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-154ff99f-0dbb-4ad8-86fb-46f6aff8e20a tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:45.910245 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-154ff99f-0dbb-4ad8-86fb-46f6aff8e20a tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:45.911765 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-154ff99f-0dbb-4ad8-86fb-46f6aff8e20a tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:45.912822 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-154ff99f-0dbb-4ad8-86fb-46f6aff8e20a tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:45.913841 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-154ff99f-0dbb-4ad8-86fb-46f6aff8e20a tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:46.155584 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-b41be73a-8875-4eef-a20e-4926f1b180b9 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc29734859a5460faee189b1726b50b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984a02b8dfd446879438d29b5efdd996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:49:46.163751 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-154ff99f-0dbb-4ad8-86fb-46f6aff8e20a tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:49:46.164446 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-b41be73a-8875-4eef-a20e-4926f1b180b9 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] 10.222.0.36 "GET /compute/v2.1/servers/8fb76141-70a4-4501-b928-7502a13c3cb4" status: 200 len: 1315 microversion: 2.1 time: 0.289496 Oct 15 13:49:46.165013 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 67/134] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:49:45 2022] GET /compute/v2.1/servers/8fb76141-70a4-4501-b928-7502a13c3cb4 => generated 1315 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 13:49:46.173850 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-154ff99f-0dbb-4ad8-86fb-46f6aff8e20a tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:49:46.175334 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-154ff99f-0dbb-4ad8-86fb-46f6aff8e20a tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:49:46.176487 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-154ff99f-0dbb-4ad8-86fb-46f6aff8e20a tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c" status: 200 len: 1406 microversion: 2.20 time: 0.308702 Oct 15 13:49:46.177226 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 68/135] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:49:45 2022] GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c => generated 1406 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 13:49:46.181914 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-013f0c8f-0c4c-486a-97e5-3085a1a2c5ab tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:49:46.182530 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-013f0c8f-0c4c-486a-97e5-3085a1a2c5ab tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] [instance: a8976a74-703a-4fa4-9cc7-760a3e3f226b] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:49:46.188107 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [req-77254ba6-d31b-4e40-82fb-e5e6399ba184 req-43775ce3-3a79-400d-8770-2738883c2e9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8fb76141-70a4-4501-b928-7502a13c3cb4", "name": "network-vif-plugged", "status": "completed", "tag": "22d267b5-2636-4dae-87c7-578106faed38"}]} {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 13:49:46.189679 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-013f0c8f-0c4c-486a-97e5-3085a1a2c5ab tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:46.190367 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-013f0c8f-0c4c-486a-97e5-3085a1a2c5ab tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:46.190793 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-013f0c8f-0c4c-486a-97e5-3085a1a2c5ab tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:46.191480 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-013f0c8f-0c4c-486a-97e5-3085a1a2c5ab tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:46.192026 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-013f0c8f-0c4c-486a-97e5-3085a1a2c5ab tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:46.193049 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-013f0c8f-0c4c-486a-97e5-3085a1a2c5ab tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:46.199652 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [req-77254ba6-d31b-4e40-82fb-e5e6399ba184 req-43775ce3-3a79-400d-8770-2738883c2e9c service nova] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:46.200514 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [req-77254ba6-d31b-4e40-82fb-e5e6399ba184 req-43775ce3-3a79-400d-8770-2738883c2e9c service nova] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:46.201023 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [req-77254ba6-d31b-4e40-82fb-e5e6399ba184 req-43775ce3-3a79-400d-8770-2738883c2e9c service nova] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:46.213510 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.compute.server_external_events [req-77254ba6-d31b-4e40-82fb-e5e6399ba184 req-43775ce3-3a79-400d-8770-2738883c2e9c service nova] Creating event network-vif-plugged:22d267b5-2636-4dae-87c7-578106faed38 for instance 8fb76141-70a4-4501-b928-7502a13c3cb4 on hv-cinder-86149 Oct 15 13:49:46.219126 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [req-77254ba6-d31b-4e40-82fb-e5e6399ba184 req-43775ce3-3a79-400d-8770-2738883c2e9c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052910 Oct 15 13:49:46.219754 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 68/136] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 15 13:49:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 13:49:46.340082 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-013f0c8f-0c4c-486a-97e5-3085a1a2c5ab tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5150c06020594efe957359f641eba5da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a0813bae074cd2aa552be82abe8493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:49:46.348749 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-013f0c8f-0c4c-486a-97e5-3085a1a2c5ab tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] 10.222.0.36 "GET /compute/v2.1/servers/a8976a74-703a-4fa4-9cc7-760a3e3f226b" status: 200 len: 1521 microversion: 2.1 time: 0.170278 Oct 15 13:49:46.349434 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 69/137] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:49:46 2022] GET /compute/v2.1/servers/a8976a74-703a-4fa4-9cc7-760a3e3f226b => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:49:46.551634 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-f52963bc-9535-49b6-90f3-54caa88fe009 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:49:46.552337 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-f52963bc-9535-49b6-90f3-54caa88fe009 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] [instance: 40d67d09-379e-4c12-b36c-21edf3b23e45] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:49:46.559358 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-f52963bc-9535-49b6-90f3-54caa88fe009 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:46.559994 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-f52963bc-9535-49b6-90f3-54caa88fe009 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:46.560430 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-f52963bc-9535-49b6-90f3-54caa88fe009 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:46.561335 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-f52963bc-9535-49b6-90f3-54caa88fe009 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:46.561784 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-f52963bc-9535-49b6-90f3-54caa88fe009 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:46.562229 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-f52963bc-9535-49b6-90f3-54caa88fe009 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:46.709301 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-f52963bc-9535-49b6-90f3-54caa88fe009 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583cce1547144e11978f20a3193ceba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f8b5024a194f70a9f7689ac44ab07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:49:46.717849 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-f52963bc-9535-49b6-90f3-54caa88fe009 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] 10.222.0.36 "GET /compute/v2.1/servers/40d67d09-379e-4c12-b36c-21edf3b23e45" status: 200 len: 1363 microversion: 2.1 time: 0.170774 Oct 15 13:49:46.718455 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 69/138] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:49:46 2022] GET /compute/v2.1/servers/40d67d09-379e-4c12-b36c-21edf3b23e45 => generated 1363 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:49:47.188312 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-362cfb13-bc8c-4ac5-851c-e88228ec4914 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:49:47.188978 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-362cfb13-bc8c-4ac5-851c-e88228ec4914 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] [instance: 8fb76141-70a4-4501-b928-7502a13c3cb4] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:49:47.195430 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-362cfb13-bc8c-4ac5-851c-e88228ec4914 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:47.197244 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-362cfb13-bc8c-4ac5-851c-e88228ec4914 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:47.197722 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-362cfb13-bc8c-4ac5-851c-e88228ec4914 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:47.198455 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-362cfb13-bc8c-4ac5-851c-e88228ec4914 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:47.198920 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-362cfb13-bc8c-4ac5-851c-e88228ec4914 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:47.199348 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-362cfb13-bc8c-4ac5-851c-e88228ec4914 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:47.202591 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-bf2abeb8-a99b-4e32-bdf2-db50ad63fa48 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:49:47.203189 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-bf2abeb8-a99b-4e32-bdf2-db50ad63fa48 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 5fc359cf-ff2c-4189-b058-31eb3c97568c] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:49:47.209486 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-bf2abeb8-a99b-4e32-bdf2-db50ad63fa48 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:47.209963 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-bf2abeb8-a99b-4e32-bdf2-db50ad63fa48 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:47.210384 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-bf2abeb8-a99b-4e32-bdf2-db50ad63fa48 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:47.211131 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-bf2abeb8-a99b-4e32-bdf2-db50ad63fa48 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:47.211571 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-bf2abeb8-a99b-4e32-bdf2-db50ad63fa48 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:47.211997 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-bf2abeb8-a99b-4e32-bdf2-db50ad63fa48 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:47.404061 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-bf2abeb8-a99b-4e32-bdf2-db50ad63fa48 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:49:47.407755 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG dbcounter [-] [125243] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:49:47.414210 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-bf2abeb8-a99b-4e32-bdf2-db50ad63fa48 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:49:47.415640 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-bf2abeb8-a99b-4e32-bdf2-db50ad63fa48 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:49:47.416805 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-bf2abeb8-a99b-4e32-bdf2-db50ad63fa48 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c" status: 200 len: 1406 microversion: 2.20 time: 0.218337 Oct 15 13:49:47.417084 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-362cfb13-bc8c-4ac5-851c-e88228ec4914 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc29734859a5460faee189b1726b50b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984a02b8dfd446879438d29b5efdd996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:49:47.417378 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 70/139] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:49:47 2022] GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c => generated 1406 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 13:49:47.422370 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-3975e350-ae4c-4a39-b0f9-907d3c40d7e0 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:49:47.422964 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-3975e350-ae4c-4a39-b0f9-907d3c40d7e0 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] [instance: a8976a74-703a-4fa4-9cc7-760a3e3f226b] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:49:47.428104 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-362cfb13-bc8c-4ac5-851c-e88228ec4914 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] 10.222.0.36 "GET /compute/v2.1/servers/8fb76141-70a4-4501-b928-7502a13c3cb4" status: 200 len: 1315 microversion: 2.1 time: 0.243700 Oct 15 13:49:47.429042 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 70/140] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:49:47 2022] GET /compute/v2.1/servers/8fb76141-70a4-4501-b928-7502a13c3cb4 => generated 1315 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:49:47.436182 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-3975e350-ae4c-4a39-b0f9-907d3c40d7e0 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:47.436182 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-3975e350-ae4c-4a39-b0f9-907d3c40d7e0 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:47.436182 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-3975e350-ae4c-4a39-b0f9-907d3c40d7e0 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:47.436182 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-3975e350-ae4c-4a39-b0f9-907d3c40d7e0 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:47.436773 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-3975e350-ae4c-4a39-b0f9-907d3c40d7e0 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:47.436773 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-3975e350-ae4c-4a39-b0f9-907d3c40d7e0 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:47.577611 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-3975e350-ae4c-4a39-b0f9-907d3c40d7e0 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5150c06020594efe957359f641eba5da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a0813bae074cd2aa552be82abe8493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:49:47.585866 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-3975e350-ae4c-4a39-b0f9-907d3c40d7e0 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] 10.222.0.36 "GET /compute/v2.1/servers/a8976a74-703a-4fa4-9cc7-760a3e3f226b" status: 200 len: 1521 microversion: 2.1 time: 0.167432 Oct 15 13:49:47.586463 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 71/141] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:49:47 2022] GET /compute/v2.1/servers/a8976a74-703a-4fa4-9cc7-760a3e3f226b => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:49:47.742543 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-bd17bdb0-fa5c-473b-9f7c-f0f32c4177ce tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:49:47.743261 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-bd17bdb0-fa5c-473b-9f7c-f0f32c4177ce tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] [instance: 40d67d09-379e-4c12-b36c-21edf3b23e45] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:49:47.749972 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-bd17bdb0-fa5c-473b-9f7c-f0f32c4177ce tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:47.750456 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-bd17bdb0-fa5c-473b-9f7c-f0f32c4177ce tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:47.750886 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-bd17bdb0-fa5c-473b-9f7c-f0f32c4177ce tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:47.751577 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-bd17bdb0-fa5c-473b-9f7c-f0f32c4177ce tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:47.752050 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-bd17bdb0-fa5c-473b-9f7c-f0f32c4177ce tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:47.752465 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-bd17bdb0-fa5c-473b-9f7c-f0f32c4177ce tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:47.909895 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-bd17bdb0-fa5c-473b-9f7c-f0f32c4177ce tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583cce1547144e11978f20a3193ceba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f8b5024a194f70a9f7689ac44ab07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:49:47.919932 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-bd17bdb0-fa5c-473b-9f7c-f0f32c4177ce tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] 10.222.0.36 "GET /compute/v2.1/servers/40d67d09-379e-4c12-b36c-21edf3b23e45" status: 200 len: 1363 microversion: 2.1 time: 0.181422 Oct 15 13:49:47.920621 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 71/142] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:49:47 2022] GET /compute/v2.1/servers/40d67d09-379e-4c12-b36c-21edf3b23e45 => generated 1363 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:49:48.448244 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-8020ff4e-6629-4be4-9961-95955023ac87 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:49:48.449410 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-8020ff4e-6629-4be4-9961-95955023ac87 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 5fc359cf-ff2c-4189-b058-31eb3c97568c] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:49:48.452539 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-ad1092eb-ef47-4cdb-9cf3-7e30cc8b7c80 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:49:48.453157 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-ad1092eb-ef47-4cdb-9cf3-7e30cc8b7c80 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] [instance: 8fb76141-70a4-4501-b928-7502a13c3cb4] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:49:48.459728 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-ad1092eb-ef47-4cdb-9cf3-7e30cc8b7c80 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:48.460025 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-8020ff4e-6629-4be4-9961-95955023ac87 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:48.460253 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-ad1092eb-ef47-4cdb-9cf3-7e30cc8b7c80 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:48.460675 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-ad1092eb-ef47-4cdb-9cf3-7e30cc8b7c80 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:48.460824 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-8020ff4e-6629-4be4-9961-95955023ac87 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:48.461419 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-8020ff4e-6629-4be4-9961-95955023ac87 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:48.461867 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-ad1092eb-ef47-4cdb-9cf3-7e30cc8b7c80 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:48.462321 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-ad1092eb-ef47-4cdb-9cf3-7e30cc8b7c80 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:48.462543 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-8020ff4e-6629-4be4-9961-95955023ac87 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:48.462713 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-ad1092eb-ef47-4cdb-9cf3-7e30cc8b7c80 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:48.463296 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-8020ff4e-6629-4be4-9961-95955023ac87 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:48.464025 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-8020ff4e-6629-4be4-9961-95955023ac87 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:48.748053 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-ad1092eb-ef47-4cdb-9cf3-7e30cc8b7c80 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc29734859a5460faee189b1726b50b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984a02b8dfd446879438d29b5efdd996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:49:48.758780 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-ad1092eb-ef47-4cdb-9cf3-7e30cc8b7c80 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] 10.222.0.36 "GET /compute/v2.1/servers/8fb76141-70a4-4501-b928-7502a13c3cb4" status: 200 len: 1315 microversion: 2.1 time: 0.310955 Oct 15 13:49:48.759978 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 72/143] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:49:48 2022] GET /compute/v2.1/servers/8fb76141-70a4-4501-b928-7502a13c3cb4 => generated 1315 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 13:49:48.773476 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-8020ff4e-6629-4be4-9961-95955023ac87 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:49:48.774938 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-170988d2-b4a6-44a5-81f2-d3010dd75084 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:49:48.776332 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-170988d2-b4a6-44a5-81f2-d3010dd75084 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] [instance: a8976a74-703a-4fa4-9cc7-760a3e3f226b] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:49:48.783053 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-8020ff4e-6629-4be4-9961-95955023ac87 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:49:48.785064 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-8020ff4e-6629-4be4-9961-95955023ac87 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:49:48.786261 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-8020ff4e-6629-4be4-9961-95955023ac87 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c" status: 200 len: 1406 microversion: 2.20 time: 0.345169 Oct 15 13:49:48.787008 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 72/144] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:49:48 2022] GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c => generated 1406 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 13:49:48.790999 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-170988d2-b4a6-44a5-81f2-d3010dd75084 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:48.791524 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-170988d2-b4a6-44a5-81f2-d3010dd75084 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:48.792001 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-170988d2-b4a6-44a5-81f2-d3010dd75084 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:48.792731 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-170988d2-b4a6-44a5-81f2-d3010dd75084 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:48.793374 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-170988d2-b4a6-44a5-81f2-d3010dd75084 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:48.793809 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-170988d2-b4a6-44a5-81f2-d3010dd75084 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:48.947625 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-c8f17330-931c-4b44-ab8c-57d781358e4f tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:49:48.949088 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-c8f17330-931c-4b44-ab8c-57d781358e4f tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] [instance: 40d67d09-379e-4c12-b36c-21edf3b23e45] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:49:48.953756 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-170988d2-b4a6-44a5-81f2-d3010dd75084 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5150c06020594efe957359f641eba5da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a0813bae074cd2aa552be82abe8493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:49:48.958513 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-c8f17330-931c-4b44-ab8c-57d781358e4f tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:48.959166 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-c8f17330-931c-4b44-ab8c-57d781358e4f tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:48.960395 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-c8f17330-931c-4b44-ab8c-57d781358e4f tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:48.961283 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-c8f17330-931c-4b44-ab8c-57d781358e4f tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:48.961849 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-c8f17330-931c-4b44-ab8c-57d781358e4f tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:48.962615 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-c8f17330-931c-4b44-ab8c-57d781358e4f tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:48.962837 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-170988d2-b4a6-44a5-81f2-d3010dd75084 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] 10.222.0.36 "GET /compute/v2.1/servers/a8976a74-703a-4fa4-9cc7-760a3e3f226b" status: 200 len: 1521 microversion: 2.1 time: 0.199738 Oct 15 13:49:48.963451 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 73/145] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:49:48 2022] GET /compute/v2.1/servers/a8976a74-703a-4fa4-9cc7-760a3e3f226b => generated 1521 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:49:49.151273 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-c8f17330-931c-4b44-ab8c-57d781358e4f tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583cce1547144e11978f20a3193ceba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f8b5024a194f70a9f7689ac44ab07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:49:49.166411 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-c8f17330-931c-4b44-ab8c-57d781358e4f tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] 10.222.0.36 "GET /compute/v2.1/servers/40d67d09-379e-4c12-b36c-21edf3b23e45" status: 200 len: 1363 microversion: 2.1 time: 0.224547 Oct 15 13:49:49.168025 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 73/146] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:49:48 2022] GET /compute/v2.1/servers/40d67d09-379e-4c12-b36c-21edf3b23e45 => generated 1363 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:49:49.803615 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-4544b62d-4ee6-4d57-b238-063a8ec7b524 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:49:49.819371 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-fdf58926-b358-49d5-98db-6c1e1e0d9bdb tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:49:49.820466 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-fdf58926-b358-49d5-98db-6c1e1e0d9bdb tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 5fc359cf-ff2c-4189-b058-31eb3c97568c] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:49:49.824458 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-4544b62d-4ee6-4d57-b238-063a8ec7b524 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] [instance: 8fb76141-70a4-4501-b928-7502a13c3cb4] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:49:49.843554 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-4544b62d-4ee6-4d57-b238-063a8ec7b524 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:49.846302 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-4544b62d-4ee6-4d57-b238-063a8ec7b524 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:49.847008 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-4544b62d-4ee6-4d57-b238-063a8ec7b524 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:49.847548 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-fdf58926-b358-49d5-98db-6c1e1e0d9bdb tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:49.848867 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-4544b62d-4ee6-4d57-b238-063a8ec7b524 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:49.849301 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-fdf58926-b358-49d5-98db-6c1e1e0d9bdb tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:49.849916 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-fdf58926-b358-49d5-98db-6c1e1e0d9bdb tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:49.850325 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-4544b62d-4ee6-4d57-b238-063a8ec7b524 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:49.850830 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-fdf58926-b358-49d5-98db-6c1e1e0d9bdb tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:49.851289 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-fdf58926-b358-49d5-98db-6c1e1e0d9bdb tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:49.851705 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-fdf58926-b358-49d5-98db-6c1e1e0d9bdb tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:49.852294 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-4544b62d-4ee6-4d57-b238-063a8ec7b524 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:50.116480 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-fdf58926-b358-49d5-98db-6c1e1e0d9bdb tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:49:50.127465 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-fdf58926-b358-49d5-98db-6c1e1e0d9bdb tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:49:50.128994 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-fdf58926-b358-49d5-98db-6c1e1e0d9bdb tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:49:50.129901 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-4544b62d-4ee6-4d57-b238-063a8ec7b524 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc29734859a5460faee189b1726b50b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984a02b8dfd446879438d29b5efdd996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:49:50.130174 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-fdf58926-b358-49d5-98db-6c1e1e0d9bdb tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c" status: 200 len: 1406 microversion: 2.20 time: 0.321375 Oct 15 13:49:50.130756 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 74/147] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:49:49 2022] GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c => generated 1406 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 13:49:50.146863 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-be382306-9642-4412-a45e-ce85d9ff2215 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:49:50.147602 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-4544b62d-4ee6-4d57-b238-063a8ec7b524 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] 10.222.0.36 "GET /compute/v2.1/servers/8fb76141-70a4-4501-b928-7502a13c3cb4" status: 200 len: 1315 microversion: 2.1 time: 0.351150 Oct 15 13:49:50.150262 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 74/148] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:49:49 2022] GET /compute/v2.1/servers/8fb76141-70a4-4501-b928-7502a13c3cb4 => generated 1315 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:49:50.153208 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-be382306-9642-4412-a45e-ce85d9ff2215 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] [instance: a8976a74-703a-4fa4-9cc7-760a3e3f226b] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:49:50.166681 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-be382306-9642-4412-a45e-ce85d9ff2215 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:50.167834 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-be382306-9642-4412-a45e-ce85d9ff2215 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:50.175035 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-be382306-9642-4412-a45e-ce85d9ff2215 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:50.175035 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-be382306-9642-4412-a45e-ce85d9ff2215 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:50.175035 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-be382306-9642-4412-a45e-ce85d9ff2215 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:50.176266 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-be382306-9642-4412-a45e-ce85d9ff2215 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:50.206880 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-7f6e2fb5-2386-46a2-af6c-a7ce9151c9e8 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:49:50.208227 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-7f6e2fb5-2386-46a2-af6c-a7ce9151c9e8 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] [instance: 40d67d09-379e-4c12-b36c-21edf3b23e45] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:49:50.214756 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-7f6e2fb5-2386-46a2-af6c-a7ce9151c9e8 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:50.215301 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-7f6e2fb5-2386-46a2-af6c-a7ce9151c9e8 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:50.215732 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-7f6e2fb5-2386-46a2-af6c-a7ce9151c9e8 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:50.216692 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-7f6e2fb5-2386-46a2-af6c-a7ce9151c9e8 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:50.217303 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-7f6e2fb5-2386-46a2-af6c-a7ce9151c9e8 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:50.218050 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-7f6e2fb5-2386-46a2-af6c-a7ce9151c9e8 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:50.422702 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-be382306-9642-4412-a45e-ce85d9ff2215 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5150c06020594efe957359f641eba5da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a0813bae074cd2aa552be82abe8493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:49:50.435386 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-be382306-9642-4412-a45e-ce85d9ff2215 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] 10.222.0.36 "GET /compute/v2.1/servers/a8976a74-703a-4fa4-9cc7-760a3e3f226b" status: 200 len: 1521 microversion: 2.1 time: 0.291878 Oct 15 13:49:50.437054 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 75/149] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:49:50 2022] GET /compute/v2.1/servers/a8976a74-703a-4fa4-9cc7-760a3e3f226b => generated 1521 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:49:50.452784 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-7f6e2fb5-2386-46a2-af6c-a7ce9151c9e8 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583cce1547144e11978f20a3193ceba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f8b5024a194f70a9f7689ac44ab07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:49:50.462251 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-7f6e2fb5-2386-46a2-af6c-a7ce9151c9e8 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] 10.222.0.36 "GET /compute/v2.1/servers/40d67d09-379e-4c12-b36c-21edf3b23e45" status: 200 len: 1550 microversion: 2.1 time: 0.259315 Oct 15 13:49:50.462931 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 75/150] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:49:50 2022] GET /compute/v2.1/servers/40d67d09-379e-4c12-b36c-21edf3b23e45 => generated 1550 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 13:49:50.487772 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-9d83c248-c53e-4e54-af8f-da0e41b8fbde tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:49:50.488346 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-9d83c248-c53e-4e54-af8f-da0e41b8fbde tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] [instance: 40d67d09-379e-4c12-b36c-21edf3b23e45] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:49:50.494693 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-9d83c248-c53e-4e54-af8f-da0e41b8fbde tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:50.495196 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-9d83c248-c53e-4e54-af8f-da0e41b8fbde tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:50.495625 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-9d83c248-c53e-4e54-af8f-da0e41b8fbde tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:50.496376 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-9d83c248-c53e-4e54-af8f-da0e41b8fbde tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:50.496828 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-9d83c248-c53e-4e54-af8f-da0e41b8fbde tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:50.497358 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-9d83c248-c53e-4e54-af8f-da0e41b8fbde tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:50.589820 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-9d83c248-c53e-4e54-af8f-da0e41b8fbde tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] 10.222.0.36 "GET /compute/v2.1/servers/40d67d09-379e-4c12-b36c-21edf3b23e45/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.104000 Oct 15 13:49:50.589820 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 76/151] 10.222.0.36 () {58 vars in 1275 bytes} [Sat Oct 15 13:49:50 2022] GET /compute/v2.1/servers/40d67d09-379e-4c12-b36c-21edf3b23e45/os-interface => generated 285 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 15 13:49:51.161086 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-52f329fd-2905-43d6-b7dd-ba7d30be2a21 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:49:51.161764 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-52f329fd-2905-43d6-b7dd-ba7d30be2a21 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 5fc359cf-ff2c-4189-b058-31eb3c97568c] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:49:51.173268 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-52f329fd-2905-43d6-b7dd-ba7d30be2a21 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:51.174498 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-52f329fd-2905-43d6-b7dd-ba7d30be2a21 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:51.175619 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-52f329fd-2905-43d6-b7dd-ba7d30be2a21 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:51.177192 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-52f329fd-2905-43d6-b7dd-ba7d30be2a21 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:51.178330 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-52f329fd-2905-43d6-b7dd-ba7d30be2a21 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:51.179280 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-52f329fd-2905-43d6-b7dd-ba7d30be2a21 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:51.180823 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-b365dddc-7c19-4da0-84c3-6fc5e3d97091 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:49:51.181776 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-b365dddc-7c19-4da0-84c3-6fc5e3d97091 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] [instance: 8fb76141-70a4-4501-b928-7502a13c3cb4] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:49:51.191694 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-b365dddc-7c19-4da0-84c3-6fc5e3d97091 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:51.192247 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-b365dddc-7c19-4da0-84c3-6fc5e3d97091 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:51.192837 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-b365dddc-7c19-4da0-84c3-6fc5e3d97091 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:51.193589 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-b365dddc-7c19-4da0-84c3-6fc5e3d97091 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:51.195035 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-b365dddc-7c19-4da0-84c3-6fc5e3d97091 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:51.195344 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-b365dddc-7c19-4da0-84c3-6fc5e3d97091 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:51.700087 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-b365dddc-7c19-4da0-84c3-6fc5e3d97091 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc29734859a5460faee189b1726b50b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984a02b8dfd446879438d29b5efdd996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:49:51.725950 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-b365dddc-7c19-4da0-84c3-6fc5e3d97091 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] 10.222.0.36 "GET /compute/v2.1/servers/8fb76141-70a4-4501-b928-7502a13c3cb4" status: 200 len: 1315 microversion: 2.1 time: 0.553522 Oct 15 13:49:51.729396 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 77/152] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:49:51 2022] GET /compute/v2.1/servers/8fb76141-70a4-4501-b928-7502a13c3cb4 => generated 1315 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:49:51.756451 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-cc3708cd-deaa-4302-bd88-780972d25f4b tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:49:51.759339 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-cc3708cd-deaa-4302-bd88-780972d25f4b tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] [instance: a8976a74-703a-4fa4-9cc7-760a3e3f226b] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:49:51.770888 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-cc3708cd-deaa-4302-bd88-780972d25f4b tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:51.772028 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-cc3708cd-deaa-4302-bd88-780972d25f4b tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:51.773022 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-cc3708cd-deaa-4302-bd88-780972d25f4b tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:51.774564 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-cc3708cd-deaa-4302-bd88-780972d25f4b tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:51.775651 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-cc3708cd-deaa-4302-bd88-780972d25f4b tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:51.776530 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-cc3708cd-deaa-4302-bd88-780972d25f4b tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:51.792595 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-52f329fd-2905-43d6-b7dd-ba7d30be2a21 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:49:51.815040 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-52f329fd-2905-43d6-b7dd-ba7d30be2a21 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:49:51.822510 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-52f329fd-2905-43d6-b7dd-ba7d30be2a21 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:49:51.825366 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-52f329fd-2905-43d6-b7dd-ba7d30be2a21 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c" status: 200 len: 1406 microversion: 2.20 time: 0.671690 Oct 15 13:49:51.827439 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 76/153] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:49:51 2022] GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c => generated 1406 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 13:49:52.434963 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-cc3708cd-deaa-4302-bd88-780972d25f4b tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5150c06020594efe957359f641eba5da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a0813bae074cd2aa552be82abe8493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:49:52.448324 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-cc3708cd-deaa-4302-bd88-780972d25f4b tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] 10.222.0.36 "GET /compute/v2.1/servers/a8976a74-703a-4fa4-9cc7-760a3e3f226b" status: 200 len: 1521 microversion: 2.1 time: 0.716920 Oct 15 13:49:52.449304 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 78/154] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:49:51 2022] GET /compute/v2.1/servers/a8976a74-703a-4fa4-9cc7-760a3e3f226b => generated 1521 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:49:52.767286 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-f95d8b24-c987-46a2-baa1-e31b92653216 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:49:52.768323 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-f95d8b24-c987-46a2-baa1-e31b92653216 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] [instance: 8fb76141-70a4-4501-b928-7502a13c3cb4] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:49:52.779215 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-f95d8b24-c987-46a2-baa1-e31b92653216 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:52.780185 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-f95d8b24-c987-46a2-baa1-e31b92653216 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:52.780938 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-f95d8b24-c987-46a2-baa1-e31b92653216 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:52.782170 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-f95d8b24-c987-46a2-baa1-e31b92653216 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:52.783008 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-f95d8b24-c987-46a2-baa1-e31b92653216 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:52.783763 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-f95d8b24-c987-46a2-baa1-e31b92653216 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:52.792144 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG dbcounter [-] [125242] Writing DB stats nova_cell1:SELECT=100 {{(pid=125242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:49:52.856430 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-6547ad6b-c03d-407e-8644-9d3d5d001702 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:49:52.857207 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-6547ad6b-c03d-407e-8644-9d3d5d001702 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 5fc359cf-ff2c-4189-b058-31eb3c97568c] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:49:52.859415 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG dbcounter [-] [125243] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=125243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:49:52.870392 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-6547ad6b-c03d-407e-8644-9d3d5d001702 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:52.871649 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-6547ad6b-c03d-407e-8644-9d3d5d001702 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:52.872380 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-6547ad6b-c03d-407e-8644-9d3d5d001702 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:52.873583 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-6547ad6b-c03d-407e-8644-9d3d5d001702 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:52.874539 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-6547ad6b-c03d-407e-8644-9d3d5d001702 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:52.875072 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-6547ad6b-c03d-407e-8644-9d3d5d001702 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:53.148437 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-f95d8b24-c987-46a2-baa1-e31b92653216 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc29734859a5460faee189b1726b50b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984a02b8dfd446879438d29b5efdd996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:49:53.159692 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-f95d8b24-c987-46a2-baa1-e31b92653216 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] 10.222.0.36 "GET /compute/v2.1/servers/8fb76141-70a4-4501-b928-7502a13c3cb4" status: 200 len: 1315 microversion: 2.1 time: 0.396669 Oct 15 13:49:53.161346 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 77/155] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:49:52 2022] GET /compute/v2.1/servers/8fb76141-70a4-4501-b928-7502a13c3cb4 => generated 1315 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:49:53.170490 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [req-ced3573c-bdd9-4b21-bee8-9bf3987748e9 req-9b71ec6f-5792-4499-b78f-499f66c8bc8d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40d67d09-379e-4c12-b36c-21edf3b23e45", "tag": "00b42a41-b63e-414a-944b-f58697650617"}]} {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 13:49:53.187193 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG dbcounter [-] [125242] Writing DB stats nova_api:SELECT=82 {{(pid=125242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:49:53.191195 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [req-ced3573c-bdd9-4b21-bee8-9bf3987748e9 req-9b71ec6f-5792-4499-b78f-499f66c8bc8d service nova] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:53.192328 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [req-ced3573c-bdd9-4b21-bee8-9bf3987748e9 req-9b71ec6f-5792-4499-b78f-499f66c8bc8d service nova] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:53.193365 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [req-ced3573c-bdd9-4b21-bee8-9bf3987748e9 req-9b71ec6f-5792-4499-b78f-499f66c8bc8d service nova] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:53.208084 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-6547ad6b-c03d-407e-8644-9d3d5d001702 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:49:53.224092 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.compute.server_external_events [req-ced3573c-bdd9-4b21-bee8-9bf3987748e9 req-9b71ec6f-5792-4499-b78f-499f66c8bc8d service nova] Creating event network-changed:00b42a41-b63e-414a-944b-f58697650617 for instance 40d67d09-379e-4c12-b36c-21edf3b23e45 on hv-cinder-86149 Oct 15 13:49:53.230008 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-6547ad6b-c03d-407e-8644-9d3d5d001702 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:49:53.231816 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-6547ad6b-c03d-407e-8644-9d3d5d001702 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:49:53.233027 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-6547ad6b-c03d-407e-8644-9d3d5d001702 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c" status: 200 len: 1406 microversion: 2.20 time: 0.384014 Oct 15 13:49:53.240854 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 79/156] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:49:52 2022] GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c => generated 1406 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 15 13:49:53.250471 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [req-ced3573c-bdd9-4b21-bee8-9bf3987748e9 req-9b71ec6f-5792-4499-b78f-499f66c8bc8d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085831 Oct 15 13:49:53.252525 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 78/157] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 15 13:49:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 13:49:53.476721 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-c5bf0bda-9a09-4cfb-9185-994935b2e9af tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:49:53.477954 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-c5bf0bda-9a09-4cfb-9185-994935b2e9af tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] [instance: a8976a74-703a-4fa4-9cc7-760a3e3f226b] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:49:53.485499 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-c5bf0bda-9a09-4cfb-9185-994935b2e9af tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:53.486011 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-c5bf0bda-9a09-4cfb-9185-994935b2e9af tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:53.486492 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-c5bf0bda-9a09-4cfb-9185-994935b2e9af tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:53.487239 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-c5bf0bda-9a09-4cfb-9185-994935b2e9af tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:53.487706 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-c5bf0bda-9a09-4cfb-9185-994935b2e9af tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:53.488202 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-c5bf0bda-9a09-4cfb-9185-994935b2e9af tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:53.653865 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-c5bf0bda-9a09-4cfb-9185-994935b2e9af tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5150c06020594efe957359f641eba5da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a0813bae074cd2aa552be82abe8493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:49:53.662250 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-c5bf0bda-9a09-4cfb-9185-994935b2e9af tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] 10.222.0.36 "GET /compute/v2.1/servers/a8976a74-703a-4fa4-9cc7-760a3e3f226b" status: 200 len: 1521 microversion: 2.1 time: 0.189545 Oct 15 13:49:53.662832 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 80/158] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:49:53 2022] GET /compute/v2.1/servers/a8976a74-703a-4fa4-9cc7-760a3e3f226b => generated 1521 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:49:54.205937 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-7f7cf1e3-d81c-4b08-bbc9-db33711e3456 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:49:54.206812 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-7f7cf1e3-d81c-4b08-bbc9-db33711e3456 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] [instance: 8fb76141-70a4-4501-b928-7502a13c3cb4] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:49:54.217303 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-7f7cf1e3-d81c-4b08-bbc9-db33711e3456 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:54.217792 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-7f7cf1e3-d81c-4b08-bbc9-db33711e3456 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:54.218235 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-7f7cf1e3-d81c-4b08-bbc9-db33711e3456 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:54.218949 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-7f7cf1e3-d81c-4b08-bbc9-db33711e3456 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:54.219426 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-7f7cf1e3-d81c-4b08-bbc9-db33711e3456 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:54.220075 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-7f7cf1e3-d81c-4b08-bbc9-db33711e3456 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:54.277684 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-44d1435b-5365-4470-8d9a-39e392e5d908 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:49:54.278642 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-44d1435b-5365-4470-8d9a-39e392e5d908 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 5fc359cf-ff2c-4189-b058-31eb3c97568c] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:49:54.285806 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-44d1435b-5365-4470-8d9a-39e392e5d908 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:54.286336 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-44d1435b-5365-4470-8d9a-39e392e5d908 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:54.286772 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-44d1435b-5365-4470-8d9a-39e392e5d908 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:54.287499 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-44d1435b-5365-4470-8d9a-39e392e5d908 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:54.288015 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-44d1435b-5365-4470-8d9a-39e392e5d908 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:54.288446 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-44d1435b-5365-4470-8d9a-39e392e5d908 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:54.459220 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-7f7cf1e3-d81c-4b08-bbc9-db33711e3456 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc29734859a5460faee189b1726b50b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984a02b8dfd446879438d29b5efdd996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:49:54.467623 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-7f7cf1e3-d81c-4b08-bbc9-db33711e3456 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] 10.222.0.36 "GET /compute/v2.1/servers/8fb76141-70a4-4501-b928-7502a13c3cb4" status: 200 len: 1315 microversion: 2.1 time: 0.266356 Oct 15 13:49:54.468500 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 79/159] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:49:54 2022] GET /compute/v2.1/servers/8fb76141-70a4-4501-b928-7502a13c3cb4 => generated 1315 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:49:54.539575 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-44d1435b-5365-4470-8d9a-39e392e5d908 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:49:54.549960 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-44d1435b-5365-4470-8d9a-39e392e5d908 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:49:54.551462 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-44d1435b-5365-4470-8d9a-39e392e5d908 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:49:54.552921 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-44d1435b-5365-4470-8d9a-39e392e5d908 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c" status: 200 len: 1406 microversion: 2.20 time: 0.279240 Oct 15 13:49:54.553900 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 81/160] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:49:54 2022] GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c => generated 1406 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 13:49:54.687710 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-8c50e1ec-4c5a-4e61-9576-a5f56fd0eb70 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:49:54.688225 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-8c50e1ec-4c5a-4e61-9576-a5f56fd0eb70 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] [instance: a8976a74-703a-4fa4-9cc7-760a3e3f226b] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:49:54.696083 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-8c50e1ec-4c5a-4e61-9576-a5f56fd0eb70 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:54.696645 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-8c50e1ec-4c5a-4e61-9576-a5f56fd0eb70 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:54.697157 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-8c50e1ec-4c5a-4e61-9576-a5f56fd0eb70 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:54.697904 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-8c50e1ec-4c5a-4e61-9576-a5f56fd0eb70 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:54.698357 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-8c50e1ec-4c5a-4e61-9576-a5f56fd0eb70 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:54.698781 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-8c50e1ec-4c5a-4e61-9576-a5f56fd0eb70 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:54.938040 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-8c50e1ec-4c5a-4e61-9576-a5f56fd0eb70 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5150c06020594efe957359f641eba5da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a0813bae074cd2aa552be82abe8493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:49:54.948461 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-8c50e1ec-4c5a-4e61-9576-a5f56fd0eb70 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] 10.222.0.36 "GET /compute/v2.1/servers/a8976a74-703a-4fa4-9cc7-760a3e3f226b" status: 200 len: 1521 microversion: 2.1 time: 0.265170 Oct 15 13:49:54.948461 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 80/161] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:49:54 2022] GET /compute/v2.1/servers/a8976a74-703a-4fa4-9cc7-760a3e3f226b => generated 1521 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:49:55.492210 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-f4e18a8f-19aa-4891-b012-75c875556a4a tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:49:55.492726 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-f4e18a8f-19aa-4891-b012-75c875556a4a tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] [instance: 8fb76141-70a4-4501-b928-7502a13c3cb4] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:49:55.499299 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-f4e18a8f-19aa-4891-b012-75c875556a4a tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:55.499783 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-f4e18a8f-19aa-4891-b012-75c875556a4a tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:55.500363 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-f4e18a8f-19aa-4891-b012-75c875556a4a tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:55.501083 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-f4e18a8f-19aa-4891-b012-75c875556a4a tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:55.501605 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-f4e18a8f-19aa-4891-b012-75c875556a4a tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:55.502027 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-f4e18a8f-19aa-4891-b012-75c875556a4a tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:55.586958 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-486ab92a-6f5f-4063-bddf-87bd5ef3ae34 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:49:55.588342 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-486ab92a-6f5f-4063-bddf-87bd5ef3ae34 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 5fc359cf-ff2c-4189-b058-31eb3c97568c] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:49:55.599146 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-486ab92a-6f5f-4063-bddf-87bd5ef3ae34 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:55.600097 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-486ab92a-6f5f-4063-bddf-87bd5ef3ae34 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:55.600879 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-486ab92a-6f5f-4063-bddf-87bd5ef3ae34 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:55.602197 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-486ab92a-6f5f-4063-bddf-87bd5ef3ae34 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:55.603401 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-486ab92a-6f5f-4063-bddf-87bd5ef3ae34 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:55.604639 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-486ab92a-6f5f-4063-bddf-87bd5ef3ae34 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:55.718902 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-f4e18a8f-19aa-4891-b012-75c875556a4a tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc29734859a5460faee189b1726b50b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984a02b8dfd446879438d29b5efdd996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:49:55.727163 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-f4e18a8f-19aa-4891-b012-75c875556a4a tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] 10.222.0.36 "GET /compute/v2.1/servers/8fb76141-70a4-4501-b928-7502a13c3cb4" status: 200 len: 1315 microversion: 2.1 time: 0.239378 Oct 15 13:49:55.728132 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 82/162] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:49:55 2022] GET /compute/v2.1/servers/8fb76141-70a4-4501-b928-7502a13c3cb4 => generated 1315 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:49:55.767754 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-486ab92a-6f5f-4063-bddf-87bd5ef3ae34 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:49:55.779576 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-486ab92a-6f5f-4063-bddf-87bd5ef3ae34 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:49:55.780915 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-486ab92a-6f5f-4063-bddf-87bd5ef3ae34 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:49:55.782068 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-486ab92a-6f5f-4063-bddf-87bd5ef3ae34 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c" status: 200 len: 1406 microversion: 2.20 time: 0.202656 Oct 15 13:49:55.782683 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 81/163] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:49:55 2022] GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c => generated 1406 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 13:49:55.972298 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-175df8a1-bab1-4e71-afee-5a3f166d8dc2 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:49:55.972916 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-175df8a1-bab1-4e71-afee-5a3f166d8dc2 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] [instance: a8976a74-703a-4fa4-9cc7-760a3e3f226b] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:49:55.980616 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-175df8a1-bab1-4e71-afee-5a3f166d8dc2 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:55.981505 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-175df8a1-bab1-4e71-afee-5a3f166d8dc2 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:55.982559 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-175df8a1-bab1-4e71-afee-5a3f166d8dc2 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:55.982938 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-175df8a1-bab1-4e71-afee-5a3f166d8dc2 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:55.983481 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-175df8a1-bab1-4e71-afee-5a3f166d8dc2 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:55.984009 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-175df8a1-bab1-4e71-afee-5a3f166d8dc2 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:56.353897 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-175df8a1-bab1-4e71-afee-5a3f166d8dc2 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5150c06020594efe957359f641eba5da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a0813bae074cd2aa552be82abe8493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:49:56.362496 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-175df8a1-bab1-4e71-afee-5a3f166d8dc2 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] 10.222.0.36 "GET /compute/v2.1/servers/a8976a74-703a-4fa4-9cc7-760a3e3f226b" status: 200 len: 1521 microversion: 2.1 time: 0.394247 Oct 15 13:49:56.363235 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 83/164] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:49:55 2022] GET /compute/v2.1/servers/a8976a74-703a-4fa4-9cc7-760a3e3f226b => generated 1521 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:49:56.752232 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-398dc5e4-e3b5-4605-89a5-b2af4ccef345 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:49:56.753096 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-398dc5e4-e3b5-4605-89a5-b2af4ccef345 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] [instance: 8fb76141-70a4-4501-b928-7502a13c3cb4] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:49:56.759060 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-398dc5e4-e3b5-4605-89a5-b2af4ccef345 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:56.759551 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-398dc5e4-e3b5-4605-89a5-b2af4ccef345 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:56.760010 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-398dc5e4-e3b5-4605-89a5-b2af4ccef345 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:56.760699 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-398dc5e4-e3b5-4605-89a5-b2af4ccef345 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:56.761331 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-398dc5e4-e3b5-4605-89a5-b2af4ccef345 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:56.761752 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-398dc5e4-e3b5-4605-89a5-b2af4ccef345 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:56.808171 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-ceec19bc-a9fd-4603-8c8e-3379b242d33b tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:49:56.808881 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-ceec19bc-a9fd-4603-8c8e-3379b242d33b tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 5fc359cf-ff2c-4189-b058-31eb3c97568c] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:49:56.816213 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-ceec19bc-a9fd-4603-8c8e-3379b242d33b tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:56.816751 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-ceec19bc-a9fd-4603-8c8e-3379b242d33b tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:56.817190 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-ceec19bc-a9fd-4603-8c8e-3379b242d33b tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:56.817899 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-ceec19bc-a9fd-4603-8c8e-3379b242d33b tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:56.818355 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-ceec19bc-a9fd-4603-8c8e-3379b242d33b tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:56.818802 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-ceec19bc-a9fd-4603-8c8e-3379b242d33b tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:56.956147 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-398dc5e4-e3b5-4605-89a5-b2af4ccef345 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc29734859a5460faee189b1726b50b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984a02b8dfd446879438d29b5efdd996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:49:56.966107 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-398dc5e4-e3b5-4605-89a5-b2af4ccef345 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] 10.222.0.36 "GET /compute/v2.1/servers/8fb76141-70a4-4501-b928-7502a13c3cb4" status: 200 len: 1315 microversion: 2.1 time: 0.217506 Oct 15 13:49:56.980534 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 82/165] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:49:56 2022] GET /compute/v2.1/servers/8fb76141-70a4-4501-b928-7502a13c3cb4 => generated 1315 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:49:57.116510 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-ceec19bc-a9fd-4603-8c8e-3379b242d33b tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:49:57.125778 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-ceec19bc-a9fd-4603-8c8e-3379b242d33b tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:49:57.127174 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-ceec19bc-a9fd-4603-8c8e-3379b242d33b tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:49:57.128496 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-ceec19bc-a9fd-4603-8c8e-3379b242d33b tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c" status: 200 len: 1406 microversion: 2.20 time: 0.324491 Oct 15 13:49:57.129295 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 84/166] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:49:56 2022] GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c => generated 1406 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 13:49:57.389785 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-cf7ddf4b-6437-4b27-b8d3-d35943a55853 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:49:57.390733 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-cf7ddf4b-6437-4b27-b8d3-d35943a55853 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] [instance: a8976a74-703a-4fa4-9cc7-760a3e3f226b] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:49:57.398463 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-cf7ddf4b-6437-4b27-b8d3-d35943a55853 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:57.399213 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-cf7ddf4b-6437-4b27-b8d3-d35943a55853 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:57.399812 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-cf7ddf4b-6437-4b27-b8d3-d35943a55853 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:57.400845 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-cf7ddf4b-6437-4b27-b8d3-d35943a55853 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:57.401420 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-cf7ddf4b-6437-4b27-b8d3-d35943a55853 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:57.401838 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-cf7ddf4b-6437-4b27-b8d3-d35943a55853 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:57.596613 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-cf7ddf4b-6437-4b27-b8d3-d35943a55853 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5150c06020594efe957359f641eba5da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a0813bae074cd2aa552be82abe8493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:49:57.611619 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-cf7ddf4b-6437-4b27-b8d3-d35943a55853 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] 10.222.0.36 "GET /compute/v2.1/servers/a8976a74-703a-4fa4-9cc7-760a3e3f226b" status: 200 len: 1521 microversion: 2.1 time: 0.226063 Oct 15 13:49:57.616912 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 83/167] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:49:57 2022] GET /compute/v2.1/servers/a8976a74-703a-4fa4-9cc7-760a3e3f226b => generated 1521 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:49:57.990927 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-d157c657-8f8f-483b-92bd-145cb3075117 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:49:57.992162 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-d157c657-8f8f-483b-92bd-145cb3075117 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] [instance: 8fb76141-70a4-4501-b928-7502a13c3cb4] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:49:58.000333 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-d157c657-8f8f-483b-92bd-145cb3075117 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:58.000994 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-d157c657-8f8f-483b-92bd-145cb3075117 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:58.001573 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-d157c657-8f8f-483b-92bd-145cb3075117 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:58.002511 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-d157c657-8f8f-483b-92bd-145cb3075117 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:58.003114 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-d157c657-8f8f-483b-92bd-145cb3075117 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:58.003676 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-d157c657-8f8f-483b-92bd-145cb3075117 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:58.159599 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-4e7f0871-5c1c-4736-a544-ad091e3924a7 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:49:58.160425 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-4e7f0871-5c1c-4736-a544-ad091e3924a7 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 5fc359cf-ff2c-4189-b058-31eb3c97568c] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:49:58.172086 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-4e7f0871-5c1c-4736-a544-ad091e3924a7 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:58.172922 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-4e7f0871-5c1c-4736-a544-ad091e3924a7 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:58.173782 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-4e7f0871-5c1c-4736-a544-ad091e3924a7 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:58.175118 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-4e7f0871-5c1c-4736-a544-ad091e3924a7 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:58.177451 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-4e7f0871-5c1c-4736-a544-ad091e3924a7 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:58.178462 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-4e7f0871-5c1c-4736-a544-ad091e3924a7 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:58.211758 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-d157c657-8f8f-483b-92bd-145cb3075117 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc29734859a5460faee189b1726b50b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984a02b8dfd446879438d29b5efdd996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:49:58.229507 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-d157c657-8f8f-483b-92bd-145cb3075117 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] 10.222.0.36 "GET /compute/v2.1/servers/8fb76141-70a4-4501-b928-7502a13c3cb4" status: 200 len: 1502 microversion: 2.1 time: 0.242525 Oct 15 13:49:58.230442 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 85/168] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:49:57 2022] GET /compute/v2.1/servers/8fb76141-70a4-4501-b928-7502a13c3cb4 => generated 1502 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:49:58.414755 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-4e7f0871-5c1c-4736-a544-ad091e3924a7 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:49:58.454102 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-4e7f0871-5c1c-4736-a544-ad091e3924a7 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:49:58.462535 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-4e7f0871-5c1c-4736-a544-ad091e3924a7 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:49:58.464695 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-4e7f0871-5c1c-4736-a544-ad091e3924a7 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c" status: 200 len: 1406 microversion: 2.20 time: 0.310926 Oct 15 13:49:58.467834 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 84/169] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:49:58 2022] GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c => generated 1406 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 13:49:58.656407 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-ff2217db-6d01-427a-b33d-d61b202c6180 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:49:58.657443 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-ff2217db-6d01-427a-b33d-d61b202c6180 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] [instance: a8976a74-703a-4fa4-9cc7-760a3e3f226b] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:49:58.672922 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-ff2217db-6d01-427a-b33d-d61b202c6180 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:58.675121 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-ff2217db-6d01-427a-b33d-d61b202c6180 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:58.675783 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-ff2217db-6d01-427a-b33d-d61b202c6180 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:58.678708 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-ff2217db-6d01-427a-b33d-d61b202c6180 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:58.681028 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-ff2217db-6d01-427a-b33d-d61b202c6180 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:58.685795 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-ff2217db-6d01-427a-b33d-d61b202c6180 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:59.043583 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-ff2217db-6d01-427a-b33d-d61b202c6180 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5150c06020594efe957359f641eba5da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a0813bae074cd2aa552be82abe8493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:49:59.055231 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-ff2217db-6d01-427a-b33d-d61b202c6180 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] 10.222.0.36 "GET /compute/v2.1/servers/a8976a74-703a-4fa4-9cc7-760a3e3f226b" status: 200 len: 1521 microversion: 2.1 time: 0.404177 Oct 15 13:49:59.062718 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 86/170] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:49:58 2022] GET /compute/v2.1/servers/a8976a74-703a-4fa4-9cc7-760a3e3f226b => generated 1521 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:49:59.497720 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-9ed8bd9c-fb72-4262-91ae-869691c945ce tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:49:59.499746 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-9ed8bd9c-fb72-4262-91ae-869691c945ce tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 5fc359cf-ff2c-4189-b058-31eb3c97568c] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:49:59.507067 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-9ed8bd9c-fb72-4262-91ae-869691c945ce tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:59.507772 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-9ed8bd9c-fb72-4262-91ae-869691c945ce tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:59.508525 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-9ed8bd9c-fb72-4262-91ae-869691c945ce tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:59.509253 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-9ed8bd9c-fb72-4262-91ae-869691c945ce tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:49:59.510029 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-9ed8bd9c-fb72-4262-91ae-869691c945ce tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:49:59.510959 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-9ed8bd9c-fb72-4262-91ae-869691c945ce tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:49:59.917140 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-9ed8bd9c-fb72-4262-91ae-869691c945ce tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:49:59.927689 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-9ed8bd9c-fb72-4262-91ae-869691c945ce tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:49:59.929356 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-9ed8bd9c-fb72-4262-91ae-869691c945ce tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:49:59.930931 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-9ed8bd9c-fb72-4262-91ae-869691c945ce tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c" status: 200 len: 1406 microversion: 2.20 time: 0.440180 Oct 15 13:49:59.931532 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 85/171] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:49:59 2022] GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c => generated 1406 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 13:50:00.095754 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-91f90547-19e2-4729-a6ce-4fffc6cc78c4 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:50:00.098288 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-91f90547-19e2-4729-a6ce-4fffc6cc78c4 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] [instance: a8976a74-703a-4fa4-9cc7-760a3e3f226b] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:50:00.124262 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-91f90547-19e2-4729-a6ce-4fffc6cc78c4 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:00.126106 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-91f90547-19e2-4729-a6ce-4fffc6cc78c4 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:00.127214 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-91f90547-19e2-4729-a6ce-4fffc6cc78c4 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:00.128907 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-91f90547-19e2-4729-a6ce-4fffc6cc78c4 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:00.130152 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-91f90547-19e2-4729-a6ce-4fffc6cc78c4 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:00.131189 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-91f90547-19e2-4729-a6ce-4fffc6cc78c4 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:00.132667 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-4786c1ef-04e2-490b-99e0-f3a01068cfe1 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2edbd0ec-3046-45e1-9f3e-e95b1e11fb6c"}} {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 13:50:00.137863 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-4786c1ef-04e2-490b-99e0-f3a01068cfe1 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] [instance: 8fb76141-70a4-4501-b928-7502a13c3cb4] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:50:00.149422 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-4786c1ef-04e2-490b-99e0-f3a01068cfe1 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:00.150218 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-4786c1ef-04e2-490b-99e0-f3a01068cfe1 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:00.150811 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-4786c1ef-04e2-490b-99e0-f3a01068cfe1 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:00.151908 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-4786c1ef-04e2-490b-99e0-f3a01068cfe1 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:00.152540 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-4786c1ef-04e2-490b-99e0-f3a01068cfe1 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:00.153129 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-4786c1ef-04e2-490b-99e0-f3a01068cfe1 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:00.626257 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-91f90547-19e2-4729-a6ce-4fffc6cc78c4 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5150c06020594efe957359f641eba5da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a0813bae074cd2aa552be82abe8493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:50:00.630428 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG dbcounter [-] [125243] Writing DB stats nova_cell1:SELECT=100 {{(pid=125243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:50:00.645583 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-91f90547-19e2-4729-a6ce-4fffc6cc78c4 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] 10.222.0.36 "GET /compute/v2.1/servers/a8976a74-703a-4fa4-9cc7-760a3e3f226b" status: 200 len: 1521 microversion: 2.1 time: 0.567480 Oct 15 13:50:00.647775 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 87/172] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:50:00 2022] GET /compute/v2.1/servers/a8976a74-703a-4fa4-9cc7-760a3e3f226b => generated 1521 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:50:00.973501 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-ace77d73-9eb0-4526-9ab7-2407bdb1cb05 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:50:00.974482 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-ace77d73-9eb0-4526-9ab7-2407bdb1cb05 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 5fc359cf-ff2c-4189-b058-31eb3c97568c] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:50:00.982696 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-ace77d73-9eb0-4526-9ab7-2407bdb1cb05 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:00.983522 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-ace77d73-9eb0-4526-9ab7-2407bdb1cb05 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:00.984168 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-ace77d73-9eb0-4526-9ab7-2407bdb1cb05 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:00.985060 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-ace77d73-9eb0-4526-9ab7-2407bdb1cb05 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:00.985715 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-ace77d73-9eb0-4526-9ab7-2407bdb1cb05 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:00.986295 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-ace77d73-9eb0-4526-9ab7-2407bdb1cb05 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:01.393531 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-ace77d73-9eb0-4526-9ab7-2407bdb1cb05 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:50:01.413908 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-ace77d73-9eb0-4526-9ab7-2407bdb1cb05 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:50:01.419516 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-ace77d73-9eb0-4526-9ab7-2407bdb1cb05 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:50:01.421907 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-ace77d73-9eb0-4526-9ab7-2407bdb1cb05 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c" status: 200 len: 1406 microversion: 2.20 time: 0.452630 Oct 15 13:50:01.423823 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 88/173] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:50:00 2022] GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c => generated 1406 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 13:50:01.682812 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-67ea66a5-b79c-4a0b-af86-bf7174835f55 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:50:01.685884 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-67ea66a5-b79c-4a0b-af86-bf7174835f55 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] [instance: a8976a74-703a-4fa4-9cc7-760a3e3f226b] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:50:01.702351 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-67ea66a5-b79c-4a0b-af86-bf7174835f55 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:01.704624 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-67ea66a5-b79c-4a0b-af86-bf7174835f55 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:01.706082 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-67ea66a5-b79c-4a0b-af86-bf7174835f55 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:01.709267 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-67ea66a5-b79c-4a0b-af86-bf7174835f55 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:01.710010 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-67ea66a5-b79c-4a0b-af86-bf7174835f55 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:01.711037 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-67ea66a5-b79c-4a0b-af86-bf7174835f55 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:01.959036 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-67ea66a5-b79c-4a0b-af86-bf7174835f55 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5150c06020594efe957359f641eba5da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a0813bae074cd2aa552be82abe8493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:50:01.977994 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-67ea66a5-b79c-4a0b-af86-bf7174835f55 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] 10.222.0.36 "GET /compute/v2.1/servers/a8976a74-703a-4fa4-9cc7-760a3e3f226b" status: 200 len: 1521 microversion: 2.1 time: 0.305938 Oct 15 13:50:01.979529 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 89/174] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:50:01 2022] GET /compute/v2.1/servers/a8976a74-703a-4fa4-9cc7-760a3e3f226b => generated 1521 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 13:50:02.452533 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-5681e485-5cda-4729-b0ab-2d06caaca990 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:50:02.453302 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-5681e485-5cda-4729-b0ab-2d06caaca990 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 5fc359cf-ff2c-4189-b058-31eb3c97568c] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:50:02.462429 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-5681e485-5cda-4729-b0ab-2d06caaca990 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:02.463025 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-5681e485-5cda-4729-b0ab-2d06caaca990 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:02.463337 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-5681e485-5cda-4729-b0ab-2d06caaca990 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:02.464555 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-5681e485-5cda-4729-b0ab-2d06caaca990 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:02.465121 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-5681e485-5cda-4729-b0ab-2d06caaca990 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:02.465664 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-5681e485-5cda-4729-b0ab-2d06caaca990 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:02.684711 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-5681e485-5cda-4729-b0ab-2d06caaca990 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:50:02.694602 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-5681e485-5cda-4729-b0ab-2d06caaca990 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:50:02.696332 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-5681e485-5cda-4729-b0ab-2d06caaca990 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:50:02.697638 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-5681e485-5cda-4729-b0ab-2d06caaca990 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c" status: 200 len: 1406 microversion: 2.20 time: 0.250524 Oct 15 13:50:02.698353 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 90/175] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:50:02 2022] GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c => generated 1406 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 13:50:03.009186 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-d4d85ec2-a932-4e56-a3e9-fe2aee829e1a tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:50:03.010224 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-d4d85ec2-a932-4e56-a3e9-fe2aee829e1a tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] [instance: a8976a74-703a-4fa4-9cc7-760a3e3f226b] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:50:03.022647 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-d4d85ec2-a932-4e56-a3e9-fe2aee829e1a tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:03.023825 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-d4d85ec2-a932-4e56-a3e9-fe2aee829e1a tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:03.025230 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-d4d85ec2-a932-4e56-a3e9-fe2aee829e1a tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:03.026411 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-d4d85ec2-a932-4e56-a3e9-fe2aee829e1a tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:03.027192 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-d4d85ec2-a932-4e56-a3e9-fe2aee829e1a tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:03.027674 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-d4d85ec2-a932-4e56-a3e9-fe2aee829e1a tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:03.246456 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-d4d85ec2-a932-4e56-a3e9-fe2aee829e1a tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5150c06020594efe957359f641eba5da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a0813bae074cd2aa552be82abe8493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:50:03.265984 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-d4d85ec2-a932-4e56-a3e9-fe2aee829e1a tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] 10.222.0.36 "GET /compute/v2.1/servers/a8976a74-703a-4fa4-9cc7-760a3e3f226b" status: 200 len: 1521 microversion: 2.1 time: 0.262960 Oct 15 13:50:03.272268 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 91/176] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:50:02 2022] GET /compute/v2.1/servers/a8976a74-703a-4fa4-9cc7-760a3e3f226b => generated 1521 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:50:03.731054 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-96c81fe9-fae4-4f2f-b5f4-f15e87404677 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:50:03.732848 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-96c81fe9-fae4-4f2f-b5f4-f15e87404677 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 5fc359cf-ff2c-4189-b058-31eb3c97568c] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:50:03.741599 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-96c81fe9-fae4-4f2f-b5f4-f15e87404677 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:03.742656 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-96c81fe9-fae4-4f2f-b5f4-f15e87404677 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:03.743490 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-96c81fe9-fae4-4f2f-b5f4-f15e87404677 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:03.744754 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-96c81fe9-fae4-4f2f-b5f4-f15e87404677 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:03.745423 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-96c81fe9-fae4-4f2f-b5f4-f15e87404677 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:03.745945 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-96c81fe9-fae4-4f2f-b5f4-f15e87404677 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:03.956865 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-96c81fe9-fae4-4f2f-b5f4-f15e87404677 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:50:03.967556 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-96c81fe9-fae4-4f2f-b5f4-f15e87404677 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:50:03.969594 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-96c81fe9-fae4-4f2f-b5f4-f15e87404677 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:50:03.971021 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-96c81fe9-fae4-4f2f-b5f4-f15e87404677 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c" status: 200 len: 1406 microversion: 2.20 time: 0.246985 Oct 15 13:50:03.972336 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 92/177] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:50:03 2022] GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c => generated 1406 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 13:50:04.308346 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-c8a73d76-38ed-400e-b8e6-27fb4ec5c3a6 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:50:04.309288 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-c8a73d76-38ed-400e-b8e6-27fb4ec5c3a6 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] [instance: a8976a74-703a-4fa4-9cc7-760a3e3f226b] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:50:04.319048 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-c8a73d76-38ed-400e-b8e6-27fb4ec5c3a6 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:04.319921 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-c8a73d76-38ed-400e-b8e6-27fb4ec5c3a6 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:04.320479 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-c8a73d76-38ed-400e-b8e6-27fb4ec5c3a6 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:04.321464 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-c8a73d76-38ed-400e-b8e6-27fb4ec5c3a6 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:04.322126 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-c8a73d76-38ed-400e-b8e6-27fb4ec5c3a6 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:04.323656 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-c8a73d76-38ed-400e-b8e6-27fb4ec5c3a6 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:04.737438 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-4786c1ef-04e2-490b-99e0-f3a01068cfe1 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] 10.222.0.36 "POST /compute/v2.1/servers/8fb76141-70a4-4501-b928-7502a13c3cb4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.611560 Oct 15 13:50:04.739543 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 86/178] 10.222.0.36 () {60 vars in 1323 bytes} [Sat Oct 15 13:50:00 2022] POST /compute/v2.1/servers/8fb76141-70a4-4501-b928-7502a13c3cb4/os-volume_attachments => generated 194 bytes in 4616 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 15 13:50:04.762190 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-c8a73d76-38ed-400e-b8e6-27fb4ec5c3a6 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5150c06020594efe957359f641eba5da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a0813bae074cd2aa552be82abe8493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:50:04.770472 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-c8a73d76-38ed-400e-b8e6-27fb4ec5c3a6 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] 10.222.0.36 "GET /compute/v2.1/servers/a8976a74-703a-4fa4-9cc7-760a3e3f226b" status: 200 len: 1521 microversion: 2.1 time: 0.466631 Oct 15 13:50:04.771071 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 93/179] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:50:04 2022] GET /compute/v2.1/servers/a8976a74-703a-4fa4-9cc7-760a3e3f226b => generated 1521 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 13:50:05.031131 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-301c8424-b34c-4de7-9812-c97067f8d214 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:50:05.032371 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-301c8424-b34c-4de7-9812-c97067f8d214 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 5fc359cf-ff2c-4189-b058-31eb3c97568c] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:50:05.048919 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-301c8424-b34c-4de7-9812-c97067f8d214 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:05.051999 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-301c8424-b34c-4de7-9812-c97067f8d214 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:05.053157 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-301c8424-b34c-4de7-9812-c97067f8d214 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:05.056809 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-301c8424-b34c-4de7-9812-c97067f8d214 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:05.058955 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-301c8424-b34c-4de7-9812-c97067f8d214 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:05.060441 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-301c8424-b34c-4de7-9812-c97067f8d214 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:05.310282 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-301c8424-b34c-4de7-9812-c97067f8d214 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:50:05.332450 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-301c8424-b34c-4de7-9812-c97067f8d214 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:50:05.336666 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-301c8424-b34c-4de7-9812-c97067f8d214 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:50:05.339896 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-301c8424-b34c-4de7-9812-c97067f8d214 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c" status: 200 len: 1406 microversion: 2.20 time: 0.323708 Oct 15 13:50:05.342282 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 87/180] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:50:05 2022] GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c => generated 1406 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 13:50:05.795230 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-7ff96d5a-fa69-4b6e-8da7-5e28485c7a8d tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:50:05.796780 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-7ff96d5a-fa69-4b6e-8da7-5e28485c7a8d tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] [instance: a8976a74-703a-4fa4-9cc7-760a3e3f226b] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:50:05.804797 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-7ff96d5a-fa69-4b6e-8da7-5e28485c7a8d tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:05.805283 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-7ff96d5a-fa69-4b6e-8da7-5e28485c7a8d tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:05.806630 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-7ff96d5a-fa69-4b6e-8da7-5e28485c7a8d tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:05.807571 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-7ff96d5a-fa69-4b6e-8da7-5e28485c7a8d tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:05.808248 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-7ff96d5a-fa69-4b6e-8da7-5e28485c7a8d tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:05.808857 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-7ff96d5a-fa69-4b6e-8da7-5e28485c7a8d tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:06.055831 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-7ff96d5a-fa69-4b6e-8da7-5e28485c7a8d tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5150c06020594efe957359f641eba5da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a0813bae074cd2aa552be82abe8493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:50:06.067906 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-7ff96d5a-fa69-4b6e-8da7-5e28485c7a8d tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] 10.222.0.36 "GET /compute/v2.1/servers/a8976a74-703a-4fa4-9cc7-760a3e3f226b" status: 200 len: 1521 microversion: 2.1 time: 0.276207 Oct 15 13:50:06.069123 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 94/181] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:50:05 2022] GET /compute/v2.1/servers/a8976a74-703a-4fa4-9cc7-760a3e3f226b => generated 1521 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:50:06.380457 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-69a8f665-1ea0-4913-af58-6c04e5fd886f tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:50:06.381153 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-69a8f665-1ea0-4913-af58-6c04e5fd886f tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 5fc359cf-ff2c-4189-b058-31eb3c97568c] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:50:06.397981 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-69a8f665-1ea0-4913-af58-6c04e5fd886f tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:06.398580 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-69a8f665-1ea0-4913-af58-6c04e5fd886f tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:06.398738 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-69a8f665-1ea0-4913-af58-6c04e5fd886f tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:06.399555 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-69a8f665-1ea0-4913-af58-6c04e5fd886f tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:06.400067 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-69a8f665-1ea0-4913-af58-6c04e5fd886f tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:06.400762 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-69a8f665-1ea0-4913-af58-6c04e5fd886f tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:06.614577 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-69a8f665-1ea0-4913-af58-6c04e5fd886f tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:50:06.625154 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-69a8f665-1ea0-4913-af58-6c04e5fd886f tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:50:06.626847 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-69a8f665-1ea0-4913-af58-6c04e5fd886f tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:50:06.628213 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-69a8f665-1ea0-4913-af58-6c04e5fd886f tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c" status: 200 len: 1406 microversion: 2.20 time: 0.257214 Oct 15 13:50:06.628853 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 88/182] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:50:06 2022] GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c => generated 1406 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 13:50:07.092119 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-31b26ac4-1f67-4319-a452-0fe6f3f971e7 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:50:07.092750 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-31b26ac4-1f67-4319-a452-0fe6f3f971e7 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] [instance: a8976a74-703a-4fa4-9cc7-760a3e3f226b] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:50:07.099491 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-31b26ac4-1f67-4319-a452-0fe6f3f971e7 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:07.100093 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-31b26ac4-1f67-4319-a452-0fe6f3f971e7 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:07.100767 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-31b26ac4-1f67-4319-a452-0fe6f3f971e7 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:07.101505 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-31b26ac4-1f67-4319-a452-0fe6f3f971e7 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:07.101939 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-31b26ac4-1f67-4319-a452-0fe6f3f971e7 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:07.102347 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-31b26ac4-1f67-4319-a452-0fe6f3f971e7 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:07.325322 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-31b26ac4-1f67-4319-a452-0fe6f3f971e7 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5150c06020594efe957359f641eba5da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a0813bae074cd2aa552be82abe8493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:50:07.335822 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-31b26ac4-1f67-4319-a452-0fe6f3f971e7 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] 10.222.0.36 "GET /compute/v2.1/servers/a8976a74-703a-4fa4-9cc7-760a3e3f226b" status: 200 len: 1521 microversion: 2.1 time: 0.247822 Oct 15 13:50:07.337304 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 95/183] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:50:07 2022] GET /compute/v2.1/servers/a8976a74-703a-4fa4-9cc7-760a3e3f226b => generated 1521 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 13:50:07.618067 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [req-2400224b-dec5-4147-b61a-a7dcb5684eb4 req-ccba408f-c7b6-40a9-82e2-cbcf1df56e15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5fc359cf-ff2c-4189-b058-31eb3c97568c", "name": "network-vif-plugged", "status": "completed", "tag": "5a131939-5800-4807-b2cc-42f66041598f"}]} {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 13:50:07.629814 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [req-2400224b-dec5-4147-b61a-a7dcb5684eb4 req-ccba408f-c7b6-40a9-82e2-cbcf1df56e15 service nova] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:07.630574 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [req-2400224b-dec5-4147-b61a-a7dcb5684eb4 req-ccba408f-c7b6-40a9-82e2-cbcf1df56e15 service nova] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:07.631224 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [req-2400224b-dec5-4147-b61a-a7dcb5684eb4 req-ccba408f-c7b6-40a9-82e2-cbcf1df56e15 service nova] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:07.645291 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.compute.server_external_events [req-2400224b-dec5-4147-b61a-a7dcb5684eb4 req-ccba408f-c7b6-40a9-82e2-cbcf1df56e15 service nova] Creating event network-vif-plugged:5a131939-5800-4807-b2cc-42f66041598f for instance 5fc359cf-ff2c-4189-b058-31eb3c97568c on hv-cinder-86149 Oct 15 13:50:07.651351 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [req-2400224b-dec5-4147-b61a-a7dcb5684eb4 req-ccba408f-c7b6-40a9-82e2-cbcf1df56e15 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040444 Oct 15 13:50:07.652632 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 89/184] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 15 13:50:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 13:50:07.656457 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-3d53dc66-561d-49fd-acab-19dcbba5cbcd tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:50:07.657103 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-3d53dc66-561d-49fd-acab-19dcbba5cbcd tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 5fc359cf-ff2c-4189-b058-31eb3c97568c] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:50:07.664533 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-3d53dc66-561d-49fd-acab-19dcbba5cbcd tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:07.666000 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-3d53dc66-561d-49fd-acab-19dcbba5cbcd tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:07.666665 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-3d53dc66-561d-49fd-acab-19dcbba5cbcd tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:07.667637 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-3d53dc66-561d-49fd-acab-19dcbba5cbcd tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:07.668738 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-3d53dc66-561d-49fd-acab-19dcbba5cbcd tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:07.669445 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-3d53dc66-561d-49fd-acab-19dcbba5cbcd tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:07.986025 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-3d53dc66-561d-49fd-acab-19dcbba5cbcd tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:50:07.996223 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-3d53dc66-561d-49fd-acab-19dcbba5cbcd tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:50:07.998605 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-3d53dc66-561d-49fd-acab-19dcbba5cbcd tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:50:07.999956 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-3d53dc66-561d-49fd-acab-19dcbba5cbcd tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c" status: 200 len: 1406 microversion: 2.20 time: 0.348500 Oct 15 13:50:08.001187 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 96/185] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:50:07 2022] GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c => generated 1406 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 13:50:08.082267 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-f976a99c-c71e-45f6-b491-df8b2aac6b55 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1113410395", "imageRef": "26e64909-1cae-49ca-af5e-adea40c062d7", "flavorRef": "452", "networks": [{"uuid": "48059652-91b4-4864-bff2-b040e5893a7d"}]}} {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 13:50:08.142288 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.network.neutron [None req-f976a99c-c71e-45f6-b491-df8b2aac6b55 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] validate_networks() for [('48059652-91b4-4864-bff2-b040e5893a7d', None, None, None, None, None)] {{(pid=125242) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 15 13:50:08.365819 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-2b352a4f-89fc-445c-a6d9-6dd6fc0a62c7 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:50:08.366831 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-2b352a4f-89fc-445c-a6d9-6dd6fc0a62c7 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] [instance: a8976a74-703a-4fa4-9cc7-760a3e3f226b] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:50:08.377763 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-2b352a4f-89fc-445c-a6d9-6dd6fc0a62c7 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:08.378398 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-2b352a4f-89fc-445c-a6d9-6dd6fc0a62c7 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:08.378903 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-2b352a4f-89fc-445c-a6d9-6dd6fc0a62c7 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:08.379836 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-2b352a4f-89fc-445c-a6d9-6dd6fc0a62c7 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:08.380432 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-2b352a4f-89fc-445c-a6d9-6dd6fc0a62c7 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:08.381042 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-2b352a4f-89fc-445c-a6d9-6dd6fc0a62c7 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:08.641195 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-2b352a4f-89fc-445c-a6d9-6dd6fc0a62c7 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5150c06020594efe957359f641eba5da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a0813bae074cd2aa552be82abe8493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:50:08.654201 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-2b352a4f-89fc-445c-a6d9-6dd6fc0a62c7 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] 10.222.0.36 "GET /compute/v2.1/servers/a8976a74-703a-4fa4-9cc7-760a3e3f226b" status: 200 len: 1521 microversion: 2.1 time: 0.295662 Oct 15 13:50:08.655342 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 97/186] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:50:08 2022] GET /compute/v2.1/servers/a8976a74-703a-4fa4-9cc7-760a3e3f226b => generated 1521 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:50:08.673561 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.virt.hardware [None req-f976a99c-c71e-45f6-b491-df8b2aac6b55 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Flavor limits 0:0:0 {{(pid=125242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 15 13:50:08.675454 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.virt.hardware [None req-f976a99c-c71e-45f6-b491-df8b2aac6b55 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Image limits 0:0:0 {{(pid=125242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 15 13:50:08.676629 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.virt.hardware [None req-f976a99c-c71e-45f6-b491-df8b2aac6b55 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Flavor pref 0:0:0 {{(pid=125242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 15 13:50:08.677585 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.virt.hardware [None req-f976a99c-c71e-45f6-b491-df8b2aac6b55 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Image pref 0:0:0 {{(pid=125242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 15 13:50:08.678326 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.virt.hardware [None req-f976a99c-c71e-45f6-b491-df8b2aac6b55 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 15 13:50:08.695069 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-f976a99c-c71e-45f6-b491-df8b2aac6b55 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:08.695958 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-f976a99c-c71e-45f6-b491-df8b2aac6b55 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:08.696735 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-f976a99c-c71e-45f6-b491-df8b2aac6b55 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:08.698071 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-f976a99c-c71e-45f6-b491-df8b2aac6b55 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:08.698722 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-f976a99c-c71e-45f6-b491-df8b2aac6b55 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:08.699385 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-f976a99c-c71e-45f6-b491-df8b2aac6b55 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:08.723339 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.quota [None req-f976a99c-c71e-45f6-b491-df8b2aac6b55 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Getting quotas for project b58d317ad84e46be85ed15b3e51c2f97. Resources: {'cores', 'ram', 'instances'} {{(pid=125242) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 15 13:50:08.728746 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.quota [None req-f976a99c-c71e-45f6-b491-df8b2aac6b55 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Getting quotas for user af1daddbc1b84ab79f269e124cbea4fb and project b58d317ad84e46be85ed15b3e51c2f97. Resources: {'cores', 'ram', 'instances'} {{(pid=125242) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 15 13:50:08.745842 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-f976a99c-c71e-45f6-b491-df8b2aac6b55 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Going to run 1 instances... {{(pid=125242) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 15 13:50:08.750696 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-f976a99c-c71e-45f6-b491-df8b2aac6b55 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] [instance: bbd01fa3-108f-4365-b722-b2a0af32983b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='26e64909-1cae-49ca-af5e-adea40c062d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125242) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 15 13:50:08.837243 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-f976a99c-c71e-45f6-b491-df8b2aac6b55 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.759166 Oct 15 13:50:08.838254 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 90/187] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 15 13:50:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 761 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 15 13:50:08.851631 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-49384560-143a-4331-ba29-2e9f9752fc59 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:50:08.852288 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-49384560-143a-4331-ba29-2e9f9752fc59 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] [instance: bbd01fa3-108f-4365-b722-b2a0af32983b] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:50:08.940464 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-49384560-143a-4331-ba29-2e9f9752fc59 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af1daddbc1b84ab79f269e124cbea4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b58d317ad84e46be85ed15b3e51c2f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:50:08.951912 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-49384560-143a-4331-ba29-2e9f9752fc59 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] 10.222.0.36 "GET /compute/v2.1/servers/bbd01fa3-108f-4365-b722-b2a0af32983b" status: 200 len: 1214 microversion: 2.1 time: 0.104573 Oct 15 13:50:08.964099 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 98/188] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:50:08 2022] GET /compute/v2.1/servers/bbd01fa3-108f-4365-b722-b2a0af32983b => generated 1214 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:50:09.060580 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-37c1d6e0-9bf8-4c64-88ec-1ccf4474265a tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:50:09.061856 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-37c1d6e0-9bf8-4c64-88ec-1ccf4474265a tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 5fc359cf-ff2c-4189-b058-31eb3c97568c] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:50:09.074083 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-37c1d6e0-9bf8-4c64-88ec-1ccf4474265a tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:09.074905 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-37c1d6e0-9bf8-4c64-88ec-1ccf4474265a tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:09.076559 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-37c1d6e0-9bf8-4c64-88ec-1ccf4474265a tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:09.077802 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-37c1d6e0-9bf8-4c64-88ec-1ccf4474265a tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:09.086077 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-37c1d6e0-9bf8-4c64-88ec-1ccf4474265a tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:09.086077 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-37c1d6e0-9bf8-4c64-88ec-1ccf4474265a tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:09.277481 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-37c1d6e0-9bf8-4c64-88ec-1ccf4474265a tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:50:09.293375 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-37c1d6e0-9bf8-4c64-88ec-1ccf4474265a tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:50:09.298313 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-37c1d6e0-9bf8-4c64-88ec-1ccf4474265a tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:50:09.301762 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-37c1d6e0-9bf8-4c64-88ec-1ccf4474265a tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c" status: 200 len: 1406 microversion: 2.20 time: 0.247961 Oct 15 13:50:09.304710 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 91/189] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:50:09 2022] GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c => generated 1406 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 13:50:09.693732 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-da33bfdb-1978-49f0-a028-22689e48a477 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:50:09.694367 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-da33bfdb-1978-49f0-a028-22689e48a477 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] [instance: a8976a74-703a-4fa4-9cc7-760a3e3f226b] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:50:09.701645 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-da33bfdb-1978-49f0-a028-22689e48a477 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:09.702012 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-da33bfdb-1978-49f0-a028-22689e48a477 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:09.702445 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-da33bfdb-1978-49f0-a028-22689e48a477 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:09.703166 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-da33bfdb-1978-49f0-a028-22689e48a477 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:09.703614 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-da33bfdb-1978-49f0-a028-22689e48a477 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:09.704083 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-da33bfdb-1978-49f0-a028-22689e48a477 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:09.861686 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-da33bfdb-1978-49f0-a028-22689e48a477 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5150c06020594efe957359f641eba5da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a0813bae074cd2aa552be82abe8493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:50:09.872993 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-da33bfdb-1978-49f0-a028-22689e48a477 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] 10.222.0.36 "GET /compute/v2.1/servers/a8976a74-703a-4fa4-9cc7-760a3e3f226b" status: 200 len: 1521 microversion: 2.1 time: 0.183192 Oct 15 13:50:09.873998 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 99/190] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:50:09 2022] GET /compute/v2.1/servers/a8976a74-703a-4fa4-9cc7-760a3e3f226b => generated 1521 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 13:50:10.017829 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-2b032e61-a9f0-4b5a-ac35-9acb50783989 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:50:10.018396 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-2b032e61-a9f0-4b5a-ac35-9acb50783989 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] [instance: bbd01fa3-108f-4365-b722-b2a0af32983b] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:50:10.025485 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-2b032e61-a9f0-4b5a-ac35-9acb50783989 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:10.026101 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-2b032e61-a9f0-4b5a-ac35-9acb50783989 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:10.026627 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-2b032e61-a9f0-4b5a-ac35-9acb50783989 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:10.027372 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-2b032e61-a9f0-4b5a-ac35-9acb50783989 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:10.027969 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-2b032e61-a9f0-4b5a-ac35-9acb50783989 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:10.028546 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-2b032e61-a9f0-4b5a-ac35-9acb50783989 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:10.101006 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-2b032e61-a9f0-4b5a-ac35-9acb50783989 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af1daddbc1b84ab79f269e124cbea4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b58d317ad84e46be85ed15b3e51c2f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:50:10.110847 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-2b032e61-a9f0-4b5a-ac35-9acb50783989 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] 10.222.0.36 "GET /compute/v2.1/servers/bbd01fa3-108f-4365-b722-b2a0af32983b" status: 200 len: 1218 microversion: 2.1 time: 0.097025 Oct 15 13:50:10.111448 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 92/191] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:50:10 2022] GET /compute/v2.1/servers/bbd01fa3-108f-4365-b722-b2a0af32983b => generated 1218 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:50:10.334381 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-42eb4e44-8ace-43cf-8753-f9ba7fcb94d0 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:50:10.335386 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-42eb4e44-8ace-43cf-8753-f9ba7fcb94d0 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 5fc359cf-ff2c-4189-b058-31eb3c97568c] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:50:10.347548 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-42eb4e44-8ace-43cf-8753-f9ba7fcb94d0 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:10.348620 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-42eb4e44-8ace-43cf-8753-f9ba7fcb94d0 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:10.349328 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-42eb4e44-8ace-43cf-8753-f9ba7fcb94d0 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:10.353623 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-42eb4e44-8ace-43cf-8753-f9ba7fcb94d0 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:10.353623 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-42eb4e44-8ace-43cf-8753-f9ba7fcb94d0 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:10.353623 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-42eb4e44-8ace-43cf-8753-f9ba7fcb94d0 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:10.580466 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-42eb4e44-8ace-43cf-8753-f9ba7fcb94d0 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:50:10.596815 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-42eb4e44-8ace-43cf-8753-f9ba7fcb94d0 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:50:10.600086 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-42eb4e44-8ace-43cf-8753-f9ba7fcb94d0 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:50:10.602307 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-42eb4e44-8ace-43cf-8753-f9ba7fcb94d0 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c" status: 200 len: 1406 microversion: 2.20 time: 0.274244 Oct 15 13:50:10.603605 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 100/192] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:50:10 2022] GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c => generated 1406 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 13:50:10.901936 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-991034eb-18e6-4a51-825d-232cbcd29983 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:50:10.902546 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-991034eb-18e6-4a51-825d-232cbcd29983 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] [instance: a8976a74-703a-4fa4-9cc7-760a3e3f226b] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:50:10.909567 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-991034eb-18e6-4a51-825d-232cbcd29983 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:10.910047 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-991034eb-18e6-4a51-825d-232cbcd29983 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:10.910476 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-991034eb-18e6-4a51-825d-232cbcd29983 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:10.911208 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-991034eb-18e6-4a51-825d-232cbcd29983 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:10.911655 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-991034eb-18e6-4a51-825d-232cbcd29983 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:10.912123 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-991034eb-18e6-4a51-825d-232cbcd29983 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:11.084980 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-991034eb-18e6-4a51-825d-232cbcd29983 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5150c06020594efe957359f641eba5da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a0813bae074cd2aa552be82abe8493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:50:11.098642 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-991034eb-18e6-4a51-825d-232cbcd29983 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] 10.222.0.36 "GET /compute/v2.1/servers/a8976a74-703a-4fa4-9cc7-760a3e3f226b" status: 200 len: 1521 microversion: 2.1 time: 0.202863 Oct 15 13:50:11.099674 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 93/193] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:50:10 2022] GET /compute/v2.1/servers/a8976a74-703a-4fa4-9cc7-760a3e3f226b => generated 1521 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:50:11.135283 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-8f2b5b75-bfb4-4803-a18a-7c5263490549 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:50:11.135966 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-8f2b5b75-bfb4-4803-a18a-7c5263490549 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] [instance: bbd01fa3-108f-4365-b722-b2a0af32983b] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:50:11.143376 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-8f2b5b75-bfb4-4803-a18a-7c5263490549 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:11.143902 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-8f2b5b75-bfb4-4803-a18a-7c5263490549 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:11.144324 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-8f2b5b75-bfb4-4803-a18a-7c5263490549 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:11.145053 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-8f2b5b75-bfb4-4803-a18a-7c5263490549 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:11.145485 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-8f2b5b75-bfb4-4803-a18a-7c5263490549 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:11.145901 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-8f2b5b75-bfb4-4803-a18a-7c5263490549 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:11.214670 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-8f2b5b75-bfb4-4803-a18a-7c5263490549 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af1daddbc1b84ab79f269e124cbea4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b58d317ad84e46be85ed15b3e51c2f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:50:11.223795 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-8f2b5b75-bfb4-4803-a18a-7c5263490549 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] 10.222.0.36 "GET /compute/v2.1/servers/bbd01fa3-108f-4365-b722-b2a0af32983b" status: 200 len: 1218 microversion: 2.1 time: 0.092514 Oct 15 13:50:11.224627 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 101/194] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:50:11 2022] GET /compute/v2.1/servers/bbd01fa3-108f-4365-b722-b2a0af32983b => generated 1218 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:50:11.644235 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-123cc6d4-3478-49df-8954-50589bfb01a5 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:50:11.645317 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-123cc6d4-3478-49df-8954-50589bfb01a5 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 5fc359cf-ff2c-4189-b058-31eb3c97568c] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:50:11.656364 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-123cc6d4-3478-49df-8954-50589bfb01a5 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:11.657002 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-123cc6d4-3478-49df-8954-50589bfb01a5 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:11.657512 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-123cc6d4-3478-49df-8954-50589bfb01a5 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:11.658377 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-123cc6d4-3478-49df-8954-50589bfb01a5 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:11.659086 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-123cc6d4-3478-49df-8954-50589bfb01a5 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:11.659563 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-123cc6d4-3478-49df-8954-50589bfb01a5 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:11.681850 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG dbcounter [-] [125242] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:50:11.823290 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-123cc6d4-3478-49df-8954-50589bfb01a5 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:50:11.832908 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-123cc6d4-3478-49df-8954-50589bfb01a5 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:50:11.834742 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-123cc6d4-3478-49df-8954-50589bfb01a5 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:50:11.836048 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-123cc6d4-3478-49df-8954-50589bfb01a5 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c" status: 200 len: 1406 microversion: 2.20 time: 0.199384 Oct 15 13:50:11.836741 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 94/195] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:50:11 2022] GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c => generated 1406 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 15 13:50:12.125176 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-3596f17b-98ed-44c9-aac6-391734056ef3 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:50:12.125841 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-3596f17b-98ed-44c9-aac6-391734056ef3 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] [instance: a8976a74-703a-4fa4-9cc7-760a3e3f226b] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:50:12.133804 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-3596f17b-98ed-44c9-aac6-391734056ef3 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:12.134300 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-3596f17b-98ed-44c9-aac6-391734056ef3 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:12.134731 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-3596f17b-98ed-44c9-aac6-391734056ef3 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:12.135472 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-3596f17b-98ed-44c9-aac6-391734056ef3 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:12.136222 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-3596f17b-98ed-44c9-aac6-391734056ef3 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:12.136367 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-3596f17b-98ed-44c9-aac6-391734056ef3 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:12.252055 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-eb0768e0-fd4b-4592-adce-4ced104f3943 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:50:12.253031 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-eb0768e0-fd4b-4592-adce-4ced104f3943 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] [instance: bbd01fa3-108f-4365-b722-b2a0af32983b] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:50:12.261392 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-eb0768e0-fd4b-4592-adce-4ced104f3943 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:12.262100 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-eb0768e0-fd4b-4592-adce-4ced104f3943 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:12.262644 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-eb0768e0-fd4b-4592-adce-4ced104f3943 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:12.263624 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-eb0768e0-fd4b-4592-adce-4ced104f3943 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:12.264153 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-eb0768e0-fd4b-4592-adce-4ced104f3943 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:12.264545 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-eb0768e0-fd4b-4592-adce-4ced104f3943 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:12.293324 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-3596f17b-98ed-44c9-aac6-391734056ef3 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5150c06020594efe957359f641eba5da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a0813bae074cd2aa552be82abe8493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:50:12.305936 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-3596f17b-98ed-44c9-aac6-391734056ef3 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] 10.222.0.36 "GET /compute/v2.1/servers/a8976a74-703a-4fa4-9cc7-760a3e3f226b" status: 200 len: 1521 microversion: 2.1 time: 0.184601 Oct 15 13:50:12.306603 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 102/196] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:50:12 2022] GET /compute/v2.1/servers/a8976a74-703a-4fa4-9cc7-760a3e3f226b => generated 1521 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:50:12.336123 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-eb0768e0-fd4b-4592-adce-4ced104f3943 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af1daddbc1b84ab79f269e124cbea4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b58d317ad84e46be85ed15b3e51c2f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:50:12.344351 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-eb0768e0-fd4b-4592-adce-4ced104f3943 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] 10.222.0.36 "GET /compute/v2.1/servers/bbd01fa3-108f-4365-b722-b2a0af32983b" status: 200 len: 1210 microversion: 2.1 time: 0.099265 Oct 15 13:50:12.344960 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 95/197] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:50:12 2022] GET /compute/v2.1/servers/bbd01fa3-108f-4365-b722-b2a0af32983b => generated 1210 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:50:12.862971 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-567dd7bb-c9bf-47f3-b0e4-33d9a068295b tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:50:12.863559 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-567dd7bb-c9bf-47f3-b0e4-33d9a068295b tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 5fc359cf-ff2c-4189-b058-31eb3c97568c] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:50:12.870524 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-567dd7bb-c9bf-47f3-b0e4-33d9a068295b tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:12.871035 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-567dd7bb-c9bf-47f3-b0e4-33d9a068295b tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:12.871473 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-567dd7bb-c9bf-47f3-b0e4-33d9a068295b tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:12.872598 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-567dd7bb-c9bf-47f3-b0e4-33d9a068295b tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:12.872947 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-567dd7bb-c9bf-47f3-b0e4-33d9a068295b tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:12.873245 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-567dd7bb-c9bf-47f3-b0e4-33d9a068295b tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:13.036091 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-567dd7bb-c9bf-47f3-b0e4-33d9a068295b tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:50:13.045748 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-567dd7bb-c9bf-47f3-b0e4-33d9a068295b tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:50:13.047116 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-567dd7bb-c9bf-47f3-b0e4-33d9a068295b tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:50:13.048317 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-567dd7bb-c9bf-47f3-b0e4-33d9a068295b tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c" status: 200 len: 1406 microversion: 2.20 time: 0.189447 Oct 15 13:50:13.048889 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 103/198] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:50:12 2022] GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c => generated 1406 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 13:50:13.329128 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-d04c9132-f465-4e80-bc02-b17096b171f9 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:50:13.329731 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-d04c9132-f465-4e80-bc02-b17096b171f9 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] [instance: a8976a74-703a-4fa4-9cc7-760a3e3f226b] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:50:13.336938 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-d04c9132-f465-4e80-bc02-b17096b171f9 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:13.337444 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-d04c9132-f465-4e80-bc02-b17096b171f9 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:13.337884 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-d04c9132-f465-4e80-bc02-b17096b171f9 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:13.338595 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-d04c9132-f465-4e80-bc02-b17096b171f9 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:13.339053 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-d04c9132-f465-4e80-bc02-b17096b171f9 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:13.339480 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-d04c9132-f465-4e80-bc02-b17096b171f9 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:13.371030 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-38c437a1-a8b9-42a1-8b65-70b45b3c678f tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:50:13.372245 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-38c437a1-a8b9-42a1-8b65-70b45b3c678f tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] [instance: bbd01fa3-108f-4365-b722-b2a0af32983b] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:50:13.380557 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-38c437a1-a8b9-42a1-8b65-70b45b3c678f tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:13.381386 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-38c437a1-a8b9-42a1-8b65-70b45b3c678f tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:13.381825 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-38c437a1-a8b9-42a1-8b65-70b45b3c678f tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:13.382538 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-38c437a1-a8b9-42a1-8b65-70b45b3c678f tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:13.382995 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-38c437a1-a8b9-42a1-8b65-70b45b3c678f tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:13.383418 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-38c437a1-a8b9-42a1-8b65-70b45b3c678f tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:13.484737 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-38c437a1-a8b9-42a1-8b65-70b45b3c678f tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af1daddbc1b84ab79f269e124cbea4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b58d317ad84e46be85ed15b3e51c2f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:50:13.493936 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-38c437a1-a8b9-42a1-8b65-70b45b3c678f tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] 10.222.0.36 "GET /compute/v2.1/servers/bbd01fa3-108f-4365-b722-b2a0af32983b" status: 200 len: 1210 microversion: 2.1 time: 0.127201 Oct 15 13:50:13.494542 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 104/199] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:50:13 2022] GET /compute/v2.1/servers/bbd01fa3-108f-4365-b722-b2a0af32983b => generated 1210 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 13:50:13.571100 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-d04c9132-f465-4e80-bc02-b17096b171f9 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5150c06020594efe957359f641eba5da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a0813bae074cd2aa552be82abe8493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:50:13.579995 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-d04c9132-f465-4e80-bc02-b17096b171f9 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] 10.222.0.36 "GET /compute/v2.1/servers/a8976a74-703a-4fa4-9cc7-760a3e3f226b" status: 200 len: 1521 microversion: 2.1 time: 0.254735 Oct 15 13:50:13.580433 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 96/200] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:50:13 2022] GET /compute/v2.1/servers/a8976a74-703a-4fa4-9cc7-760a3e3f226b => generated 1521 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:50:14.073676 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-43f051fd-30d8-4d96-b50f-ec7ab07759c0 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:50:14.074296 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-43f051fd-30d8-4d96-b50f-ec7ab07759c0 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 5fc359cf-ff2c-4189-b058-31eb3c97568c] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:50:14.081846 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-43f051fd-30d8-4d96-b50f-ec7ab07759c0 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:14.082331 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-43f051fd-30d8-4d96-b50f-ec7ab07759c0 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:14.082750 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-43f051fd-30d8-4d96-b50f-ec7ab07759c0 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:14.083449 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-43f051fd-30d8-4d96-b50f-ec7ab07759c0 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:14.083919 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-43f051fd-30d8-4d96-b50f-ec7ab07759c0 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:14.084480 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-43f051fd-30d8-4d96-b50f-ec7ab07759c0 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:14.101854 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG dbcounter [-] [125243] Writing DB stats nova_cell1:SELECT=100 {{(pid=125243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:50:14.237839 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-43f051fd-30d8-4d96-b50f-ec7ab07759c0 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:50:14.246713 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-43f051fd-30d8-4d96-b50f-ec7ab07759c0 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:50:14.248465 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-43f051fd-30d8-4d96-b50f-ec7ab07759c0 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:50:14.249608 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-43f051fd-30d8-4d96-b50f-ec7ab07759c0 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c" status: 200 len: 1406 microversion: 2.20 time: 0.179948 Oct 15 13:50:14.250177 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 105/201] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:50:14 2022] GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c => generated 1406 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 13:50:14.521215 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-ac853f0f-1730-4794-8741-a83c5afe768a tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:50:14.522065 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-ac853f0f-1730-4794-8741-a83c5afe768a tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] [instance: bbd01fa3-108f-4365-b722-b2a0af32983b] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:50:14.528929 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-ac853f0f-1730-4794-8741-a83c5afe768a tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:14.529453 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-ac853f0f-1730-4794-8741-a83c5afe768a tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:14.529861 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-ac853f0f-1730-4794-8741-a83c5afe768a tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:14.530579 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-ac853f0f-1730-4794-8741-a83c5afe768a tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:14.531030 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-ac853f0f-1730-4794-8741-a83c5afe768a tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:14.531503 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-ac853f0f-1730-4794-8741-a83c5afe768a tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:14.601038 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-ac853f0f-1730-4794-8741-a83c5afe768a tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af1daddbc1b84ab79f269e124cbea4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b58d317ad84e46be85ed15b3e51c2f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:50:14.603733 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-21d84897-e626-4646-b9c4-7c846674a5a4 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:50:14.604367 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-21d84897-e626-4646-b9c4-7c846674a5a4 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] [instance: a8976a74-703a-4fa4-9cc7-760a3e3f226b] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:50:14.611507 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-21d84897-e626-4646-b9c4-7c846674a5a4 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:14.612169 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-21d84897-e626-4646-b9c4-7c846674a5a4 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:14.612658 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-21d84897-e626-4646-b9c4-7c846674a5a4 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:14.613384 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-ac853f0f-1730-4794-8741-a83c5afe768a tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] 10.222.0.36 "GET /compute/v2.1/servers/bbd01fa3-108f-4365-b722-b2a0af32983b" status: 200 len: 1210 microversion: 2.1 time: 0.096412 Oct 15 13:50:14.613534 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-21d84897-e626-4646-b9c4-7c846674a5a4 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:14.613945 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-21d84897-e626-4646-b9c4-7c846674a5a4 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:14.614420 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 97/202] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:50:14 2022] GET /compute/v2.1/servers/bbd01fa3-108f-4365-b722-b2a0af32983b => generated 1210 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:50:14.614569 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-21d84897-e626-4646-b9c4-7c846674a5a4 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:14.795630 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-21d84897-e626-4646-b9c4-7c846674a5a4 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5150c06020594efe957359f641eba5da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a0813bae074cd2aa552be82abe8493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:50:14.807817 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-21d84897-e626-4646-b9c4-7c846674a5a4 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] 10.222.0.36 "GET /compute/v2.1/servers/a8976a74-703a-4fa4-9cc7-760a3e3f226b" status: 200 len: 1521 microversion: 2.1 time: 0.208411 Oct 15 13:50:14.818572 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 106/203] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:50:14 2022] GET /compute/v2.1/servers/a8976a74-703a-4fa4-9cc7-760a3e3f226b => generated 1521 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 13:50:15.287281 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-fa834881-6b76-40aa-b7b0-84b0512a9848 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:50:15.288018 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-fa834881-6b76-40aa-b7b0-84b0512a9848 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 5fc359cf-ff2c-4189-b058-31eb3c97568c] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:50:15.296078 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-fa834881-6b76-40aa-b7b0-84b0512a9848 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:15.296679 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-fa834881-6b76-40aa-b7b0-84b0512a9848 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:15.297119 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-fa834881-6b76-40aa-b7b0-84b0512a9848 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:15.297863 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-fa834881-6b76-40aa-b7b0-84b0512a9848 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:15.298436 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-fa834881-6b76-40aa-b7b0-84b0512a9848 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:15.298922 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-fa834881-6b76-40aa-b7b0-84b0512a9848 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:15.478069 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-fa834881-6b76-40aa-b7b0-84b0512a9848 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:50:15.494165 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-fa834881-6b76-40aa-b7b0-84b0512a9848 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:50:15.495765 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-fa834881-6b76-40aa-b7b0-84b0512a9848 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:50:15.497468 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-fa834881-6b76-40aa-b7b0-84b0512a9848 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c" status: 200 len: 1406 microversion: 2.20 time: 0.214694 Oct 15 13:50:15.498249 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 98/204] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:50:15 2022] GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c => generated 1406 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 13:50:15.649589 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-3bd512c9-d70e-4fbc-b82a-23cd264bcb46 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:50:15.650630 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-3bd512c9-d70e-4fbc-b82a-23cd264bcb46 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] [instance: bbd01fa3-108f-4365-b722-b2a0af32983b] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:50:15.658005 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-3bd512c9-d70e-4fbc-b82a-23cd264bcb46 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:15.658741 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-3bd512c9-d70e-4fbc-b82a-23cd264bcb46 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:15.659471 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-3bd512c9-d70e-4fbc-b82a-23cd264bcb46 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:15.660690 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-3bd512c9-d70e-4fbc-b82a-23cd264bcb46 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:15.661311 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-3bd512c9-d70e-4fbc-b82a-23cd264bcb46 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:15.662046 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-3bd512c9-d70e-4fbc-b82a-23cd264bcb46 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:15.728356 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-3bd512c9-d70e-4fbc-b82a-23cd264bcb46 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af1daddbc1b84ab79f269e124cbea4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b58d317ad84e46be85ed15b3e51c2f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:50:15.737321 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-3bd512c9-d70e-4fbc-b82a-23cd264bcb46 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] 10.222.0.36 "GET /compute/v2.1/servers/bbd01fa3-108f-4365-b722-b2a0af32983b" status: 200 len: 1266 microversion: 2.1 time: 0.091744 Oct 15 13:50:15.737911 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 107/205] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:50:15 2022] GET /compute/v2.1/servers/bbd01fa3-108f-4365-b722-b2a0af32983b => generated 1266 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:50:15.835490 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-9c352b92-2ce0-4330-a302-572ea59277e2 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:50:15.836182 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-9c352b92-2ce0-4330-a302-572ea59277e2 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] [instance: a8976a74-703a-4fa4-9cc7-760a3e3f226b] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:50:15.843585 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-9c352b92-2ce0-4330-a302-572ea59277e2 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:15.844105 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-9c352b92-2ce0-4330-a302-572ea59277e2 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:15.844542 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-9c352b92-2ce0-4330-a302-572ea59277e2 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:15.845279 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-9c352b92-2ce0-4330-a302-572ea59277e2 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:15.845728 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-9c352b92-2ce0-4330-a302-572ea59277e2 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:15.846154 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-9c352b92-2ce0-4330-a302-572ea59277e2 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:16.016150 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-9c352b92-2ce0-4330-a302-572ea59277e2 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5150c06020594efe957359f641eba5da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a0813bae074cd2aa552be82abe8493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:50:16.024932 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-9c352b92-2ce0-4330-a302-572ea59277e2 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] 10.222.0.36 "GET /compute/v2.1/servers/a8976a74-703a-4fa4-9cc7-760a3e3f226b" status: 200 len: 1521 microversion: 2.1 time: 0.193377 Oct 15 13:50:16.025530 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 99/206] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:50:15 2022] GET /compute/v2.1/servers/a8976a74-703a-4fa4-9cc7-760a3e3f226b => generated 1521 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 13:50:16.539084 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-461c988e-c405-4f2a-8069-a4ed8650f871 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:50:16.539687 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-461c988e-c405-4f2a-8069-a4ed8650f871 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 5fc359cf-ff2c-4189-b058-31eb3c97568c] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:50:16.547692 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-461c988e-c405-4f2a-8069-a4ed8650f871 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:16.548208 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-461c988e-c405-4f2a-8069-a4ed8650f871 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:16.548647 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-461c988e-c405-4f2a-8069-a4ed8650f871 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:16.549364 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-461c988e-c405-4f2a-8069-a4ed8650f871 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:16.549831 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-461c988e-c405-4f2a-8069-a4ed8650f871 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:16.550287 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-461c988e-c405-4f2a-8069-a4ed8650f871 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:16.722768 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-461c988e-c405-4f2a-8069-a4ed8650f871 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:50:16.732628 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-461c988e-c405-4f2a-8069-a4ed8650f871 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:50:16.734193 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-461c988e-c405-4f2a-8069-a4ed8650f871 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:50:16.735378 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-461c988e-c405-4f2a-8069-a4ed8650f871 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c" status: 200 len: 1406 microversion: 2.20 time: 0.200411 Oct 15 13:50:16.735956 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 108/207] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:50:16 2022] GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c => generated 1406 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 13:50:16.761935 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-64be75ea-40fe-43c1-a13c-80105e20d247 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:50:16.762445 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-64be75ea-40fe-43c1-a13c-80105e20d247 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] [instance: bbd01fa3-108f-4365-b722-b2a0af32983b] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:50:16.769489 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-64be75ea-40fe-43c1-a13c-80105e20d247 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:16.769977 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-64be75ea-40fe-43c1-a13c-80105e20d247 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:16.770409 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-64be75ea-40fe-43c1-a13c-80105e20d247 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:16.771110 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-64be75ea-40fe-43c1-a13c-80105e20d247 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:16.771556 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-64be75ea-40fe-43c1-a13c-80105e20d247 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:16.772016 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-64be75ea-40fe-43c1-a13c-80105e20d247 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:16.846611 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-64be75ea-40fe-43c1-a13c-80105e20d247 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af1daddbc1b84ab79f269e124cbea4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b58d317ad84e46be85ed15b3e51c2f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:50:16.857219 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-64be75ea-40fe-43c1-a13c-80105e20d247 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] 10.222.0.36 "GET /compute/v2.1/servers/bbd01fa3-108f-4365-b722-b2a0af32983b" status: 200 len: 1266 microversion: 2.1 time: 0.098849 Oct 15 13:50:16.857941 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 100/208] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:50:16 2022] GET /compute/v2.1/servers/bbd01fa3-108f-4365-b722-b2a0af32983b => generated 1266 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:50:17.055105 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-bc909fc1-8134-41ea-9dc6-3f5e8c75a8fa tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:50:17.055714 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-bc909fc1-8134-41ea-9dc6-3f5e8c75a8fa tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] [instance: a8976a74-703a-4fa4-9cc7-760a3e3f226b] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:50:17.063074 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-bc909fc1-8134-41ea-9dc6-3f5e8c75a8fa tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:17.063862 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-bc909fc1-8134-41ea-9dc6-3f5e8c75a8fa tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:17.064328 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-bc909fc1-8134-41ea-9dc6-3f5e8c75a8fa tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:17.065032 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-bc909fc1-8134-41ea-9dc6-3f5e8c75a8fa tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:17.065475 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-bc909fc1-8134-41ea-9dc6-3f5e8c75a8fa tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:17.065875 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-bc909fc1-8134-41ea-9dc6-3f5e8c75a8fa tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:17.231782 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-bc909fc1-8134-41ea-9dc6-3f5e8c75a8fa tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5150c06020594efe957359f641eba5da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a0813bae074cd2aa552be82abe8493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:50:17.241096 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-bc909fc1-8134-41ea-9dc6-3f5e8c75a8fa tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] 10.222.0.36 "GET /compute/v2.1/servers/a8976a74-703a-4fa4-9cc7-760a3e3f226b" status: 200 len: 1521 microversion: 2.1 time: 0.189868 Oct 15 13:50:17.241697 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 109/209] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:50:17 2022] GET /compute/v2.1/servers/a8976a74-703a-4fa4-9cc7-760a3e3f226b => generated 1521 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:50:17.777164 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-acf4a655-7419-49de-80b4-632ed7607fac tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:50:17.777801 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-acf4a655-7419-49de-80b4-632ed7607fac tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 5fc359cf-ff2c-4189-b058-31eb3c97568c] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:50:17.785209 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-acf4a655-7419-49de-80b4-632ed7607fac tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:17.785603 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-acf4a655-7419-49de-80b4-632ed7607fac tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:17.786029 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-acf4a655-7419-49de-80b4-632ed7607fac tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:17.786748 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-acf4a655-7419-49de-80b4-632ed7607fac tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:17.787218 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-acf4a655-7419-49de-80b4-632ed7607fac tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:17.787595 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-acf4a655-7419-49de-80b4-632ed7607fac tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:17.885465 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-ffb48f2e-a5ad-42d1-a71c-9197b2359a84 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:50:17.886478 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-ffb48f2e-a5ad-42d1-a71c-9197b2359a84 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] [instance: bbd01fa3-108f-4365-b722-b2a0af32983b] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:50:17.896703 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-ffb48f2e-a5ad-42d1-a71c-9197b2359a84 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:17.897579 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-ffb48f2e-a5ad-42d1-a71c-9197b2359a84 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:17.898319 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-ffb48f2e-a5ad-42d1-a71c-9197b2359a84 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:17.899943 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-ffb48f2e-a5ad-42d1-a71c-9197b2359a84 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:17.900745 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-ffb48f2e-a5ad-42d1-a71c-9197b2359a84 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:17.901483 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-ffb48f2e-a5ad-42d1-a71c-9197b2359a84 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:17.971976 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-acf4a655-7419-49de-80b4-632ed7607fac tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:50:17.985268 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-acf4a655-7419-49de-80b4-632ed7607fac tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:50:17.988069 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-acf4a655-7419-49de-80b4-632ed7607fac tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:50:17.989985 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-ffb48f2e-a5ad-42d1-a71c-9197b2359a84 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af1daddbc1b84ab79f269e124cbea4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b58d317ad84e46be85ed15b3e51c2f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:50:17.990216 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-acf4a655-7419-49de-80b4-632ed7607fac tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c" status: 200 len: 1406 microversion: 2.20 time: 0.216787 Oct 15 13:50:17.991192 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 101/210] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:50:17 2022] GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c => generated 1406 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 13:50:17.999262 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-ffb48f2e-a5ad-42d1-a71c-9197b2359a84 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] 10.222.0.36 "GET /compute/v2.1/servers/bbd01fa3-108f-4365-b722-b2a0af32983b" status: 200 len: 1266 microversion: 2.1 time: 0.120685 Oct 15 13:50:17.999854 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 110/211] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:50:17 2022] GET /compute/v2.1/servers/bbd01fa3-108f-4365-b722-b2a0af32983b => generated 1266 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 13:50:18.266954 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-552679ec-9c23-46c7-9125-f1f807076959 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:50:18.267578 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-552679ec-9c23-46c7-9125-f1f807076959 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] [instance: a8976a74-703a-4fa4-9cc7-760a3e3f226b] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:50:18.274067 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-552679ec-9c23-46c7-9125-f1f807076959 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:18.274651 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-552679ec-9c23-46c7-9125-f1f807076959 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:18.275138 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-552679ec-9c23-46c7-9125-f1f807076959 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:18.275933 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-552679ec-9c23-46c7-9125-f1f807076959 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:18.276452 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-552679ec-9c23-46c7-9125-f1f807076959 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:18.276925 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-552679ec-9c23-46c7-9125-f1f807076959 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:18.446484 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-552679ec-9c23-46c7-9125-f1f807076959 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5150c06020594efe957359f641eba5da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a0813bae074cd2aa552be82abe8493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:50:18.457911 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-552679ec-9c23-46c7-9125-f1f807076959 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] 10.222.0.36 "GET /compute/v2.1/servers/a8976a74-703a-4fa4-9cc7-760a3e3f226b" status: 200 len: 1521 microversion: 2.1 time: 0.195593 Oct 15 13:50:18.458663 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 102/212] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:50:18 2022] GET /compute/v2.1/servers/a8976a74-703a-4fa4-9cc7-760a3e3f226b => generated 1521 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:50:19.018457 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-7e720f59-f1cd-4f51-a836-dd91bbc4c73e tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:50:19.019259 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-7e720f59-f1cd-4f51-a836-dd91bbc4c73e tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 5fc359cf-ff2c-4189-b058-31eb3c97568c] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:50:19.021445 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG dbcounter [-] [125243] Writing DB stats nova_cell0:SELECT=2 {{(pid=125243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:50:19.026725 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-f2a5be82-9d7e-46d1-8256-2f179da60006 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:50:19.027284 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-7e720f59-f1cd-4f51-a836-dd91bbc4c73e tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:19.027651 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-f2a5be82-9d7e-46d1-8256-2f179da60006 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] [instance: bbd01fa3-108f-4365-b722-b2a0af32983b] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:50:19.027767 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-7e720f59-f1cd-4f51-a836-dd91bbc4c73e tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:19.028141 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-7e720f59-f1cd-4f51-a836-dd91bbc4c73e tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:19.028907 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-7e720f59-f1cd-4f51-a836-dd91bbc4c73e tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:19.029351 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-7e720f59-f1cd-4f51-a836-dd91bbc4c73e tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:19.029776 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-7e720f59-f1cd-4f51-a836-dd91bbc4c73e tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:19.030529 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG dbcounter [-] [125242] Writing DB stats nova_cell0:SELECT=2 {{(pid=125242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:50:19.031343 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG dbcounter [-] [125242] Writing DB stats nova_cell0:SELECT=6 {{(pid=125242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:50:19.038908 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-f2a5be82-9d7e-46d1-8256-2f179da60006 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:19.039398 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-f2a5be82-9d7e-46d1-8256-2f179da60006 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:19.039842 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-f2a5be82-9d7e-46d1-8256-2f179da60006 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:19.040583 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-f2a5be82-9d7e-46d1-8256-2f179da60006 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:19.041028 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-f2a5be82-9d7e-46d1-8256-2f179da60006 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:19.041443 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-f2a5be82-9d7e-46d1-8256-2f179da60006 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:19.132173 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-f2a5be82-9d7e-46d1-8256-2f179da60006 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af1daddbc1b84ab79f269e124cbea4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b58d317ad84e46be85ed15b3e51c2f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:50:19.146582 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-f2a5be82-9d7e-46d1-8256-2f179da60006 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] 10.222.0.36 "GET /compute/v2.1/servers/bbd01fa3-108f-4365-b722-b2a0af32983b" status: 200 len: 1266 microversion: 2.1 time: 0.124053 Oct 15 13:50:19.147612 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 103/213] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:50:19 2022] GET /compute/v2.1/servers/bbd01fa3-108f-4365-b722-b2a0af32983b => generated 1266 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 13:50:19.224855 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-7e720f59-f1cd-4f51-a836-dd91bbc4c73e tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:50:19.234025 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-7e720f59-f1cd-4f51-a836-dd91bbc4c73e tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:50:19.235480 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-7e720f59-f1cd-4f51-a836-dd91bbc4c73e tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:50:19.236653 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-7e720f59-f1cd-4f51-a836-dd91bbc4c73e tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c" status: 200 len: 1406 microversion: 2.20 time: 0.222254 Oct 15 13:50:19.237229 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 111/214] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:50:19 2022] GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c => generated 1406 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 13:50:19.485029 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-6bc9e9e1-0969-43b1-8508-616985505387 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:50:19.485635 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-6bc9e9e1-0969-43b1-8508-616985505387 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] [instance: a8976a74-703a-4fa4-9cc7-760a3e3f226b] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:50:19.492592 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-6bc9e9e1-0969-43b1-8508-616985505387 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:19.493122 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-6bc9e9e1-0969-43b1-8508-616985505387 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:19.493566 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-6bc9e9e1-0969-43b1-8508-616985505387 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:19.494285 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-6bc9e9e1-0969-43b1-8508-616985505387 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:19.494718 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-6bc9e9e1-0969-43b1-8508-616985505387 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:19.495130 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-6bc9e9e1-0969-43b1-8508-616985505387 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:19.651222 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-6bc9e9e1-0969-43b1-8508-616985505387 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5150c06020594efe957359f641eba5da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a0813bae074cd2aa552be82abe8493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:50:19.660415 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-6bc9e9e1-0969-43b1-8508-616985505387 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] 10.222.0.36 "GET /compute/v2.1/servers/a8976a74-703a-4fa4-9cc7-760a3e3f226b" status: 200 len: 1521 microversion: 2.1 time: 0.179269 Oct 15 13:50:19.660971 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 104/215] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:50:19 2022] GET /compute/v2.1/servers/a8976a74-703a-4fa4-9cc7-760a3e3f226b => generated 1521 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:50:20.175455 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-2a726171-9e2d-4786-8d7c-afc6a74f5b2b tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:50:20.176038 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-2a726171-9e2d-4786-8d7c-afc6a74f5b2b tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] [instance: bbd01fa3-108f-4365-b722-b2a0af32983b] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:50:20.182625 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-2a726171-9e2d-4786-8d7c-afc6a74f5b2b tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:20.182952 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-2a726171-9e2d-4786-8d7c-afc6a74f5b2b tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:20.183498 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-2a726171-9e2d-4786-8d7c-afc6a74f5b2b tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:20.184115 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-2a726171-9e2d-4786-8d7c-afc6a74f5b2b tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:20.184682 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-2a726171-9e2d-4786-8d7c-afc6a74f5b2b tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:20.185109 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-2a726171-9e2d-4786-8d7c-afc6a74f5b2b tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:20.254421 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-2a726171-9e2d-4786-8d7c-afc6a74f5b2b tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af1daddbc1b84ab79f269e124cbea4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b58d317ad84e46be85ed15b3e51c2f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:50:20.268182 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-2a726171-9e2d-4786-8d7c-afc6a74f5b2b tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] 10.222.0.36 "GET /compute/v2.1/servers/bbd01fa3-108f-4365-b722-b2a0af32983b" status: 200 len: 1266 microversion: 2.1 time: 0.096484 Oct 15 13:50:20.270060 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 112/216] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:50:20 2022] GET /compute/v2.1/servers/bbd01fa3-108f-4365-b722-b2a0af32983b => generated 1266 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:50:20.272591 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-3669ddd4-a118-4902-b07d-0e4a972fa5ff tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:50:20.273789 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-3669ddd4-a118-4902-b07d-0e4a972fa5ff tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 5fc359cf-ff2c-4189-b058-31eb3c97568c] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:50:20.284607 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-3669ddd4-a118-4902-b07d-0e4a972fa5ff tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:20.285518 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-3669ddd4-a118-4902-b07d-0e4a972fa5ff tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:20.286106 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-3669ddd4-a118-4902-b07d-0e4a972fa5ff tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:20.287031 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-3669ddd4-a118-4902-b07d-0e4a972fa5ff tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:20.287581 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-3669ddd4-a118-4902-b07d-0e4a972fa5ff tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:20.288126 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-3669ddd4-a118-4902-b07d-0e4a972fa5ff tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:20.443960 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-3669ddd4-a118-4902-b07d-0e4a972fa5ff tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:50:20.453323 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-3669ddd4-a118-4902-b07d-0e4a972fa5ff tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:50:20.454807 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-3669ddd4-a118-4902-b07d-0e4a972fa5ff tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:50:20.455979 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-3669ddd4-a118-4902-b07d-0e4a972fa5ff tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c" status: 200 len: 1406 microversion: 2.20 time: 0.191054 Oct 15 13:50:20.456551 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 105/217] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:50:20 2022] GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c => generated 1406 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 15 13:50:20.685789 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-c6f093af-6efe-45e4-916f-9f1b70df78ae tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:50:20.686404 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-c6f093af-6efe-45e4-916f-9f1b70df78ae tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] [instance: a8976a74-703a-4fa4-9cc7-760a3e3f226b] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:50:20.693370 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-c6f093af-6efe-45e4-916f-9f1b70df78ae tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:20.693774 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-c6f093af-6efe-45e4-916f-9f1b70df78ae tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:20.694205 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-c6f093af-6efe-45e4-916f-9f1b70df78ae tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:20.694915 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-c6f093af-6efe-45e4-916f-9f1b70df78ae tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:20.695362 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-c6f093af-6efe-45e4-916f-9f1b70df78ae tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:20.695791 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-c6f093af-6efe-45e4-916f-9f1b70df78ae tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:20.854201 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-c6f093af-6efe-45e4-916f-9f1b70df78ae tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5150c06020594efe957359f641eba5da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a0813bae074cd2aa552be82abe8493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:50:20.863130 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-c6f093af-6efe-45e4-916f-9f1b70df78ae tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] 10.222.0.36 "GET /compute/v2.1/servers/a8976a74-703a-4fa4-9cc7-760a3e3f226b" status: 200 len: 1521 microversion: 2.1 time: 0.181758 Oct 15 13:50:20.863705 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 113/218] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:50:20 2022] GET /compute/v2.1/servers/a8976a74-703a-4fa4-9cc7-760a3e3f226b => generated 1521 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:50:21.292237 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-143858a3-d770-4389-a22b-fd55692a2490 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:50:21.293167 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-143858a3-d770-4389-a22b-fd55692a2490 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] [instance: bbd01fa3-108f-4365-b722-b2a0af32983b] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:50:21.300850 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-143858a3-d770-4389-a22b-fd55692a2490 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:21.301306 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-143858a3-d770-4389-a22b-fd55692a2490 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:21.302125 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-143858a3-d770-4389-a22b-fd55692a2490 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:21.303243 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-143858a3-d770-4389-a22b-fd55692a2490 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:21.304108 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-143858a3-d770-4389-a22b-fd55692a2490 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:21.304916 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-143858a3-d770-4389-a22b-fd55692a2490 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:21.465439 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-143858a3-d770-4389-a22b-fd55692a2490 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af1daddbc1b84ab79f269e124cbea4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b58d317ad84e46be85ed15b3e51c2f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:50:21.482650 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-cfd460c7-3d97-4098-806f-80f5b6d368e7 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:50:21.484113 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-cfd460c7-3d97-4098-806f-80f5b6d368e7 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 5fc359cf-ff2c-4189-b058-31eb3c97568c] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:50:21.485327 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-143858a3-d770-4389-a22b-fd55692a2490 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] 10.222.0.36 "GET /compute/v2.1/servers/bbd01fa3-108f-4365-b722-b2a0af32983b" status: 200 len: 1266 microversion: 2.1 time: 0.196430 Oct 15 13:50:21.486405 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 106/219] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:50:21 2022] GET /compute/v2.1/servers/bbd01fa3-108f-4365-b722-b2a0af32983b => generated 1266 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 13:50:21.490717 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-cfd460c7-3d97-4098-806f-80f5b6d368e7 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:21.491492 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-cfd460c7-3d97-4098-806f-80f5b6d368e7 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:21.491947 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-cfd460c7-3d97-4098-806f-80f5b6d368e7 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:21.492860 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-cfd460c7-3d97-4098-806f-80f5b6d368e7 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:21.493477 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-cfd460c7-3d97-4098-806f-80f5b6d368e7 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:21.494048 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-cfd460c7-3d97-4098-806f-80f5b6d368e7 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:21.695347 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-cfd460c7-3d97-4098-806f-80f5b6d368e7 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:50:21.714097 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-cfd460c7-3d97-4098-806f-80f5b6d368e7 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:50:21.718079 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-cfd460c7-3d97-4098-806f-80f5b6d368e7 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:50:21.720747 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-cfd460c7-3d97-4098-806f-80f5b6d368e7 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c" status: 200 len: 1598 microversion: 2.20 time: 0.243114 Oct 15 13:50:21.722009 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 114/220] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:50:21 2022] GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c => generated 1598 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 15 13:50:21.771088 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-9fe74bbb-a32a-4043-b69e-2e51905bba84 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:50:21.772014 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-9fe74bbb-a32a-4043-b69e-2e51905bba84 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 5fc359cf-ff2c-4189-b058-31eb3c97568c] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:50:21.783896 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-9fe74bbb-a32a-4043-b69e-2e51905bba84 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:21.784746 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-9fe74bbb-a32a-4043-b69e-2e51905bba84 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:21.785492 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-9fe74bbb-a32a-4043-b69e-2e51905bba84 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:21.786666 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-9fe74bbb-a32a-4043-b69e-2e51905bba84 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:21.787473 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-9fe74bbb-a32a-4043-b69e-2e51905bba84 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:21.788313 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-9fe74bbb-a32a-4043-b69e-2e51905bba84 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:21.887236 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-d1701f0a-170d-4221-ab9e-0fc8fe832c7d tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:50:21.888924 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-d1701f0a-170d-4221-ab9e-0fc8fe832c7d tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] [instance: a8976a74-703a-4fa4-9cc7-760a3e3f226b] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:50:21.899956 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-d1701f0a-170d-4221-ab9e-0fc8fe832c7d tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:21.901939 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-d1701f0a-170d-4221-ab9e-0fc8fe832c7d tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:21.902385 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-d1701f0a-170d-4221-ab9e-0fc8fe832c7d tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:21.904037 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-d1701f0a-170d-4221-ab9e-0fc8fe832c7d tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:21.904037 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-d1701f0a-170d-4221-ab9e-0fc8fe832c7d tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:21.904858 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-d1701f0a-170d-4221-ab9e-0fc8fe832c7d tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:21.940666 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-9fe74bbb-a32a-4043-b69e-2e51905bba84 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.176560 Oct 15 13:50:21.941869 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 107/221] 10.222.0.36 () {60 vars in 1316 bytes} [Sat Oct 15 13:50:21 2022] GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c/os-interface => generated 284 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 13:50:22.136968 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-d1701f0a-170d-4221-ab9e-0fc8fe832c7d tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5150c06020594efe957359f641eba5da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a0813bae074cd2aa552be82abe8493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:50:22.150522 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-d1701f0a-170d-4221-ab9e-0fc8fe832c7d tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] 10.222.0.36 "GET /compute/v2.1/servers/a8976a74-703a-4fa4-9cc7-760a3e3f226b" status: 200 len: 1521 microversion: 2.1 time: 0.267565 Oct 15 13:50:22.151637 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 115/222] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:50:21 2022] GET /compute/v2.1/servers/a8976a74-703a-4fa4-9cc7-760a3e3f226b => generated 1521 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 13:50:22.516933 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-a8bc6f2e-6593-4608-a2da-8ad059e0636d tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:50:22.518824 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-a8bc6f2e-6593-4608-a2da-8ad059e0636d tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] [instance: bbd01fa3-108f-4365-b722-b2a0af32983b] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:50:22.528068 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-a8bc6f2e-6593-4608-a2da-8ad059e0636d tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:22.529545 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-a8bc6f2e-6593-4608-a2da-8ad059e0636d tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:22.530661 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-a8bc6f2e-6593-4608-a2da-8ad059e0636d tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:22.533271 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-a8bc6f2e-6593-4608-a2da-8ad059e0636d tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:22.535030 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-a8bc6f2e-6593-4608-a2da-8ad059e0636d tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:22.536280 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-a8bc6f2e-6593-4608-a2da-8ad059e0636d tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:22.615606 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-a8bc6f2e-6593-4608-a2da-8ad059e0636d tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af1daddbc1b84ab79f269e124cbea4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b58d317ad84e46be85ed15b3e51c2f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:50:22.630418 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-a8bc6f2e-6593-4608-a2da-8ad059e0636d tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] 10.222.0.36 "GET /compute/v2.1/servers/bbd01fa3-108f-4365-b722-b2a0af32983b" status: 200 len: 1266 microversion: 2.1 time: 0.120948 Oct 15 13:50:22.632381 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 108/223] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:50:22 2022] GET /compute/v2.1/servers/bbd01fa3-108f-4365-b722-b2a0af32983b => generated 1266 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:50:23.186713 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-877f411d-4368-4afa-96cd-99a2d03b37ed tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:50:23.188969 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-877f411d-4368-4afa-96cd-99a2d03b37ed tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] [instance: a8976a74-703a-4fa4-9cc7-760a3e3f226b] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:50:23.201143 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG dbcounter [-] [125243] Writing DB stats nova_api:SELECT=76 {{(pid=125243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:50:23.209644 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-877f411d-4368-4afa-96cd-99a2d03b37ed tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:23.210777 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-877f411d-4368-4afa-96cd-99a2d03b37ed tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:23.211620 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-877f411d-4368-4afa-96cd-99a2d03b37ed tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:23.213843 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-877f411d-4368-4afa-96cd-99a2d03b37ed tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:23.215253 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-877f411d-4368-4afa-96cd-99a2d03b37ed tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:23.216160 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-877f411d-4368-4afa-96cd-99a2d03b37ed tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:23.561096 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-877f411d-4368-4afa-96cd-99a2d03b37ed tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5150c06020594efe957359f641eba5da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a0813bae074cd2aa552be82abe8493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:50:23.612809 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-877f411d-4368-4afa-96cd-99a2d03b37ed tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] 10.222.0.36 "GET /compute/v2.1/servers/a8976a74-703a-4fa4-9cc7-760a3e3f226b" status: 200 len: 1521 microversion: 2.1 time: 0.439199 Oct 15 13:50:23.616770 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 116/224] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:50:23 2022] GET /compute/v2.1/servers/a8976a74-703a-4fa4-9cc7-760a3e3f226b => generated 1521 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 13:50:23.670616 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-1dd884d8-725a-4cf3-bc68-252b7c97b345 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:50:23.674046 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-1dd884d8-725a-4cf3-bc68-252b7c97b345 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] [instance: bbd01fa3-108f-4365-b722-b2a0af32983b] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:50:23.704191 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG dbcounter [-] [125242] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=3 {{(pid=125242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:50:23.705627 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-1dd884d8-725a-4cf3-bc68-252b7c97b345 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:23.708892 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-1dd884d8-725a-4cf3-bc68-252b7c97b345 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:23.710113 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-1dd884d8-725a-4cf3-bc68-252b7c97b345 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:23.712707 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-1dd884d8-725a-4cf3-bc68-252b7c97b345 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:23.715285 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-1dd884d8-725a-4cf3-bc68-252b7c97b345 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:23.716662 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-1dd884d8-725a-4cf3-bc68-252b7c97b345 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:23.882575 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-1dd884d8-725a-4cf3-bc68-252b7c97b345 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af1daddbc1b84ab79f269e124cbea4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b58d317ad84e46be85ed15b3e51c2f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:50:23.899841 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-1dd884d8-725a-4cf3-bc68-252b7c97b345 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] 10.222.0.36 "GET /compute/v2.1/servers/bbd01fa3-108f-4365-b722-b2a0af32983b" status: 200 len: 1266 microversion: 2.1 time: 0.237617 Oct 15 13:50:23.913312 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 109/225] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:50:23 2022] GET /compute/v2.1/servers/bbd01fa3-108f-4365-b722-b2a0af32983b => generated 1266 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:50:24.035705 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [req-efe2292d-3949-44a3-bd4c-6c5400cce1ce req-dccd2adc-11fa-41a6-b959-6dd5cc735932 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5fc359cf-ff2c-4189-b058-31eb3c97568c", "tag": "5a131939-5800-4807-b2cc-42f66041598f"}]} {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 13:50:24.049752 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [req-efe2292d-3949-44a3-bd4c-6c5400cce1ce req-dccd2adc-11fa-41a6-b959-6dd5cc735932 service nova] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:24.050348 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [req-efe2292d-3949-44a3-bd4c-6c5400cce1ce req-dccd2adc-11fa-41a6-b959-6dd5cc735932 service nova] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:24.050892 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [req-efe2292d-3949-44a3-bd4c-6c5400cce1ce req-dccd2adc-11fa-41a6-b959-6dd5cc735932 service nova] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:24.067224 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.compute.server_external_events [req-efe2292d-3949-44a3-bd4c-6c5400cce1ce req-dccd2adc-11fa-41a6-b959-6dd5cc735932 service nova] Creating event network-changed:5a131939-5800-4807-b2cc-42f66041598f for instance 5fc359cf-ff2c-4189-b058-31eb3c97568c on hv-cinder-86149 Oct 15 13:50:24.073256 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [req-efe2292d-3949-44a3-bd4c-6c5400cce1ce req-dccd2adc-11fa-41a6-b959-6dd5cc735932 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041317 Oct 15 13:50:24.074170 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 117/226] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 15 13:50:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 13:50:24.659912 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-dbbe60f5-d810-4af0-b103-8468fd0959e6 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:50:24.660594 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-dbbe60f5-d810-4af0-b103-8468fd0959e6 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] [instance: a8976a74-703a-4fa4-9cc7-760a3e3f226b] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:50:24.678048 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-dbbe60f5-d810-4af0-b103-8468fd0959e6 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:24.681302 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-dbbe60f5-d810-4af0-b103-8468fd0959e6 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:24.682758 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-dbbe60f5-d810-4af0-b103-8468fd0959e6 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:24.686812 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-dbbe60f5-d810-4af0-b103-8468fd0959e6 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:24.689821 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-dbbe60f5-d810-4af0-b103-8468fd0959e6 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:24.691675 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-dbbe60f5-d810-4af0-b103-8468fd0959e6 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:24.939603 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-bb05c7a4-de00-43c9-86c4-9f49f5f95b38 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:50:24.940457 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-bb05c7a4-de00-43c9-86c4-9f49f5f95b38 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] [instance: bbd01fa3-108f-4365-b722-b2a0af32983b] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:50:24.949487 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-bb05c7a4-de00-43c9-86c4-9f49f5f95b38 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:24.950355 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-bb05c7a4-de00-43c9-86c4-9f49f5f95b38 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:24.950804 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-bb05c7a4-de00-43c9-86c4-9f49f5f95b38 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:24.951550 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-bb05c7a4-de00-43c9-86c4-9f49f5f95b38 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:24.952069 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-bb05c7a4-de00-43c9-86c4-9f49f5f95b38 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:24.952492 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-bb05c7a4-de00-43c9-86c4-9f49f5f95b38 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:25.271763 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-bb05c7a4-de00-43c9-86c4-9f49f5f95b38 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af1daddbc1b84ab79f269e124cbea4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b58d317ad84e46be85ed15b3e51c2f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:50:25.287591 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-bb05c7a4-de00-43c9-86c4-9f49f5f95b38 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] 10.222.0.36 "GET /compute/v2.1/servers/bbd01fa3-108f-4365-b722-b2a0af32983b" status: 200 len: 1266 microversion: 2.1 time: 0.350127 Oct 15 13:50:25.290044 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 118/227] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:50:24 2022] GET /compute/v2.1/servers/bbd01fa3-108f-4365-b722-b2a0af32983b => generated 1266 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 13:50:25.307040 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-b1798751-774f-4f7e-979d-d72c440c0a11 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:50:25.309476 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-b1798751-774f-4f7e-979d-d72c440c0a11 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] [instance: 8fb76141-70a4-4501-b928-7502a13c3cb4] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:50:25.332581 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-b1798751-774f-4f7e-979d-d72c440c0a11 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:25.333558 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-b1798751-774f-4f7e-979d-d72c440c0a11 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:25.334007 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-b1798751-774f-4f7e-979d-d72c440c0a11 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:25.334745 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-b1798751-774f-4f7e-979d-d72c440c0a11 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:25.335195 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-b1798751-774f-4f7e-979d-d72c440c0a11 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:25.339599 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-b1798751-774f-4f7e-979d-d72c440c0a11 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:25.423236 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-b1798751-774f-4f7e-979d-d72c440c0a11 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] [instance: 8fb76141-70a4-4501-b928-7502a13c3cb4] Going to try to terminate instance {{(pid=125243) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 15 13:50:25.578005 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-dbbe60f5-d810-4af0-b103-8468fd0959e6 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5150c06020594efe957359f641eba5da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a0813bae074cd2aa552be82abe8493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:50:25.596638 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-dbbe60f5-d810-4af0-b103-8468fd0959e6 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] 10.222.0.36 "GET /compute/v2.1/servers/a8976a74-703a-4fa4-9cc7-760a3e3f226b" status: 200 len: 1521 microversion: 2.1 time: 0.936129 Oct 15 13:50:25.597582 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 110/228] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:50:24 2022] GET /compute/v2.1/servers/a8976a74-703a-4fa4-9cc7-760a3e3f226b => generated 1521 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 13:50:25.677783 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-b1798751-774f-4f7e-979d-d72c440c0a11 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] 10.222.0.36 "DELETE /compute/v2.1/servers/8fb76141-70a4-4501-b928-7502a13c3cb4" status: 204 len: 0 microversion: 2.1 time: 0.384941 Oct 15 13:50:25.678824 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 119/229] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 15 13:50:25 2022] DELETE /compute/v2.1/servers/8fb76141-70a4-4501-b928-7502a13c3cb4 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 15 13:50:25.691517 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-ce2e8fb2-2e0d-4a4d-82ee-6d7bcdd4db52 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:50:25.694280 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-ce2e8fb2-2e0d-4a4d-82ee-6d7bcdd4db52 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] [instance: 8fb76141-70a4-4501-b928-7502a13c3cb4] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:50:25.702908 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-ce2e8fb2-2e0d-4a4d-82ee-6d7bcdd4db52 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:25.703702 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-ce2e8fb2-2e0d-4a4d-82ee-6d7bcdd4db52 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:25.704434 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-ce2e8fb2-2e0d-4a4d-82ee-6d7bcdd4db52 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:25.705591 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-ce2e8fb2-2e0d-4a4d-82ee-6d7bcdd4db52 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:25.706433 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-ce2e8fb2-2e0d-4a4d-82ee-6d7bcdd4db52 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:25.707757 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-ce2e8fb2-2e0d-4a4d-82ee-6d7bcdd4db52 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:25.736186 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG dbcounter [-] [125242] Writing DB stats nova_cell1:SELECT=100 {{(pid=125242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:50:25.992728 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-ce2e8fb2-2e0d-4a4d-82ee-6d7bcdd4db52 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc29734859a5460faee189b1726b50b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984a02b8dfd446879438d29b5efdd996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:50:26.009161 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-ce2e8fb2-2e0d-4a4d-82ee-6d7bcdd4db52 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] 10.222.0.36 "GET /compute/v2.1/servers/8fb76141-70a4-4501-b928-7502a13c3cb4" status: 200 len: 1554 microversion: 2.1 time: 0.320662 Oct 15 13:50:26.025888 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 111/230] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:50:25 2022] GET /compute/v2.1/servers/8fb76141-70a4-4501-b928-7502a13c3cb4 => generated 1554 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:50:26.343120 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-9f8e3734-6155-435b-ab34-d68a15cb2d3a tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:50:26.344200 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-9f8e3734-6155-435b-ab34-d68a15cb2d3a tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] [instance: bbd01fa3-108f-4365-b722-b2a0af32983b] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:50:26.353107 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-9f8e3734-6155-435b-ab34-d68a15cb2d3a tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:26.353926 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-9f8e3734-6155-435b-ab34-d68a15cb2d3a tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:26.354582 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-9f8e3734-6155-435b-ab34-d68a15cb2d3a tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:26.355477 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-9f8e3734-6155-435b-ab34-d68a15cb2d3a tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:26.356285 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-9f8e3734-6155-435b-ab34-d68a15cb2d3a tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:26.357433 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-9f8e3734-6155-435b-ab34-d68a15cb2d3a tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:26.631379 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-50545f4e-1ae7-4807-a225-cb472febfb67 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:50:26.636113 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-50545f4e-1ae7-4807-a225-cb472febfb67 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] [instance: a8976a74-703a-4fa4-9cc7-760a3e3f226b] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:50:26.652101 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-50545f4e-1ae7-4807-a225-cb472febfb67 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:26.652907 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-50545f4e-1ae7-4807-a225-cb472febfb67 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:26.654638 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-50545f4e-1ae7-4807-a225-cb472febfb67 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:26.655917 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-50545f4e-1ae7-4807-a225-cb472febfb67 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:26.658134 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-50545f4e-1ae7-4807-a225-cb472febfb67 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:26.659023 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-50545f4e-1ae7-4807-a225-cb472febfb67 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:26.865740 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-9f8e3734-6155-435b-ab34-d68a15cb2d3a tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af1daddbc1b84ab79f269e124cbea4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b58d317ad84e46be85ed15b3e51c2f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:50:26.881283 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-9f8e3734-6155-435b-ab34-d68a15cb2d3a tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] 10.222.0.36 "GET /compute/v2.1/servers/bbd01fa3-108f-4365-b722-b2a0af32983b" status: 200 len: 1314 microversion: 2.1 time: 0.542308 Oct 15 13:50:26.897580 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 120/231] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:50:26 2022] GET /compute/v2.1/servers/bbd01fa3-108f-4365-b722-b2a0af32983b => generated 1314 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:50:27.043676 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-6872c0e1-159e-49b0-a848-7cfcff4d4ae5 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:50:27.045404 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-6872c0e1-159e-49b0-a848-7cfcff4d4ae5 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] [instance: 8fb76141-70a4-4501-b928-7502a13c3cb4] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:50:27.056150 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-6872c0e1-159e-49b0-a848-7cfcff4d4ae5 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:27.057198 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-6872c0e1-159e-49b0-a848-7cfcff4d4ae5 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:27.058027 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-6872c0e1-159e-49b0-a848-7cfcff4d4ae5 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:27.058878 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-6872c0e1-159e-49b0-a848-7cfcff4d4ae5 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:27.059944 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-6872c0e1-159e-49b0-a848-7cfcff4d4ae5 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:27.060732 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-6872c0e1-159e-49b0-a848-7cfcff4d4ae5 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:27.070147 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG dbcounter [-] [125243] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:50:27.430789 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-50545f4e-1ae7-4807-a225-cb472febfb67 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5150c06020594efe957359f641eba5da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a0813bae074cd2aa552be82abe8493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:50:27.439646 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-50545f4e-1ae7-4807-a225-cb472febfb67 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] 10.222.0.36 "GET /compute/v2.1/servers/a8976a74-703a-4fa4-9cc7-760a3e3f226b" status: 200 len: 1521 microversion: 2.1 time: 0.818279 Oct 15 13:50:27.440568 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 112/232] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:50:26 2022] GET /compute/v2.1/servers/a8976a74-703a-4fa4-9cc7-760a3e3f226b => generated 1521 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:50:27.679598 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-6872c0e1-159e-49b0-a848-7cfcff4d4ae5 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc29734859a5460faee189b1726b50b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984a02b8dfd446879438d29b5efdd996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:50:27.708615 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-6872c0e1-159e-49b0-a848-7cfcff4d4ae5 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] 10.222.0.36 "GET /compute/v2.1/servers/8fb76141-70a4-4501-b928-7502a13c3cb4" status: 200 len: 1554 microversion: 2.1 time: 0.673308 Oct 15 13:50:27.710921 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 121/233] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:50:27 2022] GET /compute/v2.1/servers/8fb76141-70a4-4501-b928-7502a13c3cb4 => generated 1554 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:50:27.918047 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-6a666bec-803b-4001-91e9-bb4d41b828cc tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:50:27.921969 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-6a666bec-803b-4001-91e9-bb4d41b828cc tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] [instance: bbd01fa3-108f-4365-b722-b2a0af32983b] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:50:27.940092 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-6a666bec-803b-4001-91e9-bb4d41b828cc tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:27.943157 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-6a666bec-803b-4001-91e9-bb4d41b828cc tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:27.944272 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-6a666bec-803b-4001-91e9-bb4d41b828cc tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:27.946213 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-6a666bec-803b-4001-91e9-bb4d41b828cc tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:27.949145 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-6a666bec-803b-4001-91e9-bb4d41b828cc tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:27.950857 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-6a666bec-803b-4001-91e9-bb4d41b828cc tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:28.260638 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-6a666bec-803b-4001-91e9-bb4d41b828cc tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af1daddbc1b84ab79f269e124cbea4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b58d317ad84e46be85ed15b3e51c2f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:50:28.285125 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-6a666bec-803b-4001-91e9-bb4d41b828cc tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] 10.222.0.36 "GET /compute/v2.1/servers/bbd01fa3-108f-4365-b722-b2a0af32983b" status: 200 len: 1314 microversion: 2.1 time: 0.380941 Oct 15 13:50:28.286912 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 113/234] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:50:27 2022] GET /compute/v2.1/servers/bbd01fa3-108f-4365-b722-b2a0af32983b => generated 1314 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:50:28.480525 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-498bd0ac-63a3-4335-8f47-99922d1a7d92 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:50:28.482185 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-498bd0ac-63a3-4335-8f47-99922d1a7d92 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] [instance: a8976a74-703a-4fa4-9cc7-760a3e3f226b] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:50:28.503244 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-498bd0ac-63a3-4335-8f47-99922d1a7d92 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:28.512794 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-498bd0ac-63a3-4335-8f47-99922d1a7d92 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:28.513958 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-498bd0ac-63a3-4335-8f47-99922d1a7d92 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:28.521059 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-498bd0ac-63a3-4335-8f47-99922d1a7d92 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:28.522418 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-498bd0ac-63a3-4335-8f47-99922d1a7d92 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:28.523451 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-498bd0ac-63a3-4335-8f47-99922d1a7d92 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:28.754916 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-2c8a0fdf-b395-4bc8-a1fc-ede9cb7547f3 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:50:28.756301 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-2c8a0fdf-b395-4bc8-a1fc-ede9cb7547f3 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] [instance: 8fb76141-70a4-4501-b928-7502a13c3cb4] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:50:28.768779 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-2c8a0fdf-b395-4bc8-a1fc-ede9cb7547f3 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:28.769718 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-2c8a0fdf-b395-4bc8-a1fc-ede9cb7547f3 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:28.770653 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-2c8a0fdf-b395-4bc8-a1fc-ede9cb7547f3 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:28.772051 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-2c8a0fdf-b395-4bc8-a1fc-ede9cb7547f3 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:28.772834 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-2c8a0fdf-b395-4bc8-a1fc-ede9cb7547f3 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:28.773907 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-2c8a0fdf-b395-4bc8-a1fc-ede9cb7547f3 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:29.020309 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-498bd0ac-63a3-4335-8f47-99922d1a7d92 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5150c06020594efe957359f641eba5da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a0813bae074cd2aa552be82abe8493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:50:29.032930 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-498bd0ac-63a3-4335-8f47-99922d1a7d92 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] 10.222.0.36 "GET /compute/v2.1/servers/a8976a74-703a-4fa4-9cc7-760a3e3f226b" status: 200 len: 1521 microversion: 2.1 time: 0.559442 Oct 15 13:50:29.061657 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 122/235] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:50:28 2022] GET /compute/v2.1/servers/a8976a74-703a-4fa4-9cc7-760a3e3f226b => generated 1521 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:50:29.073696 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [req-59d25612-9619-4302-82b5-ccc904398ae7 req-a8b8de86-d091-4648-9476-fe29ac000580 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bbd01fa3-108f-4365-b722-b2a0af32983b", "tag": "8383672e-6343-4633-a903-42e13011e626"}]} {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 13:50:29.089353 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [req-59d25612-9619-4302-82b5-ccc904398ae7 req-a8b8de86-d091-4648-9476-fe29ac000580 service nova] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:29.091798 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [req-59d25612-9619-4302-82b5-ccc904398ae7 req-a8b8de86-d091-4648-9476-fe29ac000580 service nova] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:29.093083 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [req-59d25612-9619-4302-82b5-ccc904398ae7 req-a8b8de86-d091-4648-9476-fe29ac000580 service nova] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:29.110304 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.compute.server_external_events [req-59d25612-9619-4302-82b5-ccc904398ae7 req-a8b8de86-d091-4648-9476-fe29ac000580 service nova] Creating event network-changed:8383672e-6343-4633-a903-42e13011e626 for instance bbd01fa3-108f-4365-b722-b2a0af32983b on hv-cinder-86149 Oct 15 13:50:29.132506 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [req-59d25612-9619-4302-82b5-ccc904398ae7 req-a8b8de86-d091-4648-9476-fe29ac000580 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069098 Oct 15 13:50:29.133465 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 123/236] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 15 13:50:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 13:50:29.305564 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-2c8a0fdf-b395-4bc8-a1fc-ede9cb7547f3 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc29734859a5460faee189b1726b50b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984a02b8dfd446879438d29b5efdd996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:50:29.317363 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-4f2e43e8-4ef3-4cb8-8bba-448d8f176e12 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:50:29.318935 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-4f2e43e8-4ef3-4cb8-8bba-448d8f176e12 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] [instance: bbd01fa3-108f-4365-b722-b2a0af32983b] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:50:29.321196 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-2c8a0fdf-b395-4bc8-a1fc-ede9cb7547f3 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] 10.222.0.36 "GET /compute/v2.1/servers/8fb76141-70a4-4501-b928-7502a13c3cb4" status: 200 len: 1554 microversion: 2.1 time: 0.570671 Oct 15 13:50:29.330028 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-4f2e43e8-4ef3-4cb8-8bba-448d8f176e12 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:29.333416 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 114/237] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:50:28 2022] GET /compute/v2.1/servers/8fb76141-70a4-4501-b928-7502a13c3cb4 => generated 1554 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 13:50:29.333730 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-4f2e43e8-4ef3-4cb8-8bba-448d8f176e12 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:29.338392 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-4f2e43e8-4ef3-4cb8-8bba-448d8f176e12 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:29.341651 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-4f2e43e8-4ef3-4cb8-8bba-448d8f176e12 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:29.342395 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-4f2e43e8-4ef3-4cb8-8bba-448d8f176e12 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:29.343766 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-4f2e43e8-4ef3-4cb8-8bba-448d8f176e12 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:29.822012 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-4f2e43e8-4ef3-4cb8-8bba-448d8f176e12 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af1daddbc1b84ab79f269e124cbea4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b58d317ad84e46be85ed15b3e51c2f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:50:29.841137 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-4f2e43e8-4ef3-4cb8-8bba-448d8f176e12 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] 10.222.0.36 "GET /compute/v2.1/servers/bbd01fa3-108f-4365-b722-b2a0af32983b" status: 200 len: 1314 microversion: 2.1 time: 0.529544 Oct 15 13:50:29.842358 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 124/238] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:50:29 2022] GET /compute/v2.1/servers/bbd01fa3-108f-4365-b722-b2a0af32983b => generated 1314 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 13:50:30.057337 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-d91da119-4683-4d1b-a8c7-389ce007cad2 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:50:30.058712 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-d91da119-4683-4d1b-a8c7-389ce007cad2 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] [instance: a8976a74-703a-4fa4-9cc7-760a3e3f226b] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:50:30.074716 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-d91da119-4683-4d1b-a8c7-389ce007cad2 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:30.075755 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-d91da119-4683-4d1b-a8c7-389ce007cad2 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:30.076620 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-d91da119-4683-4d1b-a8c7-389ce007cad2 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:30.077907 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-d91da119-4683-4d1b-a8c7-389ce007cad2 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:30.079300 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-d91da119-4683-4d1b-a8c7-389ce007cad2 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:30.080118 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-d91da119-4683-4d1b-a8c7-389ce007cad2 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:30.350682 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-2d0eb78a-981f-469f-b00f-bc306d219cd0 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:50:30.351728 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-2d0eb78a-981f-469f-b00f-bc306d219cd0 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] [instance: 8fb76141-70a4-4501-b928-7502a13c3cb4] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:50:30.363356 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-2d0eb78a-981f-469f-b00f-bc306d219cd0 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:30.364126 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-2d0eb78a-981f-469f-b00f-bc306d219cd0 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:30.365248 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-2d0eb78a-981f-469f-b00f-bc306d219cd0 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:30.367757 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-2d0eb78a-981f-469f-b00f-bc306d219cd0 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:30.369645 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-2d0eb78a-981f-469f-b00f-bc306d219cd0 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:30.370191 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-2d0eb78a-981f-469f-b00f-bc306d219cd0 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:30.412544 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-d91da119-4683-4d1b-a8c7-389ce007cad2 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5150c06020594efe957359f641eba5da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a0813bae074cd2aa552be82abe8493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:50:30.424057 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-d91da119-4683-4d1b-a8c7-389ce007cad2 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] 10.222.0.36 "GET /compute/v2.1/servers/a8976a74-703a-4fa4-9cc7-760a3e3f226b" status: 200 len: 1501 microversion: 2.1 time: 0.370852 Oct 15 13:50:30.443160 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 115/239] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:50:30 2022] GET /compute/v2.1/servers/a8976a74-703a-4fa4-9cc7-760a3e3f226b => generated 1501 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:50:30.449679 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-e39204b3-762c-41ec-a08c-355feb0027d6 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:50:30.450823 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-e39204b3-762c-41ec-a08c-355feb0027d6 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] [instance: 242ed9b0-fe03-4583-ad2f-4760e86d2031] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:50:30.457728 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-e39204b3-762c-41ec-a08c-355feb0027d6 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:30.458496 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-e39204b3-762c-41ec-a08c-355feb0027d6 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:30.459128 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-e39204b3-762c-41ec-a08c-355feb0027d6 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:30.460106 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-e39204b3-762c-41ec-a08c-355feb0027d6 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:30.460794 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-e39204b3-762c-41ec-a08c-355feb0027d6 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:30.461425 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-e39204b3-762c-41ec-a08c-355feb0027d6 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:30.483671 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-2d0eb78a-981f-469f-b00f-bc306d219cd0 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc29734859a5460faee189b1726b50b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984a02b8dfd446879438d29b5efdd996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:50:30.504387 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-2d0eb78a-981f-469f-b00f-bc306d219cd0 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] 10.222.0.36 "GET /compute/v2.1/servers/8fb76141-70a4-4501-b928-7502a13c3cb4" status: 200 len: 1512 microversion: 2.1 time: 0.160605 Oct 15 13:50:30.522343 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 125/240] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:50:30 2022] GET /compute/v2.1/servers/8fb76141-70a4-4501-b928-7502a13c3cb4 => generated 1512 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:50:30.533309 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [req-60ff23ba-1dfe-4686-8552-80db1ca9a893 req-ba7dd360-a9f6-47db-a7fb-c6921dc3ef43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8fb76141-70a4-4501-b928-7502a13c3cb4", "name": "network-vif-deleted", "tag": "22d267b5-2636-4dae-87c7-578106faed38"}]} {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 13:50:30.557413 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [req-60ff23ba-1dfe-4686-8552-80db1ca9a893 req-ba7dd360-a9f6-47db-a7fb-c6921dc3ef43 service nova] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:30.557931 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [req-60ff23ba-1dfe-4686-8552-80db1ca9a893 req-ba7dd360-a9f6-47db-a7fb-c6921dc3ef43 service nova] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:30.558401 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [req-60ff23ba-1dfe-4686-8552-80db1ca9a893 req-ba7dd360-a9f6-47db-a7fb-c6921dc3ef43 service nova] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:30.572681 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.compute.server_external_events [req-60ff23ba-1dfe-4686-8552-80db1ca9a893 req-ba7dd360-a9f6-47db-a7fb-c6921dc3ef43 service nova] Creating event network-vif-deleted:22d267b5-2636-4dae-87c7-578106faed38 for instance 8fb76141-70a4-4501-b928-7502a13c3cb4 on hv-cinder-86149 Oct 15 13:50:30.578479 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [req-60ff23ba-1dfe-4686-8552-80db1ca9a893 req-ba7dd360-a9f6-47db-a7fb-c6921dc3ef43 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053292 Oct 15 13:50:30.579288 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 126/241] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 15 13:50:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 13:50:30.697784 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-e39204b3-762c-41ec-a08c-355feb0027d6 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5150c06020594efe957359f641eba5da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a0813bae074cd2aa552be82abe8493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:50:30.706710 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-e39204b3-762c-41ec-a08c-355feb0027d6 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] 10.222.0.36 "GET /compute/v2.1/servers/242ed9b0-fe03-4583-ad2f-4760e86d2031" status: 200 len: 1517 microversion: 2.1 time: 0.261801 Oct 15 13:50:30.707649 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 116/242] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:50:30 2022] GET /compute/v2.1/servers/242ed9b0-fe03-4583-ad2f-4760e86d2031 => generated 1517 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:50:30.881956 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-ed0f685f-f74f-4bcf-908a-768928430fa1 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:50:30.883027 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-ed0f685f-f74f-4bcf-908a-768928430fa1 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] [instance: bbd01fa3-108f-4365-b722-b2a0af32983b] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:50:30.893294 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-ed0f685f-f74f-4bcf-908a-768928430fa1 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:30.894188 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-ed0f685f-f74f-4bcf-908a-768928430fa1 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:30.894814 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-ed0f685f-f74f-4bcf-908a-768928430fa1 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:30.895706 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-ed0f685f-f74f-4bcf-908a-768928430fa1 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:30.896349 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-ed0f685f-f74f-4bcf-908a-768928430fa1 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:30.897482 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-ed0f685f-f74f-4bcf-908a-768928430fa1 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:31.084063 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-ed0f685f-f74f-4bcf-908a-768928430fa1 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af1daddbc1b84ab79f269e124cbea4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b58d317ad84e46be85ed15b3e51c2f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:50:31.103806 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-ed0f685f-f74f-4bcf-908a-768928430fa1 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] 10.222.0.36 "GET /compute/v2.1/servers/bbd01fa3-108f-4365-b722-b2a0af32983b" status: 200 len: 1314 microversion: 2.1 time: 0.232387 Oct 15 13:50:31.104521 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 127/243] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:50:30 2022] GET /compute/v2.1/servers/bbd01fa3-108f-4365-b722-b2a0af32983b => generated 1314 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 13:50:31.528412 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-58eb0064-5aed-45e4-b2b7-57cd44d26d6b tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:50:31.529927 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-58eb0064-5aed-45e4-b2b7-57cd44d26d6b tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] [instance: 8fb76141-70a4-4501-b928-7502a13c3cb4] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:50:31.538122 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-58eb0064-5aed-45e4-b2b7-57cd44d26d6b tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:31.539046 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-58eb0064-5aed-45e4-b2b7-57cd44d26d6b tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:31.539821 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-58eb0064-5aed-45e4-b2b7-57cd44d26d6b tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:31.548888 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-58eb0064-5aed-45e4-b2b7-57cd44d26d6b tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:31.549733 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-58eb0064-5aed-45e4-b2b7-57cd44d26d6b tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:31.551186 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-58eb0064-5aed-45e4-b2b7-57cd44d26d6b tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:31.661674 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-58eb0064-5aed-45e4-b2b7-57cd44d26d6b tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc29734859a5460faee189b1726b50b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984a02b8dfd446879438d29b5efdd996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:50:31.671483 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-58eb0064-5aed-45e4-b2b7-57cd44d26d6b tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] 10.222.0.36 "GET /compute/v2.1/servers/8fb76141-70a4-4501-b928-7502a13c3cb4" status: 200 len: 1512 microversion: 2.1 time: 0.148422 Oct 15 13:50:31.672536 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 117/244] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:50:31 2022] GET /compute/v2.1/servers/8fb76141-70a4-4501-b928-7502a13c3cb4 => generated 1512 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:50:32.130961 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-39cfcb1b-e2af-41d7-a934-eaac57638352 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:50:32.131710 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-39cfcb1b-e2af-41d7-a934-eaac57638352 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] [instance: bbd01fa3-108f-4365-b722-b2a0af32983b] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:50:32.137962 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-39cfcb1b-e2af-41d7-a934-eaac57638352 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:32.138483 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-39cfcb1b-e2af-41d7-a934-eaac57638352 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:32.138863 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-39cfcb1b-e2af-41d7-a934-eaac57638352 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:32.139790 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-39cfcb1b-e2af-41d7-a934-eaac57638352 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:32.140261 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-39cfcb1b-e2af-41d7-a934-eaac57638352 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:32.140679 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-39cfcb1b-e2af-41d7-a934-eaac57638352 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:32.316063 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-39cfcb1b-e2af-41d7-a934-eaac57638352 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af1daddbc1b84ab79f269e124cbea4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b58d317ad84e46be85ed15b3e51c2f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:50:32.330556 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-39cfcb1b-e2af-41d7-a934-eaac57638352 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] 10.222.0.36 "GET /compute/v2.1/servers/bbd01fa3-108f-4365-b722-b2a0af32983b" status: 200 len: 1314 microversion: 2.1 time: 0.203126 Oct 15 13:50:32.331759 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 128/245] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:50:32 2022] GET /compute/v2.1/servers/bbd01fa3-108f-4365-b722-b2a0af32983b => generated 1314 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:50:32.451539 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-daff537f-6980-41a3-99c1-9f6640a6b80b tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 13:50:32.453903 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-daff537f-6980-41a3-99c1-9f6640a6b80b tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] [instance: 242ed9b0-fe03-4583-ad2f-4760e86d2031] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:50:32.460134 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-daff537f-6980-41a3-99c1-9f6640a6b80b tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:32.460617 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-daff537f-6980-41a3-99c1-9f6640a6b80b tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:32.461044 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-daff537f-6980-41a3-99c1-9f6640a6b80b tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:32.461729 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-daff537f-6980-41a3-99c1-9f6640a6b80b tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:32.463255 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-daff537f-6980-41a3-99c1-9f6640a6b80b tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:32.463255 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-daff537f-6980-41a3-99c1-9f6640a6b80b tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:32.495025 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.objects.instance [None req-daff537f-6980-41a3-99c1-9f6640a6b80b tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lazy-loading 'flavor' on Instance uuid 242ed9b0-fe03-4583-ad2f-4760e86d2031 {{(pid=125242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 15 13:50:32.634768 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-daff537f-6980-41a3-99c1-9f6640a6b80b tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] 10.222.0.36 "POST /compute/v2.1/servers/242ed9b0-fe03-4583-ad2f-4760e86d2031/action" status: 200 len: 32 microversion: 2.1 time: 0.191222 Oct 15 13:50:32.635682 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 118/246] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 15 13:50:32 2022] POST /compute/v2.1/servers/242ed9b0-fe03-4583-ad2f-4760e86d2031/action => generated 32 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 15 13:50:32.646604 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-6e74852b-c3ba-4956-a4ea-7cf6cd152810 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:50:32.647265 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-6e74852b-c3ba-4956-a4ea-7cf6cd152810 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] [instance: 242ed9b0-fe03-4583-ad2f-4760e86d2031] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:50:32.653802 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-6e74852b-c3ba-4956-a4ea-7cf6cd152810 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:32.654441 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-6e74852b-c3ba-4956-a4ea-7cf6cd152810 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:32.654807 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-6e74852b-c3ba-4956-a4ea-7cf6cd152810 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:32.655512 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-6e74852b-c3ba-4956-a4ea-7cf6cd152810 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:32.655990 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-6e74852b-c3ba-4956-a4ea-7cf6cd152810 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:32.656415 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-6e74852b-c3ba-4956-a4ea-7cf6cd152810 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:32.698943 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-3becda5f-9992-43f2-8db5-8121bd8ba9e2 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:50:32.699650 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-3becda5f-9992-43f2-8db5-8121bd8ba9e2 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] [instance: 8fb76141-70a4-4501-b928-7502a13c3cb4] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:50:32.707989 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-3becda5f-9992-43f2-8db5-8121bd8ba9e2 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:32.708483 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-3becda5f-9992-43f2-8db5-8121bd8ba9e2 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:32.708920 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-3becda5f-9992-43f2-8db5-8121bd8ba9e2 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:32.709707 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-3becda5f-9992-43f2-8db5-8121bd8ba9e2 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:32.710168 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-3becda5f-9992-43f2-8db5-8121bd8ba9e2 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:32.710584 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-3becda5f-9992-43f2-8db5-8121bd8ba9e2 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:32.859040 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-3becda5f-9992-43f2-8db5-8121bd8ba9e2 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc29734859a5460faee189b1726b50b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984a02b8dfd446879438d29b5efdd996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:50:32.872633 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-3becda5f-9992-43f2-8db5-8121bd8ba9e2 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] 10.222.0.36 "GET /compute/v2.1/servers/8fb76141-70a4-4501-b928-7502a13c3cb4" status: 200 len: 1512 microversion: 2.1 time: 0.176768 Oct 15 13:50:32.878702 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 119/247] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:50:32 2022] GET /compute/v2.1/servers/8fb76141-70a4-4501-b928-7502a13c3cb4 => generated 1512 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 13:50:32.965262 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-6e74852b-c3ba-4956-a4ea-7cf6cd152810 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5150c06020594efe957359f641eba5da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a0813bae074cd2aa552be82abe8493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:50:32.975040 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-6e74852b-c3ba-4956-a4ea-7cf6cd152810 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] 10.222.0.36 "GET /compute/v2.1/servers/242ed9b0-fe03-4583-ad2f-4760e86d2031" status: 200 len: 1523 microversion: 2.1 time: 0.332836 Oct 15 13:50:32.975632 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 129/248] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:50:32 2022] GET /compute/v2.1/servers/242ed9b0-fe03-4583-ad2f-4760e86d2031 => generated 1523 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:50:33.369697 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-e1f5158e-f534-49ce-9cb3-19fd6f6ff656 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:50:33.370829 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-e1f5158e-f534-49ce-9cb3-19fd6f6ff656 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] [instance: bbd01fa3-108f-4365-b722-b2a0af32983b] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:50:33.378274 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-e1f5158e-f534-49ce-9cb3-19fd6f6ff656 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:33.379140 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-e1f5158e-f534-49ce-9cb3-19fd6f6ff656 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:33.379790 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-e1f5158e-f534-49ce-9cb3-19fd6f6ff656 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:33.380738 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-e1f5158e-f534-49ce-9cb3-19fd6f6ff656 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:33.381701 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-e1f5158e-f534-49ce-9cb3-19fd6f6ff656 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:33.382351 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-e1f5158e-f534-49ce-9cb3-19fd6f6ff656 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:33.672646 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-e1f5158e-f534-49ce-9cb3-19fd6f6ff656 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af1daddbc1b84ab79f269e124cbea4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b58d317ad84e46be85ed15b3e51c2f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:50:33.681863 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-e1f5158e-f534-49ce-9cb3-19fd6f6ff656 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] 10.222.0.36 "GET /compute/v2.1/servers/bbd01fa3-108f-4365-b722-b2a0af32983b" status: 200 len: 1314 microversion: 2.1 time: 0.316034 Oct 15 13:50:33.682447 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 120/249] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:50:33 2022] GET /compute/v2.1/servers/bbd01fa3-108f-4365-b722-b2a0af32983b => generated 1314 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:50:33.904573 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-9d548bac-4529-47ca-bd54-0087f4ca1091 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:50:33.905434 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-9d548bac-4529-47ca-bd54-0087f4ca1091 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] [instance: 8fb76141-70a4-4501-b928-7502a13c3cb4] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:50:33.914517 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-9d548bac-4529-47ca-bd54-0087f4ca1091 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:33.915135 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-9d548bac-4529-47ca-bd54-0087f4ca1091 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:33.915805 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-9d548bac-4529-47ca-bd54-0087f4ca1091 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:33.917207 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-9d548bac-4529-47ca-bd54-0087f4ca1091 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:33.918006 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-9d548bac-4529-47ca-bd54-0087f4ca1091 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:33.918655 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-9d548bac-4529-47ca-bd54-0087f4ca1091 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:33.959166 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-9d548bac-4529-47ca-bd54-0087f4ca1091 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:33.959704 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-9d548bac-4529-47ca-bd54-0087f4ca1091 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:33.960469 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-9d548bac-4529-47ca-bd54-0087f4ca1091 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:33.961098 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.objects.instance [None req-9d548bac-4529-47ca-bd54-0087f4ca1091 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lazy-loading 'fault' on Instance uuid 8fb76141-70a4-4501-b928-7502a13c3cb4 {{(pid=125243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 15 13:50:34.004755 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-47591e1f-fae1-4b55-acf7-a753ed99dec1 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:50:34.005672 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-47591e1f-fae1-4b55-acf7-a753ed99dec1 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] [instance: 242ed9b0-fe03-4583-ad2f-4760e86d2031] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:50:34.014700 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-47591e1f-fae1-4b55-acf7-a753ed99dec1 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:34.015657 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-47591e1f-fae1-4b55-acf7-a753ed99dec1 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:34.016817 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-47591e1f-fae1-4b55-acf7-a753ed99dec1 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:34.017557 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-47591e1f-fae1-4b55-acf7-a753ed99dec1 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:34.018504 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-47591e1f-fae1-4b55-acf7-a753ed99dec1 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:34.018947 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-47591e1f-fae1-4b55-acf7-a753ed99dec1 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:34.036191 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-9d548bac-4529-47ca-bd54-0087f4ca1091 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc29734859a5460faee189b1726b50b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984a02b8dfd446879438d29b5efdd996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:50:34.045817 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-9d548bac-4529-47ca-bd54-0087f4ca1091 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] 10.222.0.36 "GET /compute/v2.1/servers/8fb76141-70a4-4501-b928-7502a13c3cb4" status: 200 len: 1351 microversion: 2.1 time: 0.150984 Oct 15 13:50:34.047368 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 130/250] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:50:33 2022] GET /compute/v2.1/servers/8fb76141-70a4-4501-b928-7502a13c3cb4 => generated 1351 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:50:34.266772 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-47591e1f-fae1-4b55-acf7-a753ed99dec1 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5150c06020594efe957359f641eba5da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a0813bae074cd2aa552be82abe8493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:50:34.281391 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-47591e1f-fae1-4b55-acf7-a753ed99dec1 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] 10.222.0.36 "GET /compute/v2.1/servers/242ed9b0-fe03-4583-ad2f-4760e86d2031" status: 200 len: 1523 microversion: 2.1 time: 0.282418 Oct 15 13:50:34.282372 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 121/251] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:50:33 2022] GET /compute/v2.1/servers/242ed9b0-fe03-4583-ad2f-4760e86d2031 => generated 1523 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:50:34.715087 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-af11cb43-604a-4612-821b-52cd2e3a0391 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:50:34.715694 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-af11cb43-604a-4612-821b-52cd2e3a0391 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] [instance: bbd01fa3-108f-4365-b722-b2a0af32983b] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:50:34.722610 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-af11cb43-604a-4612-821b-52cd2e3a0391 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:34.723093 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-af11cb43-604a-4612-821b-52cd2e3a0391 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:34.723528 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-af11cb43-604a-4612-821b-52cd2e3a0391 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:34.724269 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-af11cb43-604a-4612-821b-52cd2e3a0391 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:34.724717 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-af11cb43-604a-4612-821b-52cd2e3a0391 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:34.725140 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-af11cb43-604a-4612-821b-52cd2e3a0391 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:34.873918 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-af11cb43-604a-4612-821b-52cd2e3a0391 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af1daddbc1b84ab79f269e124cbea4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b58d317ad84e46be85ed15b3e51c2f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:50:34.882050 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-af11cb43-604a-4612-821b-52cd2e3a0391 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] 10.222.0.36 "GET /compute/v2.1/servers/bbd01fa3-108f-4365-b722-b2a0af32983b" status: 200 len: 1314 microversion: 2.1 time: 0.170882 Oct 15 13:50:34.882706 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 131/252] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:50:34 2022] GET /compute/v2.1/servers/bbd01fa3-108f-4365-b722-b2a0af32983b => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:50:35.077076 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-6eb54541-332b-4c8a-89e5-b9c504497268 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:50:35.077729 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-6eb54541-332b-4c8a-89e5-b9c504497268 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] [instance: 8fb76141-70a4-4501-b928-7502a13c3cb4] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:50:35.085576 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-6eb54541-332b-4c8a-89e5-b9c504497268 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:35.086077 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-6eb54541-332b-4c8a-89e5-b9c504497268 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:35.086511 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-6eb54541-332b-4c8a-89e5-b9c504497268 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:35.087250 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-6eb54541-332b-4c8a-89e5-b9c504497268 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:35.087700 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-6eb54541-332b-4c8a-89e5-b9c504497268 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:35.088165 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-6eb54541-332b-4c8a-89e5-b9c504497268 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:35.125603 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-6eb54541-332b-4c8a-89e5-b9c504497268 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:35.126092 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-6eb54541-332b-4c8a-89e5-b9c504497268 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:35.126558 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-6eb54541-332b-4c8a-89e5-b9c504497268 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:35.127104 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.objects.instance [None req-6eb54541-332b-4c8a-89e5-b9c504497268 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lazy-loading 'fault' on Instance uuid 8fb76141-70a4-4501-b928-7502a13c3cb4 {{(pid=125242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 15 13:50:35.173581 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-6eb54541-332b-4c8a-89e5-b9c504497268 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc29734859a5460faee189b1726b50b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984a02b8dfd446879438d29b5efdd996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:50:35.182186 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-6eb54541-332b-4c8a-89e5-b9c504497268 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] 10.222.0.36 "GET /compute/v2.1/servers/8fb76141-70a4-4501-b928-7502a13c3cb4" status: 200 len: 1351 microversion: 2.1 time: 0.110228 Oct 15 13:50:35.182776 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 122/253] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:50:35 2022] GET /compute/v2.1/servers/8fb76141-70a4-4501-b928-7502a13c3cb4 => generated 1351 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:50:35.316477 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-28d4a2af-6757-42a8-a72f-3d513fe477d4 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:50:35.317314 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-28d4a2af-6757-42a8-a72f-3d513fe477d4 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] [instance: 242ed9b0-fe03-4583-ad2f-4760e86d2031] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:50:35.323519 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-28d4a2af-6757-42a8-a72f-3d513fe477d4 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:35.324040 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-28d4a2af-6757-42a8-a72f-3d513fe477d4 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:35.324476 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-28d4a2af-6757-42a8-a72f-3d513fe477d4 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:35.325177 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-28d4a2af-6757-42a8-a72f-3d513fe477d4 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:35.325803 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-28d4a2af-6757-42a8-a72f-3d513fe477d4 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:35.326249 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-28d4a2af-6757-42a8-a72f-3d513fe477d4 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:35.469124 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-28d4a2af-6757-42a8-a72f-3d513fe477d4 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5150c06020594efe957359f641eba5da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a0813bae074cd2aa552be82abe8493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:50:35.477278 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-28d4a2af-6757-42a8-a72f-3d513fe477d4 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] 10.222.0.36 "GET /compute/v2.1/servers/242ed9b0-fe03-4583-ad2f-4760e86d2031" status: 200 len: 1523 microversion: 2.1 time: 0.165076 Oct 15 13:50:35.478216 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 132/254] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:50:35 2022] GET /compute/v2.1/servers/242ed9b0-fe03-4583-ad2f-4760e86d2031 => generated 1523 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:50:35.914239 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-3450fb31-0f5b-47f6-8b0e-7990f3736757 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:50:35.914967 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-3450fb31-0f5b-47f6-8b0e-7990f3736757 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] [instance: bbd01fa3-108f-4365-b722-b2a0af32983b] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:50:35.921344 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-3450fb31-0f5b-47f6-8b0e-7990f3736757 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:35.921823 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-3450fb31-0f5b-47f6-8b0e-7990f3736757 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:35.922266 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-3450fb31-0f5b-47f6-8b0e-7990f3736757 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:35.923011 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-3450fb31-0f5b-47f6-8b0e-7990f3736757 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:35.923452 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-3450fb31-0f5b-47f6-8b0e-7990f3736757 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:35.923897 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-3450fb31-0f5b-47f6-8b0e-7990f3736757 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:36.079830 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-3450fb31-0f5b-47f6-8b0e-7990f3736757 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af1daddbc1b84ab79f269e124cbea4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b58d317ad84e46be85ed15b3e51c2f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:50:36.088567 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-3450fb31-0f5b-47f6-8b0e-7990f3736757 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] 10.222.0.36 "GET /compute/v2.1/servers/bbd01fa3-108f-4365-b722-b2a0af32983b" status: 200 len: 1314 microversion: 2.1 time: 0.178270 Oct 15 13:50:36.089151 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 123/255] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:50:35 2022] GET /compute/v2.1/servers/bbd01fa3-108f-4365-b722-b2a0af32983b => generated 1314 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:50:36.207236 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-860af09e-211e-479f-a9eb-27f6018a1894 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:50:36.208116 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-860af09e-211e-479f-a9eb-27f6018a1894 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] [instance: 8fb76141-70a4-4501-b928-7502a13c3cb4] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:50:36.217593 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-860af09e-211e-479f-a9eb-27f6018a1894 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:36.218090 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-860af09e-211e-479f-a9eb-27f6018a1894 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:36.218523 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-860af09e-211e-479f-a9eb-27f6018a1894 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:36.219210 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-860af09e-211e-479f-a9eb-27f6018a1894 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:36.219661 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-860af09e-211e-479f-a9eb-27f6018a1894 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:36.220091 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-860af09e-211e-479f-a9eb-27f6018a1894 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:36.253090 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-860af09e-211e-479f-a9eb-27f6018a1894 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:36.253574 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-860af09e-211e-479f-a9eb-27f6018a1894 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:36.254008 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-860af09e-211e-479f-a9eb-27f6018a1894 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:36.254457 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.objects.instance [None req-860af09e-211e-479f-a9eb-27f6018a1894 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lazy-loading 'fault' on Instance uuid 8fb76141-70a4-4501-b928-7502a13c3cb4 {{(pid=125243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 15 13:50:36.303654 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-860af09e-211e-479f-a9eb-27f6018a1894 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc29734859a5460faee189b1726b50b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984a02b8dfd446879438d29b5efdd996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:50:36.315725 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-860af09e-211e-479f-a9eb-27f6018a1894 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] 10.222.0.36 "GET /compute/v2.1/servers/8fb76141-70a4-4501-b928-7502a13c3cb4" status: 200 len: 1351 microversion: 2.1 time: 0.113643 Oct 15 13:50:36.316560 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 133/256] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:50:36 2022] GET /compute/v2.1/servers/8fb76141-70a4-4501-b928-7502a13c3cb4 => generated 1351 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:50:36.502472 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-f4eade05-2127-4e63-8418-134e38f5523c tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:50:36.503046 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-f4eade05-2127-4e63-8418-134e38f5523c tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] [instance: 242ed9b0-fe03-4583-ad2f-4760e86d2031] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:50:36.510033 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-f4eade05-2127-4e63-8418-134e38f5523c tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:36.510583 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-f4eade05-2127-4e63-8418-134e38f5523c tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:36.511023 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-f4eade05-2127-4e63-8418-134e38f5523c tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:36.511741 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-f4eade05-2127-4e63-8418-134e38f5523c tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:36.512238 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-f4eade05-2127-4e63-8418-134e38f5523c tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:36.512669 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-f4eade05-2127-4e63-8418-134e38f5523c tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:36.670791 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-f4eade05-2127-4e63-8418-134e38f5523c tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5150c06020594efe957359f641eba5da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a0813bae074cd2aa552be82abe8493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:50:36.684735 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-f4eade05-2127-4e63-8418-134e38f5523c tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] 10.222.0.36 "GET /compute/v2.1/servers/242ed9b0-fe03-4583-ad2f-4760e86d2031" status: 200 len: 1523 microversion: 2.1 time: 0.186378 Oct 15 13:50:36.685755 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 124/257] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:50:36 2022] GET /compute/v2.1/servers/242ed9b0-fe03-4583-ad2f-4760e86d2031 => generated 1523 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:50:37.112789 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-96643506-8e48-4149-8902-64e37833dc4f tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:50:37.113389 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-96643506-8e48-4149-8902-64e37833dc4f tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] [instance: bbd01fa3-108f-4365-b722-b2a0af32983b] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:50:37.119729 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-96643506-8e48-4149-8902-64e37833dc4f tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:37.120253 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-96643506-8e48-4149-8902-64e37833dc4f tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:37.120678 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-96643506-8e48-4149-8902-64e37833dc4f tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:37.121368 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-96643506-8e48-4149-8902-64e37833dc4f tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:37.121812 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-96643506-8e48-4149-8902-64e37833dc4f tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:37.122232 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-96643506-8e48-4149-8902-64e37833dc4f tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:37.286286 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-96643506-8e48-4149-8902-64e37833dc4f tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af1daddbc1b84ab79f269e124cbea4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b58d317ad84e46be85ed15b3e51c2f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:50:37.294262 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-96643506-8e48-4149-8902-64e37833dc4f tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] 10.222.0.36 "GET /compute/v2.1/servers/bbd01fa3-108f-4365-b722-b2a0af32983b" status: 200 len: 1314 microversion: 2.1 time: 0.185567 Oct 15 13:50:37.294850 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 134/258] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:50:37 2022] GET /compute/v2.1/servers/bbd01fa3-108f-4365-b722-b2a0af32983b => generated 1314 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:50:37.342538 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-d43c3714-b3cc-41b1-ad44-1775fdf44141 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:50:37.343244 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-d43c3714-b3cc-41b1-ad44-1775fdf44141 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] [instance: 8fb76141-70a4-4501-b928-7502a13c3cb4] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:50:37.350348 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-d43c3714-b3cc-41b1-ad44-1775fdf44141 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:37.350871 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-d43c3714-b3cc-41b1-ad44-1775fdf44141 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:37.351444 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-d43c3714-b3cc-41b1-ad44-1775fdf44141 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:37.352194 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-d43c3714-b3cc-41b1-ad44-1775fdf44141 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:37.353009 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-d43c3714-b3cc-41b1-ad44-1775fdf44141 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:37.353485 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-d43c3714-b3cc-41b1-ad44-1775fdf44141 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:37.387709 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-d43c3714-b3cc-41b1-ad44-1775fdf44141 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:37.388143 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-d43c3714-b3cc-41b1-ad44-1775fdf44141 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:37.388577 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-d43c3714-b3cc-41b1-ad44-1775fdf44141 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:37.389021 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.objects.instance [None req-d43c3714-b3cc-41b1-ad44-1775fdf44141 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lazy-loading 'fault' on Instance uuid 8fb76141-70a4-4501-b928-7502a13c3cb4 {{(pid=125242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 15 13:50:37.392243 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG dbcounter [-] [125242] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:50:37.440087 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-d43c3714-b3cc-41b1-ad44-1775fdf44141 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc29734859a5460faee189b1726b50b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984a02b8dfd446879438d29b5efdd996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:50:37.448691 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-d43c3714-b3cc-41b1-ad44-1775fdf44141 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] 10.222.0.36 "GET /compute/v2.1/servers/8fb76141-70a4-4501-b928-7502a13c3cb4" status: 200 len: 1351 microversion: 2.1 time: 0.110137 Oct 15 13:50:37.449535 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 125/259] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:50:37 2022] GET /compute/v2.1/servers/8fb76141-70a4-4501-b928-7502a13c3cb4 => generated 1351 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:50:37.719020 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-d54b844c-e051-405f-bc57-1c4b5cc8f2e0 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:50:37.719812 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-d54b844c-e051-405f-bc57-1c4b5cc8f2e0 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] [instance: 242ed9b0-fe03-4583-ad2f-4760e86d2031] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:50:37.726961 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-d54b844c-e051-405f-bc57-1c4b5cc8f2e0 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:37.727457 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-d54b844c-e051-405f-bc57-1c4b5cc8f2e0 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:37.728473 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-d54b844c-e051-405f-bc57-1c4b5cc8f2e0 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:37.728967 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-d54b844c-e051-405f-bc57-1c4b5cc8f2e0 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:37.729426 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-d54b844c-e051-405f-bc57-1c4b5cc8f2e0 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:37.729853 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-d54b844c-e051-405f-bc57-1c4b5cc8f2e0 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:37.896672 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-d54b844c-e051-405f-bc57-1c4b5cc8f2e0 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5150c06020594efe957359f641eba5da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a0813bae074cd2aa552be82abe8493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:50:37.906066 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-d54b844c-e051-405f-bc57-1c4b5cc8f2e0 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] 10.222.0.36 "GET /compute/v2.1/servers/242ed9b0-fe03-4583-ad2f-4760e86d2031" status: 200 len: 1523 microversion: 2.1 time: 0.190903 Oct 15 13:50:37.906962 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 135/260] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:50:37 2022] GET /compute/v2.1/servers/242ed9b0-fe03-4583-ad2f-4760e86d2031 => generated 1523 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:50:38.318858 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-a5303704-e533-4fbe-9995-0023d7e92bc8 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:50:38.319377 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-a5303704-e533-4fbe-9995-0023d7e92bc8 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] [instance: bbd01fa3-108f-4365-b722-b2a0af32983b] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:50:38.326043 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-a5303704-e533-4fbe-9995-0023d7e92bc8 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:38.326537 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-a5303704-e533-4fbe-9995-0023d7e92bc8 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:38.326983 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-a5303704-e533-4fbe-9995-0023d7e92bc8 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:38.327739 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-a5303704-e533-4fbe-9995-0023d7e92bc8 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:38.328240 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-a5303704-e533-4fbe-9995-0023d7e92bc8 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:38.328661 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-a5303704-e533-4fbe-9995-0023d7e92bc8 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:38.473022 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-ae40e663-de23-40ae-b981-d1845936ec8a tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:50:38.474131 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-ae40e663-de23-40ae-b981-d1845936ec8a tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] [instance: 8fb76141-70a4-4501-b928-7502a13c3cb4] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:50:38.477112 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-a5303704-e533-4fbe-9995-0023d7e92bc8 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af1daddbc1b84ab79f269e124cbea4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b58d317ad84e46be85ed15b3e51c2f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:50:38.480677 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-ae40e663-de23-40ae-b981-d1845936ec8a tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:38.481181 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-ae40e663-de23-40ae-b981-d1845936ec8a tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:38.481615 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-ae40e663-de23-40ae-b981-d1845936ec8a tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:38.482337 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-ae40e663-de23-40ae-b981-d1845936ec8a tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:38.482794 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-ae40e663-de23-40ae-b981-d1845936ec8a tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:38.483230 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-ae40e663-de23-40ae-b981-d1845936ec8a tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:38.490123 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-a5303704-e533-4fbe-9995-0023d7e92bc8 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] 10.222.0.36 "GET /compute/v2.1/servers/bbd01fa3-108f-4365-b722-b2a0af32983b" status: 200 len: 1314 microversion: 2.1 time: 0.174762 Oct 15 13:50:38.492436 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 126/261] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:50:38 2022] GET /compute/v2.1/servers/bbd01fa3-108f-4365-b722-b2a0af32983b => generated 1314 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:50:38.520298 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-ae40e663-de23-40ae-b981-d1845936ec8a tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:38.520809 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-ae40e663-de23-40ae-b981-d1845936ec8a tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:38.521215 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-ae40e663-de23-40ae-b981-d1845936ec8a tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:38.521716 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.objects.instance [None req-ae40e663-de23-40ae-b981-d1845936ec8a tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lazy-loading 'fault' on Instance uuid 8fb76141-70a4-4501-b928-7502a13c3cb4 {{(pid=125243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 15 13:50:38.568093 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-ae40e663-de23-40ae-b981-d1845936ec8a tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc29734859a5460faee189b1726b50b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984a02b8dfd446879438d29b5efdd996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:50:38.579605 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-ae40e663-de23-40ae-b981-d1845936ec8a tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] 10.222.0.36 "GET /compute/v2.1/servers/8fb76141-70a4-4501-b928-7502a13c3cb4" status: 200 len: 1351 microversion: 2.1 time: 0.110644 Oct 15 13:50:38.580272 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 136/262] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:50:38 2022] GET /compute/v2.1/servers/8fb76141-70a4-4501-b928-7502a13c3cb4 => generated 1351 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:50:38.942616 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-338bd4ec-d160-490d-b6c3-511fc56df752 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:50:38.943215 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-338bd4ec-d160-490d-b6c3-511fc56df752 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] [instance: 242ed9b0-fe03-4583-ad2f-4760e86d2031] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:50:38.949608 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-338bd4ec-d160-490d-b6c3-511fc56df752 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:38.950076 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-338bd4ec-d160-490d-b6c3-511fc56df752 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:38.950512 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-338bd4ec-d160-490d-b6c3-511fc56df752 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:38.951219 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-338bd4ec-d160-490d-b6c3-511fc56df752 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:38.951719 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-338bd4ec-d160-490d-b6c3-511fc56df752 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:38.952240 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-338bd4ec-d160-490d-b6c3-511fc56df752 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:39.255565 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-338bd4ec-d160-490d-b6c3-511fc56df752 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5150c06020594efe957359f641eba5da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a0813bae074cd2aa552be82abe8493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:50:39.264576 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-338bd4ec-d160-490d-b6c3-511fc56df752 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] 10.222.0.36 "GET /compute/v2.1/servers/242ed9b0-fe03-4583-ad2f-4760e86d2031" status: 200 len: 1523 microversion: 2.1 time: 0.325800 Oct 15 13:50:39.265451 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 127/263] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:50:38 2022] GET /compute/v2.1/servers/242ed9b0-fe03-4583-ad2f-4760e86d2031 => generated 1523 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:50:39.516158 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-900c00c9-5550-44b8-a892-50ee822e75a2 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:50:39.516911 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-900c00c9-5550-44b8-a892-50ee822e75a2 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] [instance: bbd01fa3-108f-4365-b722-b2a0af32983b] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:50:39.523701 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-900c00c9-5550-44b8-a892-50ee822e75a2 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:39.524244 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-900c00c9-5550-44b8-a892-50ee822e75a2 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:39.524660 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-900c00c9-5550-44b8-a892-50ee822e75a2 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:39.525515 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-900c00c9-5550-44b8-a892-50ee822e75a2 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:39.525981 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-900c00c9-5550-44b8-a892-50ee822e75a2 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:39.526414 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-900c00c9-5550-44b8-a892-50ee822e75a2 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:39.606921 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-2bbd7562-caa7-4743-9419-fd34d5cf791a tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:50:39.608631 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-2bbd7562-caa7-4743-9419-fd34d5cf791a tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] [instance: 8fb76141-70a4-4501-b928-7502a13c3cb4] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:50:39.617749 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-2bbd7562-caa7-4743-9419-fd34d5cf791a tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:39.618246 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-2bbd7562-caa7-4743-9419-fd34d5cf791a tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:39.618681 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-2bbd7562-caa7-4743-9419-fd34d5cf791a tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:39.619609 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-2bbd7562-caa7-4743-9419-fd34d5cf791a tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:39.620128 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-2bbd7562-caa7-4743-9419-fd34d5cf791a tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:39.620553 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-2bbd7562-caa7-4743-9419-fd34d5cf791a tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:39.636689 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.wsgi [None req-2bbd7562-caa7-4743-9419-fd34d5cf791a tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] HTTP exception thrown: Instance 8fb76141-70a4-4501-b928-7502a13c3cb4 could not be found. Oct 15 13:50:39.641933 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-2bbd7562-caa7-4743-9419-fd34d5cf791a tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Request method failure captured: Oct 15 13:50:39.641933 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: request: GET /compute/v2.1/servers/8fb76141-70a4-4501-b928-7502a13c3cb4 HTTP/1.1 Oct 15 13:50:39.641933 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Accept: application/json Oct 15 13:50:39.641933 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Accept-Encoding: identity Oct 15 13:50:39.641933 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Connection: close Oct 15 13:50:39.641933 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Content-Length: 0 Oct 15 13:50:39.641933 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Content-Type: application/json Oct 15 13:50:39.641933 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Host: 10.222.0.36 Oct 15 13:50:39.641933 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Openstack-System-Scope: None Oct 15 13:50:39.641933 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: User-Agent: python-urllib3/1.26.12 Oct 15 13:50:39.641933 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Auth-Token: gAAAAABjSrpKAZaSREsbgcq8AKZBCakN3E-E5knMOBr-FkIf6NiGUyppe0ROFrgwNC2j9JeEGr4oDfifA-NQawikxZwEJcmn_MqpOOxbCKczOR8TDr4msZ5s07R7KO_8t7UiFLV_G963-MJREo47zX1K8F6ATJiBLHZ1oEnEVKCPbzJmXhEzNbQ Oct 15 13:50:39.641933 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Domain-Id: None Oct 15 13:50:39.641933 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Domain-Name: None Oct 15 13:50:39.641933 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Identity-Status: Confirmed Oct 15 13:50:39.641933 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Is-Admin-Project: True Oct 15 13:50:39.641933 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Project-Domain-Id: default Oct 15 13:50:39.641933 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Project-Domain-Name: Default Oct 15 13:50:39.641933 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Project-Id: 984a02b8dfd446879438d29b5efdd996 Oct 15 13:50:39.641933 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Project-Name: tempest-DeleteServersTestJSON-1206873879 Oct 15 13:50:39.641933 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Role: member,reader Oct 15 13:50:39.641933 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Roles: member,reader Oct 15 13:50:39.644341 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_984a02b8dfd446879438d29b5efdd996", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/984a02b8dfd446879438d29b5efdd996"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/984a02b8dfd446879438d29b5efdd996"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/984a02b8dfd446879438d29b5efdd996"}]}] Oct 15 13:50:39.644341 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Tenant: tempest-DeleteServersTestJSON-1206873879 Oct 15 13:50:39.644341 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Tenant-Id: 984a02b8dfd446879438d29b5efdd996 Oct 15 13:50:39.644341 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Tenant-Name: tempest-DeleteServersTestJSON-1206873879 Oct 15 13:50:39.644341 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-User: tempest-DeleteServersTestJSON-1206873879-project Oct 15 13:50:39.644341 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-User-Domain-Id: default Oct 15 13:50:39.644341 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-User-Domain-Name: Default Oct 15 13:50:39.644341 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-User-Id: bc29734859a5460faee189b1726b50b4 Oct 15 13:50:39.644341 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-User-Name: tempest-DeleteServersTestJSON-1206873879-project Oct 15 13:50:39.644341 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: method: > Oct 15 13:50:39.644341 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: exception: Instance 8fb76141-70a4-4501-b928-7502a13c3cb4 could not be found. Oct 15 13:50:39.644341 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: action_args: {'id': '8fb76141-70a4-4501-b928-7502a13c3cb4'} Oct 15 13:50:39.645065 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 15 13:50:39.645065 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 13:50:39.645065 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 15 13:50:39.645065 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 15 13:50:39.645065 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 15 13:50:39.645065 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 15 13:50:39.645065 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 15 13:50:39.645065 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 15 13:50:39.645065 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 15 13:50:39.645065 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 15 13:50:39.645065 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8fb76141-70a4-4501-b928-7502a13c3cb4 could not be found. Oct 15 13:50:39.645065 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Oct 15 13:50:39.645065 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 13:50:39.645065 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Oct 15 13:50:39.645065 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 13:50:39.645065 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 13:50:39.645065 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 13:50:39.645065 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 15 13:50:39.645065 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 15 13:50:39.645065 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 15 13:50:39.646170 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 15 13:50:39.646170 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 15 13:50:39.646170 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 15 13:50:39.646170 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 15 13:50:39.646170 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 15 13:50:39.646170 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 15 13:50:39.646170 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 15 13:50:39.646170 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8fb76141-70a4-4501-b928-7502a13c3cb4 could not be found. Oct 15 13:50:39.646170 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Oct 15 13:50:39.646170 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 13:50:39.646170 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Oct 15 13:50:39.646170 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 13:50:39.646170 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 13:50:39.646170 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 13:50:39.646170 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 15 13:50:39.646170 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 15 13:50:39.646170 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8fb76141-70a4-4501-b928-7502a13c3cb4 could not be found. Oct 15 13:50:39.646170 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Oct 15 13:50:39.648755 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-2bbd7562-caa7-4743-9419-fd34d5cf791a tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Returning 404 to user: Instance 8fb76141-70a4-4501-b928-7502a13c3cb4 could not be found. {{(pid=125242) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 15 13:50:39.648755 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-2bbd7562-caa7-4743-9419-fd34d5cf791a tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] 10.222.0.36 "GET /compute/v2.1/servers/8fb76141-70a4-4501-b928-7502a13c3cb4" status: 404 len: 111 microversion: 2.1 time: 0.043500 Oct 15 13:50:39.648755 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 128/264] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:50:39 2022] GET /compute/v2.1/servers/8fb76141-70a4-4501-b928-7502a13c3cb4 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 15 13:50:39.720637 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-900c00c9-5550-44b8-a892-50ee822e75a2 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af1daddbc1b84ab79f269e124cbea4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b58d317ad84e46be85ed15b3e51c2f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:50:39.735047 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-900c00c9-5550-44b8-a892-50ee822e75a2 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] 10.222.0.36 "GET /compute/v2.1/servers/bbd01fa3-108f-4365-b722-b2a0af32983b" status: 200 len: 1314 microversion: 2.1 time: 0.222432 Oct 15 13:50:39.736583 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 137/265] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:50:39 2022] GET /compute/v2.1/servers/bbd01fa3-108f-4365-b722-b2a0af32983b => generated 1314 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:50:39.799973 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-ee815052-464d-4457-8bff-6d99989ec3b4 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:50:39.803917 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-ee815052-464d-4457-8bff-6d99989ec3b4 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] [instance: 8fb76141-70a4-4501-b928-7502a13c3cb4] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:50:39.811313 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-ee815052-464d-4457-8bff-6d99989ec3b4 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:39.812422 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-ee815052-464d-4457-8bff-6d99989ec3b4 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:39.812978 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-ee815052-464d-4457-8bff-6d99989ec3b4 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:39.814262 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-ee815052-464d-4457-8bff-6d99989ec3b4 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:39.815125 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-ee815052-464d-4457-8bff-6d99989ec3b4 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:39.815995 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-ee815052-464d-4457-8bff-6d99989ec3b4 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:39.840059 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.wsgi [None req-ee815052-464d-4457-8bff-6d99989ec3b4 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] HTTP exception thrown: Instance 8fb76141-70a4-4501-b928-7502a13c3cb4 could not be found. Oct 15 13:50:39.843660 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-ee815052-464d-4457-8bff-6d99989ec3b4 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Request method failure captured: Oct 15 13:50:39.843660 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: request: GET /compute/v2.1/servers/8fb76141-70a4-4501-b928-7502a13c3cb4/os-volume_attachments HTTP/1.1 Oct 15 13:50:39.843660 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Accept: application/json Oct 15 13:50:39.843660 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Accept-Encoding: identity Oct 15 13:50:39.843660 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Connection: close Oct 15 13:50:39.843660 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Content-Length: 0 Oct 15 13:50:39.843660 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Content-Type: application/json Oct 15 13:50:39.843660 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Host: 10.222.0.36 Oct 15 13:50:39.843660 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Openstack-System-Scope: None Oct 15 13:50:39.843660 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: User-Agent: python-urllib3/1.26.12 Oct 15 13:50:39.843660 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Auth-Token: gAAAAABjSrpKAZaSREsbgcq8AKZBCakN3E-E5knMOBr-FkIf6NiGUyppe0ROFrgwNC2j9JeEGr4oDfifA-NQawikxZwEJcmn_MqpOOxbCKczOR8TDr4msZ5s07R7KO_8t7UiFLV_G963-MJREo47zX1K8F6ATJiBLHZ1oEnEVKCPbzJmXhEzNbQ Oct 15 13:50:39.843660 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Domain-Id: None Oct 15 13:50:39.843660 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Domain-Name: None Oct 15 13:50:39.843660 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Identity-Status: Confirmed Oct 15 13:50:39.843660 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Is-Admin-Project: True Oct 15 13:50:39.843660 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Project-Domain-Id: default Oct 15 13:50:39.843660 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Project-Domain-Name: Default Oct 15 13:50:39.843660 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Project-Id: 984a02b8dfd446879438d29b5efdd996 Oct 15 13:50:39.843660 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Project-Name: tempest-DeleteServersTestJSON-1206873879 Oct 15 13:50:39.843660 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Role: member,reader Oct 15 13:50:39.843660 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Roles: member,reader Oct 15 13:50:39.845039 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_984a02b8dfd446879438d29b5efdd996", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/984a02b8dfd446879438d29b5efdd996"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/984a02b8dfd446879438d29b5efdd996"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/984a02b8dfd446879438d29b5efdd996"}]}] Oct 15 13:50:39.845039 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Tenant: tempest-DeleteServersTestJSON-1206873879 Oct 15 13:50:39.845039 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Tenant-Id: 984a02b8dfd446879438d29b5efdd996 Oct 15 13:50:39.845039 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Tenant-Name: tempest-DeleteServersTestJSON-1206873879 Oct 15 13:50:39.845039 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-User: tempest-DeleteServersTestJSON-1206873879-project Oct 15 13:50:39.845039 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-User-Domain-Id: default Oct 15 13:50:39.845039 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-User-Domain-Name: Default Oct 15 13:50:39.845039 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-User-Id: bc29734859a5460faee189b1726b50b4 Oct 15 13:50:39.845039 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-User-Name: tempest-DeleteServersTestJSON-1206873879-project Oct 15 13:50:39.845039 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: method: > Oct 15 13:50:39.845039 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: exception: Instance 8fb76141-70a4-4501-b928-7502a13c3cb4 could not be found. Oct 15 13:50:39.845039 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: action_args: {'server_id': '8fb76141-70a4-4501-b928-7502a13c3cb4'} Oct 15 13:50:39.845702 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 15 13:50:39.845702 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 13:50:39.845702 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 15 13:50:39.845702 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 15 13:50:39.845702 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 15 13:50:39.845702 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 15 13:50:39.845702 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 15 13:50:39.845702 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 15 13:50:39.845702 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 15 13:50:39.845702 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 15 13:50:39.845702 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8fb76141-70a4-4501-b928-7502a13c3cb4 could not be found. Oct 15 13:50:39.845702 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Oct 15 13:50:39.845702 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 13:50:39.845702 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Oct 15 13:50:39.845702 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 13:50:39.845702 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 13:50:39.845702 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 13:50:39.845702 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 15 13:50:39.845702 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 15 13:50:39.845702 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 15 13:50:39.846732 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 15 13:50:39.846732 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 15 13:50:39.846732 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 15 13:50:39.846732 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 15 13:50:39.846732 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 15 13:50:39.846732 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 15 13:50:39.846732 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 15 13:50:39.846732 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 15 13:50:39.846732 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 15 13:50:39.846732 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8fb76141-70a4-4501-b928-7502a13c3cb4 could not be found. Oct 15 13:50:39.846732 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Oct 15 13:50:39.846732 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 13:50:39.846732 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Oct 15 13:50:39.846732 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 13:50:39.846732 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 13:50:39.846732 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 13:50:39.846732 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 15 13:50:39.846732 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 15 13:50:39.846732 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8fb76141-70a4-4501-b928-7502a13c3cb4 could not be found. Oct 15 13:50:39.846732 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Oct 15 13:50:39.847819 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-ee815052-464d-4457-8bff-6d99989ec3b4 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Returning 404 to user: Instance 8fb76141-70a4-4501-b928-7502a13c3cb4 could not be found. {{(pid=125242) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 15 13:50:39.847819 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-ee815052-464d-4457-8bff-6d99989ec3b4 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] 10.222.0.36 "GET /compute/v2.1/servers/8fb76141-70a4-4501-b928-7502a13c3cb4/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.053073 Oct 15 13:50:39.847819 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 129/266] 10.222.0.36 () {58 vars in 1302 bytes} [Sat Oct 15 13:50:39 2022] GET /compute/v2.1/servers/8fb76141-70a4-4501-b928-7502a13c3cb4/os-volume_attachments => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 15 13:50:39.977192 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [req-26f73644-dca8-41de-8b83-41791cd061c4 req-8e2fe76c-3399-478a-b618-5a7b972cea2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbd01fa3-108f-4365-b722-b2a0af32983b", "name": "network-vif-plugged", "status": "completed", "tag": "8383672e-6343-4633-a903-42e13011e626"}]} {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 13:50:39.997033 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [req-26f73644-dca8-41de-8b83-41791cd061c4 req-8e2fe76c-3399-478a-b618-5a7b972cea2f service nova] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:39.998099 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [req-26f73644-dca8-41de-8b83-41791cd061c4 req-8e2fe76c-3399-478a-b618-5a7b972cea2f service nova] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:39.999456 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [req-26f73644-dca8-41de-8b83-41791cd061c4 req-8e2fe76c-3399-478a-b618-5a7b972cea2f service nova] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:40.008229 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG dbcounter [-] [125243] Writing DB stats nova_cell1:SELECT=100 {{(pid=125243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:50:40.026806 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.compute.server_external_events [req-26f73644-dca8-41de-8b83-41791cd061c4 req-8e2fe76c-3399-478a-b618-5a7b972cea2f service nova] Creating event network-vif-plugged:8383672e-6343-4633-a903-42e13011e626 for instance bbd01fa3-108f-4365-b722-b2a0af32983b on hv-cinder-86149 Oct 15 13:50:40.036438 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [req-26f73644-dca8-41de-8b83-41791cd061c4 req-8e2fe76c-3399-478a-b618-5a7b972cea2f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066877 Oct 15 13:50:40.037610 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 138/267] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 15 13:50:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 15 13:50:40.302130 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-10d4ec38-a36b-48b2-8ac4-0f78e7130707 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:50:40.302130 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-10d4ec38-a36b-48b2-8ac4-0f78e7130707 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] [instance: 242ed9b0-fe03-4583-ad2f-4760e86d2031] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:50:40.302433 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-10d4ec38-a36b-48b2-8ac4-0f78e7130707 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:40.303269 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-10d4ec38-a36b-48b2-8ac4-0f78e7130707 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:40.303864 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-10d4ec38-a36b-48b2-8ac4-0f78e7130707 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:40.305152 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-10d4ec38-a36b-48b2-8ac4-0f78e7130707 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:40.306320 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-10d4ec38-a36b-48b2-8ac4-0f78e7130707 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:40.307124 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-10d4ec38-a36b-48b2-8ac4-0f78e7130707 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:40.512694 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-10d4ec38-a36b-48b2-8ac4-0f78e7130707 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5150c06020594efe957359f641eba5da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a0813bae074cd2aa552be82abe8493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:50:40.526792 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-10d4ec38-a36b-48b2-8ac4-0f78e7130707 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] 10.222.0.36 "GET /compute/v2.1/servers/242ed9b0-fe03-4583-ad2f-4760e86d2031" status: 200 len: 1523 microversion: 2.1 time: 0.240257 Oct 15 13:50:40.528003 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 130/268] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:50:40 2022] GET /compute/v2.1/servers/242ed9b0-fe03-4583-ad2f-4760e86d2031 => generated 1523 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:50:40.760095 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-06688ed8-8726-46e1-bfa2-9bd61f91509e tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:50:40.760979 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-06688ed8-8726-46e1-bfa2-9bd61f91509e tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] [instance: bbd01fa3-108f-4365-b722-b2a0af32983b] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:50:40.769873 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-06688ed8-8726-46e1-bfa2-9bd61f91509e tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:40.770366 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-06688ed8-8726-46e1-bfa2-9bd61f91509e tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:40.770878 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-06688ed8-8726-46e1-bfa2-9bd61f91509e tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:40.771517 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-06688ed8-8726-46e1-bfa2-9bd61f91509e tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:40.772007 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-06688ed8-8726-46e1-bfa2-9bd61f91509e tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:40.772425 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-06688ed8-8726-46e1-bfa2-9bd61f91509e tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:40.942776 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-06688ed8-8726-46e1-bfa2-9bd61f91509e tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af1daddbc1b84ab79f269e124cbea4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b58d317ad84e46be85ed15b3e51c2f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:50:40.953815 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-06688ed8-8726-46e1-bfa2-9bd61f91509e tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] 10.222.0.36 "GET /compute/v2.1/servers/bbd01fa3-108f-4365-b722-b2a0af32983b" status: 200 len: 1314 microversion: 2.1 time: 0.197901 Oct 15 13:50:40.954806 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 139/269] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:50:40 2022] GET /compute/v2.1/servers/bbd01fa3-108f-4365-b722-b2a0af32983b => generated 1314 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 13:50:41.191734 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-4e659d5c-e5b2-4dfa-9442-b6d7a8d62d0e tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:50:41.192382 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-4e659d5c-e5b2-4dfa-9442-b6d7a8d62d0e tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] [instance: 8fb76141-70a4-4501-b928-7502a13c3cb4] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:50:41.199614 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-4e659d5c-e5b2-4dfa-9442-b6d7a8d62d0e tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:41.200189 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-4e659d5c-e5b2-4dfa-9442-b6d7a8d62d0e tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:41.200639 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-4e659d5c-e5b2-4dfa-9442-b6d7a8d62d0e tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:41.201411 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-4e659d5c-e5b2-4dfa-9442-b6d7a8d62d0e tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:41.201924 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-4e659d5c-e5b2-4dfa-9442-b6d7a8d62d0e tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:41.202508 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-4e659d5c-e5b2-4dfa-9442-b6d7a8d62d0e tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:41.218056 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.wsgi [None req-4e659d5c-e5b2-4dfa-9442-b6d7a8d62d0e tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] HTTP exception thrown: Instance 8fb76141-70a4-4501-b928-7502a13c3cb4 could not be found. Oct 15 13:50:41.220127 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-4e659d5c-e5b2-4dfa-9442-b6d7a8d62d0e tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Request method failure captured: Oct 15 13:50:41.220127 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: request: DELETE /compute/v2.1/servers/8fb76141-70a4-4501-b928-7502a13c3cb4 HTTP/1.1 Oct 15 13:50:41.220127 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Accept: application/json Oct 15 13:50:41.220127 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Accept-Encoding: identity Oct 15 13:50:41.220127 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Connection: close Oct 15 13:50:41.220127 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Content-Length: 0 Oct 15 13:50:41.220127 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Content-Type: application/json Oct 15 13:50:41.220127 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Host: 10.222.0.36 Oct 15 13:50:41.220127 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Openstack-System-Scope: None Oct 15 13:50:41.220127 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: User-Agent: python-urllib3/1.26.12 Oct 15 13:50:41.220127 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Auth-Token: gAAAAABjSrpKAZaSREsbgcq8AKZBCakN3E-E5knMOBr-FkIf6NiGUyppe0ROFrgwNC2j9JeEGr4oDfifA-NQawikxZwEJcmn_MqpOOxbCKczOR8TDr4msZ5s07R7KO_8t7UiFLV_G963-MJREo47zX1K8F6ATJiBLHZ1oEnEVKCPbzJmXhEzNbQ Oct 15 13:50:41.220127 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Domain-Id: None Oct 15 13:50:41.220127 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Domain-Name: None Oct 15 13:50:41.220127 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Identity-Status: Confirmed Oct 15 13:50:41.220127 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Is-Admin-Project: True Oct 15 13:50:41.220127 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Project-Domain-Id: default Oct 15 13:50:41.220127 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Project-Domain-Name: Default Oct 15 13:50:41.220127 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Project-Id: 984a02b8dfd446879438d29b5efdd996 Oct 15 13:50:41.220127 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Project-Name: tempest-DeleteServersTestJSON-1206873879 Oct 15 13:50:41.220127 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Role: member,reader Oct 15 13:50:41.220127 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Roles: member,reader Oct 15 13:50:41.221376 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_984a02b8dfd446879438d29b5efdd996", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/984a02b8dfd446879438d29b5efdd996"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/984a02b8dfd446879438d29b5efdd996"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/984a02b8dfd446879438d29b5efdd996"}]}] Oct 15 13:50:41.221376 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Tenant: tempest-DeleteServersTestJSON-1206873879 Oct 15 13:50:41.221376 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Tenant-Id: 984a02b8dfd446879438d29b5efdd996 Oct 15 13:50:41.221376 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Tenant-Name: tempest-DeleteServersTestJSON-1206873879 Oct 15 13:50:41.221376 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-User: tempest-DeleteServersTestJSON-1206873879-project Oct 15 13:50:41.221376 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-User-Domain-Id: default Oct 15 13:50:41.221376 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-User-Domain-Name: Default Oct 15 13:50:41.221376 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-User-Id: bc29734859a5460faee189b1726b50b4 Oct 15 13:50:41.221376 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-User-Name: tempest-DeleteServersTestJSON-1206873879-project Oct 15 13:50:41.221376 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: method: > Oct 15 13:50:41.221376 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: exception: Instance 8fb76141-70a4-4501-b928-7502a13c3cb4 could not be found. Oct 15 13:50:41.221376 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: action_args: {'id': '8fb76141-70a4-4501-b928-7502a13c3cb4'} Oct 15 13:50:41.222105 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 15 13:50:41.222105 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 13:50:41.222105 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 15 13:50:41.222105 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 15 13:50:41.222105 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 15 13:50:41.222105 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 15 13:50:41.222105 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 15 13:50:41.222105 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 15 13:50:41.222105 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 15 13:50:41.222105 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 15 13:50:41.222105 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8fb76141-70a4-4501-b928-7502a13c3cb4 could not be found. Oct 15 13:50:41.222105 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Oct 15 13:50:41.222105 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 13:50:41.222105 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Oct 15 13:50:41.222105 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 13:50:41.222105 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 13:50:41.222105 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 13:50:41.222105 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 15 13:50:41.222105 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 15 13:50:41.222105 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 15 13:50:41.223194 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 15 13:50:41.223194 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 15 13:50:41.223194 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 15 13:50:41.223194 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 15 13:50:41.223194 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 15 13:50:41.223194 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 15 13:50:41.223194 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 15 13:50:41.223194 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 15 13:50:41.223194 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 15 13:50:41.223194 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8fb76141-70a4-4501-b928-7502a13c3cb4 could not be found. Oct 15 13:50:41.223194 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Oct 15 13:50:41.223194 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 13:50:41.223194 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Oct 15 13:50:41.223194 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 13:50:41.223194 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 13:50:41.223194 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 13:50:41.223194 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 15 13:50:41.223194 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 15 13:50:41.223194 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8fb76141-70a4-4501-b928-7502a13c3cb4 could not be found. Oct 15 13:50:41.223194 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Oct 15 13:50:41.224340 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-4e659d5c-e5b2-4dfa-9442-b6d7a8d62d0e tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Returning 404 to user: Instance 8fb76141-70a4-4501-b928-7502a13c3cb4 could not be found. {{(pid=125242) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 15 13:50:41.224994 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-4e659d5c-e5b2-4dfa-9442-b6d7a8d62d0e tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] 10.222.0.36 "DELETE /compute/v2.1/servers/8fb76141-70a4-4501-b928-7502a13c3cb4" status: 404 len: 111 microversion: 2.1 time: 0.035275 Oct 15 13:50:41.225949 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 131/270] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 15 13:50:41 2022] DELETE /compute/v2.1/servers/8fb76141-70a4-4501-b928-7502a13c3cb4 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 15 13:50:41.235574 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-b5a89476-f151-4162-84d0-6c9d00e4e891 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:50:41.236243 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-b5a89476-f151-4162-84d0-6c9d00e4e891 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] [instance: 8fb76141-70a4-4501-b928-7502a13c3cb4] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:50:41.243660 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-b5a89476-f151-4162-84d0-6c9d00e4e891 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:41.244193 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-b5a89476-f151-4162-84d0-6c9d00e4e891 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:41.244628 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-b5a89476-f151-4162-84d0-6c9d00e4e891 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:41.248086 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-b5a89476-f151-4162-84d0-6c9d00e4e891 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:41.248086 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-b5a89476-f151-4162-84d0-6c9d00e4e891 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:41.248086 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-b5a89476-f151-4162-84d0-6c9d00e4e891 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:41.261585 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.wsgi [None req-b5a89476-f151-4162-84d0-6c9d00e4e891 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] HTTP exception thrown: Instance 8fb76141-70a4-4501-b928-7502a13c3cb4 could not be found. Oct 15 13:50:41.266929 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-b5a89476-f151-4162-84d0-6c9d00e4e891 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Request method failure captured: Oct 15 13:50:41.266929 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: request: GET /compute/v2.1/servers/8fb76141-70a4-4501-b928-7502a13c3cb4 HTTP/1.1 Oct 15 13:50:41.266929 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: Accept: application/json Oct 15 13:50:41.266929 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: Accept-Encoding: identity Oct 15 13:50:41.266929 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: Connection: close Oct 15 13:50:41.266929 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: Content-Length: 0 Oct 15 13:50:41.266929 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: Content-Type: application/json Oct 15 13:50:41.266929 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: Host: 10.222.0.36 Oct 15 13:50:41.266929 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: Openstack-System-Scope: None Oct 15 13:50:41.266929 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: User-Agent: python-urllib3/1.26.12 Oct 15 13:50:41.266929 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Auth-Token: gAAAAABjSrpKAZaSREsbgcq8AKZBCakN3E-E5knMOBr-FkIf6NiGUyppe0ROFrgwNC2j9JeEGr4oDfifA-NQawikxZwEJcmn_MqpOOxbCKczOR8TDr4msZ5s07R7KO_8t7UiFLV_G963-MJREo47zX1K8F6ATJiBLHZ1oEnEVKCPbzJmXhEzNbQ Oct 15 13:50:41.266929 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Domain-Id: None Oct 15 13:50:41.266929 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Domain-Name: None Oct 15 13:50:41.266929 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Identity-Status: Confirmed Oct 15 13:50:41.266929 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Is-Admin-Project: True Oct 15 13:50:41.266929 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Project-Domain-Id: default Oct 15 13:50:41.266929 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Project-Domain-Name: Default Oct 15 13:50:41.266929 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Project-Id: 984a02b8dfd446879438d29b5efdd996 Oct 15 13:50:41.266929 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Project-Name: tempest-DeleteServersTestJSON-1206873879 Oct 15 13:50:41.266929 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Role: member,reader Oct 15 13:50:41.266929 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Roles: member,reader Oct 15 13:50:41.269678 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_984a02b8dfd446879438d29b5efdd996", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/984a02b8dfd446879438d29b5efdd996"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/984a02b8dfd446879438d29b5efdd996"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/984a02b8dfd446879438d29b5efdd996"}]}] Oct 15 13:50:41.269678 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Tenant: tempest-DeleteServersTestJSON-1206873879 Oct 15 13:50:41.269678 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Tenant-Id: 984a02b8dfd446879438d29b5efdd996 Oct 15 13:50:41.269678 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Tenant-Name: tempest-DeleteServersTestJSON-1206873879 Oct 15 13:50:41.269678 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-User: tempest-DeleteServersTestJSON-1206873879-project Oct 15 13:50:41.269678 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-User-Domain-Id: default Oct 15 13:50:41.269678 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-User-Domain-Name: Default Oct 15 13:50:41.269678 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-User-Id: bc29734859a5460faee189b1726b50b4 Oct 15 13:50:41.269678 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-User-Name: tempest-DeleteServersTestJSON-1206873879-project Oct 15 13:50:41.269678 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: method: > Oct 15 13:50:41.269678 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: exception: Instance 8fb76141-70a4-4501-b928-7502a13c3cb4 could not be found. Oct 15 13:50:41.269678 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: action_args: {'id': '8fb76141-70a4-4501-b928-7502a13c3cb4'} Oct 15 13:50:41.271491 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 15 13:50:41.271491 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 13:50:41.271491 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 15 13:50:41.271491 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 15 13:50:41.271491 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 15 13:50:41.271491 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 15 13:50:41.271491 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 15 13:50:41.271491 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 15 13:50:41.271491 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 15 13:50:41.271491 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 15 13:50:41.271491 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8fb76141-70a4-4501-b928-7502a13c3cb4 could not be found. Oct 15 13:50:41.271491 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Oct 15 13:50:41.271491 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 13:50:41.271491 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Oct 15 13:50:41.271491 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 13:50:41.271491 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 13:50:41.271491 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 13:50:41.271491 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 15 13:50:41.271491 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 15 13:50:41.271491 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 15 13:50:41.274043 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 15 13:50:41.274043 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 15 13:50:41.274043 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 15 13:50:41.274043 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 15 13:50:41.274043 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 15 13:50:41.274043 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 15 13:50:41.274043 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 15 13:50:41.274043 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8fb76141-70a4-4501-b928-7502a13c3cb4 could not be found. Oct 15 13:50:41.274043 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Oct 15 13:50:41.274043 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 13:50:41.274043 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Oct 15 13:50:41.274043 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 13:50:41.274043 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 13:50:41.274043 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 13:50:41.274043 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 15 13:50:41.274043 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 15 13:50:41.274043 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8fb76141-70a4-4501-b928-7502a13c3cb4 could not be found. Oct 15 13:50:41.274043 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Oct 15 13:50:41.276400 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-b5a89476-f151-4162-84d0-6c9d00e4e891 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] Returning 404 to user: Instance 8fb76141-70a4-4501-b928-7502a13c3cb4 could not be found. {{(pid=125243) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 15 13:50:41.276400 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-b5a89476-f151-4162-84d0-6c9d00e4e891 tempest-DeleteServersTestJSON-1206873879 tempest-DeleteServersTestJSON-1206873879-project] 10.222.0.36 "GET /compute/v2.1/servers/8fb76141-70a4-4501-b928-7502a13c3cb4" status: 404 len: 111 microversion: 2.1 time: 0.037477 Oct 15 13:50:41.276400 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 140/271] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:50:41 2022] GET /compute/v2.1/servers/8fb76141-70a4-4501-b928-7502a13c3cb4 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 15 13:50:41.554096 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-132e5629-4653-4b38-a209-2fdf982ee268 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:50:41.554900 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-132e5629-4653-4b38-a209-2fdf982ee268 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] [instance: 242ed9b0-fe03-4583-ad2f-4760e86d2031] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:50:41.562156 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-132e5629-4653-4b38-a209-2fdf982ee268 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:41.562860 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-132e5629-4653-4b38-a209-2fdf982ee268 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:41.563311 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-132e5629-4653-4b38-a209-2fdf982ee268 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:41.564145 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-132e5629-4653-4b38-a209-2fdf982ee268 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:41.564697 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-132e5629-4653-4b38-a209-2fdf982ee268 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:41.565124 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-132e5629-4653-4b38-a209-2fdf982ee268 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:41.719385 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-132e5629-4653-4b38-a209-2fdf982ee268 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5150c06020594efe957359f641eba5da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a0813bae074cd2aa552be82abe8493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:50:41.728472 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-132e5629-4653-4b38-a209-2fdf982ee268 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] 10.222.0.36 "GET /compute/v2.1/servers/242ed9b0-fe03-4583-ad2f-4760e86d2031" status: 200 len: 1523 microversion: 2.1 time: 0.179441 Oct 15 13:50:41.729072 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 132/272] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:50:41 2022] GET /compute/v2.1/servers/242ed9b0-fe03-4583-ad2f-4760e86d2031 => generated 1523 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:50:42.002577 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-ef83d614-0615-4b01-a25e-1341a9dc1ce6 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:50:42.007788 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-ef83d614-0615-4b01-a25e-1341a9dc1ce6 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] [instance: bbd01fa3-108f-4365-b722-b2a0af32983b] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:50:42.020050 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-ef83d614-0615-4b01-a25e-1341a9dc1ce6 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:42.021355 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-ef83d614-0615-4b01-a25e-1341a9dc1ce6 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:42.022727 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-ef83d614-0615-4b01-a25e-1341a9dc1ce6 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:42.025571 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-ef83d614-0615-4b01-a25e-1341a9dc1ce6 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:42.026836 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-ef83d614-0615-4b01-a25e-1341a9dc1ce6 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:42.027604 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-ef83d614-0615-4b01-a25e-1341a9dc1ce6 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:42.201026 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-ef83d614-0615-4b01-a25e-1341a9dc1ce6 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af1daddbc1b84ab79f269e124cbea4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b58d317ad84e46be85ed15b3e51c2f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:50:42.211638 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-ef83d614-0615-4b01-a25e-1341a9dc1ce6 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] 10.222.0.36 "GET /compute/v2.1/servers/bbd01fa3-108f-4365-b722-b2a0af32983b" status: 200 len: 1314 microversion: 2.1 time: 0.218031 Oct 15 13:50:42.212536 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 141/273] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:50:41 2022] GET /compute/v2.1/servers/bbd01fa3-108f-4365-b722-b2a0af32983b => generated 1314 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:50:42.756372 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-ddf3ada7-9fe7-432f-8332-4e86cc830dca tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:50:42.756981 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-ddf3ada7-9fe7-432f-8332-4e86cc830dca tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] [instance: 242ed9b0-fe03-4583-ad2f-4760e86d2031] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:50:42.770141 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-ddf3ada7-9fe7-432f-8332-4e86cc830dca tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:42.770890 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-ddf3ada7-9fe7-432f-8332-4e86cc830dca tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:42.771638 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-ddf3ada7-9fe7-432f-8332-4e86cc830dca tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:42.772730 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-ddf3ada7-9fe7-432f-8332-4e86cc830dca tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:42.773883 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-ddf3ada7-9fe7-432f-8332-4e86cc830dca tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:42.774630 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-ddf3ada7-9fe7-432f-8332-4e86cc830dca tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:42.992719 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-ddf3ada7-9fe7-432f-8332-4e86cc830dca tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5150c06020594efe957359f641eba5da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a0813bae074cd2aa552be82abe8493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:50:43.002624 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-ddf3ada7-9fe7-432f-8332-4e86cc830dca tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] 10.222.0.36 "GET /compute/v2.1/servers/242ed9b0-fe03-4583-ad2f-4760e86d2031" status: 200 len: 1523 microversion: 2.1 time: 0.252845 Oct 15 13:50:43.003601 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 133/274] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:50:42 2022] GET /compute/v2.1/servers/242ed9b0-fe03-4583-ad2f-4760e86d2031 => generated 1523 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:50:43.263218 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-28188ab2-c827-4b03-9ec4-60edb5be5fed tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:50:43.266457 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-28188ab2-c827-4b03-9ec4-60edb5be5fed tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] [instance: bbd01fa3-108f-4365-b722-b2a0af32983b] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:50:43.283745 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-28188ab2-c827-4b03-9ec4-60edb5be5fed tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:43.284563 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-28188ab2-c827-4b03-9ec4-60edb5be5fed tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:43.285166 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-28188ab2-c827-4b03-9ec4-60edb5be5fed tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:43.286379 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-28188ab2-c827-4b03-9ec4-60edb5be5fed tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:43.287176 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-28188ab2-c827-4b03-9ec4-60edb5be5fed tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:43.288624 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-28188ab2-c827-4b03-9ec4-60edb5be5fed tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:43.538908 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-28188ab2-c827-4b03-9ec4-60edb5be5fed tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af1daddbc1b84ab79f269e124cbea4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b58d317ad84e46be85ed15b3e51c2f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:50:43.552723 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-28188ab2-c827-4b03-9ec4-60edb5be5fed tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] 10.222.0.36 "GET /compute/v2.1/servers/bbd01fa3-108f-4365-b722-b2a0af32983b" status: 200 len: 1499 microversion: 2.1 time: 0.307474 Oct 15 13:50:43.553745 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 142/275] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:50:43 2022] GET /compute/v2.1/servers/bbd01fa3-108f-4365-b722-b2a0af32983b => generated 1499 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:50:44.035076 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-9617b5ec-bad3-4fe6-b944-6d8c8a07905d tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:50:44.035854 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-9617b5ec-bad3-4fe6-b944-6d8c8a07905d tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] [instance: 242ed9b0-fe03-4583-ad2f-4760e86d2031] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:50:44.046502 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-9617b5ec-bad3-4fe6-b944-6d8c8a07905d tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:44.047118 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-9617b5ec-bad3-4fe6-b944-6d8c8a07905d tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:44.047578 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-9617b5ec-bad3-4fe6-b944-6d8c8a07905d tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:44.048341 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-9617b5ec-bad3-4fe6-b944-6d8c8a07905d tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:44.048793 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-9617b5ec-bad3-4fe6-b944-6d8c8a07905d tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:44.049220 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-9617b5ec-bad3-4fe6-b944-6d8c8a07905d tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:44.385983 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-1b8ae001-327f-4f66-b96c-1996e42d758e tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:50:44.391259 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-1b8ae001-327f-4f66-b96c-1996e42d758e tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] [instance: bbd01fa3-108f-4365-b722-b2a0af32983b] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:50:44.398068 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-1b8ae001-327f-4f66-b96c-1996e42d758e tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:44.398823 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-1b8ae001-327f-4f66-b96c-1996e42d758e tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:44.399484 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-1b8ae001-327f-4f66-b96c-1996e42d758e tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:44.400445 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-1b8ae001-327f-4f66-b96c-1996e42d758e tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:44.401168 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-1b8ae001-327f-4f66-b96c-1996e42d758e tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:44.402453 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-1b8ae001-327f-4f66-b96c-1996e42d758e tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:44.427943 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-9617b5ec-bad3-4fe6-b944-6d8c8a07905d tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5150c06020594efe957359f641eba5da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a0813bae074cd2aa552be82abe8493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:50:44.441175 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-9617b5ec-bad3-4fe6-b944-6d8c8a07905d tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] 10.222.0.36 "GET /compute/v2.1/servers/242ed9b0-fe03-4583-ad2f-4760e86d2031" status: 200 len: 1523 microversion: 2.1 time: 0.411590 Oct 15 13:50:44.442123 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 134/276] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:50:44 2022] GET /compute/v2.1/servers/242ed9b0-fe03-4583-ad2f-4760e86d2031 => generated 1523 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:50:44.448388 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-1b8ae001-327f-4f66-b96c-1996e42d758e tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] [instance: bbd01fa3-108f-4365-b722-b2a0af32983b] Going to try to terminate instance {{(pid=125243) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 15 13:50:44.580090 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-1b8ae001-327f-4f66-b96c-1996e42d758e tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] 10.222.0.36 "DELETE /compute/v2.1/servers/bbd01fa3-108f-4365-b722-b2a0af32983b" status: 204 len: 0 microversion: 2.1 time: 0.197369 Oct 15 13:50:44.580769 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 143/277] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 15 13:50:44 2022] DELETE /compute/v2.1/servers/bbd01fa3-108f-4365-b722-b2a0af32983b => generated 0 bytes in 199 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 15 13:50:44.589340 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-d513478d-f72d-49bf-b56a-1ecf71f0d150 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:50:44.589966 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-d513478d-f72d-49bf-b56a-1ecf71f0d150 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] [instance: bbd01fa3-108f-4365-b722-b2a0af32983b] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:50:44.597637 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-d513478d-f72d-49bf-b56a-1ecf71f0d150 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:44.598127 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-d513478d-f72d-49bf-b56a-1ecf71f0d150 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:44.598715 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-d513478d-f72d-49bf-b56a-1ecf71f0d150 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:44.599562 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-d513478d-f72d-49bf-b56a-1ecf71f0d150 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:44.600064 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-d513478d-f72d-49bf-b56a-1ecf71f0d150 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:44.600614 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-d513478d-f72d-49bf-b56a-1ecf71f0d150 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:44.879522 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-d513478d-f72d-49bf-b56a-1ecf71f0d150 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af1daddbc1b84ab79f269e124cbea4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b58d317ad84e46be85ed15b3e51c2f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:50:44.898069 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-d513478d-f72d-49bf-b56a-1ecf71f0d150 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] 10.222.0.36 "GET /compute/v2.1/servers/bbd01fa3-108f-4365-b722-b2a0af32983b" status: 200 len: 1505 microversion: 2.1 time: 0.312616 Oct 15 13:50:44.898815 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 135/278] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:50:44 2022] GET /compute/v2.1/servers/bbd01fa3-108f-4365-b722-b2a0af32983b => generated 1505 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:50:45.474737 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-304ecf6a-9e54-4c6e-98c5-f303885d0e9f tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:50:45.476663 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-304ecf6a-9e54-4c6e-98c5-f303885d0e9f tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] [instance: 242ed9b0-fe03-4583-ad2f-4760e86d2031] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:50:45.488773 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-304ecf6a-9e54-4c6e-98c5-f303885d0e9f tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:45.489413 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-304ecf6a-9e54-4c6e-98c5-f303885d0e9f tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:45.490105 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-304ecf6a-9e54-4c6e-98c5-f303885d0e9f tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:45.491310 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-304ecf6a-9e54-4c6e-98c5-f303885d0e9f tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:45.492204 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-304ecf6a-9e54-4c6e-98c5-f303885d0e9f tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:45.492853 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-304ecf6a-9e54-4c6e-98c5-f303885d0e9f tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:45.844387 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-304ecf6a-9e54-4c6e-98c5-f303885d0e9f tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5150c06020594efe957359f641eba5da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a0813bae074cd2aa552be82abe8493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:50:45.860496 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-304ecf6a-9e54-4c6e-98c5-f303885d0e9f tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] 10.222.0.36 "GET /compute/v2.1/servers/242ed9b0-fe03-4583-ad2f-4760e86d2031" status: 200 len: 1523 microversion: 2.1 time: 0.390924 Oct 15 13:50:45.861654 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 144/279] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:50:45 2022] GET /compute/v2.1/servers/242ed9b0-fe03-4583-ad2f-4760e86d2031 => generated 1523 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:50:45.940838 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-36132320-2043-48ce-9a1c-a487212ab253 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:50:45.941857 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-36132320-2043-48ce-9a1c-a487212ab253 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] [instance: bbd01fa3-108f-4365-b722-b2a0af32983b] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:50:45.948934 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-36132320-2043-48ce-9a1c-a487212ab253 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:45.949615 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-36132320-2043-48ce-9a1c-a487212ab253 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:45.950322 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-36132320-2043-48ce-9a1c-a487212ab253 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:45.951404 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-36132320-2043-48ce-9a1c-a487212ab253 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:45.952589 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-36132320-2043-48ce-9a1c-a487212ab253 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:45.953560 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-36132320-2043-48ce-9a1c-a487212ab253 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:46.240656 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-36132320-2043-48ce-9a1c-a487212ab253 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af1daddbc1b84ab79f269e124cbea4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b58d317ad84e46be85ed15b3e51c2f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:50:46.252658 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-36132320-2043-48ce-9a1c-a487212ab253 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] 10.222.0.36 "GET /compute/v2.1/servers/bbd01fa3-108f-4365-b722-b2a0af32983b" status: 200 len: 1505 microversion: 2.1 time: 0.317001 Oct 15 13:50:46.254069 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 136/280] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:50:45 2022] GET /compute/v2.1/servers/bbd01fa3-108f-4365-b722-b2a0af32983b => generated 1505 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:50:46.901098 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-3ebebd14-4079-4330-a76a-8e1cf615c2c1 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:50:46.902156 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-3ebebd14-4079-4330-a76a-8e1cf615c2c1 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] [instance: 242ed9b0-fe03-4583-ad2f-4760e86d2031] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:50:46.930561 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-3ebebd14-4079-4330-a76a-8e1cf615c2c1 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:46.931423 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-3ebebd14-4079-4330-a76a-8e1cf615c2c1 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:46.932236 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-3ebebd14-4079-4330-a76a-8e1cf615c2c1 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:46.941737 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-3ebebd14-4079-4330-a76a-8e1cf615c2c1 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:46.942834 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-3ebebd14-4079-4330-a76a-8e1cf615c2c1 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:46.946763 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-3ebebd14-4079-4330-a76a-8e1cf615c2c1 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:47.275490 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-3ebebd14-4079-4330-a76a-8e1cf615c2c1 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5150c06020594efe957359f641eba5da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a0813bae074cd2aa552be82abe8493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:50:47.285489 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-7ca7bd37-2863-4536-900e-f2b4ac43f0a1 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:50:47.287809 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-7ca7bd37-2863-4536-900e-f2b4ac43f0a1 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] [instance: bbd01fa3-108f-4365-b722-b2a0af32983b] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:50:47.297737 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-3ebebd14-4079-4330-a76a-8e1cf615c2c1 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] 10.222.0.36 "GET /compute/v2.1/servers/242ed9b0-fe03-4583-ad2f-4760e86d2031" status: 200 len: 1523 microversion: 2.1 time: 0.404660 Oct 15 13:50:47.298057 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-7ca7bd37-2863-4536-900e-f2b4ac43f0a1 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:47.298737 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-7ca7bd37-2863-4536-900e-f2b4ac43f0a1 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:47.299399 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-7ca7bd37-2863-4536-900e-f2b4ac43f0a1 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:47.300375 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-7ca7bd37-2863-4536-900e-f2b4ac43f0a1 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:47.300993 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-7ca7bd37-2863-4536-900e-f2b4ac43f0a1 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:47.301469 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 145/281] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:50:46 2022] GET /compute/v2.1/servers/242ed9b0-fe03-4583-ad2f-4760e86d2031 => generated 1523 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:50:47.301842 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-7ca7bd37-2863-4536-900e-f2b4ac43f0a1 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:47.606059 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-7ca7bd37-2863-4536-900e-f2b4ac43f0a1 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af1daddbc1b84ab79f269e124cbea4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b58d317ad84e46be85ed15b3e51c2f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:50:47.640489 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-7ca7bd37-2863-4536-900e-f2b4ac43f0a1 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] 10.222.0.36 "GET /compute/v2.1/servers/bbd01fa3-108f-4365-b722-b2a0af32983b" status: 200 len: 1505 microversion: 2.1 time: 0.359654 Oct 15 13:50:47.656173 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 137/282] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:50:47 2022] GET /compute/v2.1/servers/bbd01fa3-108f-4365-b722-b2a0af32983b => generated 1505 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:50:48.338150 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-5fb156ff-7483-4f8a-abbd-c5e0224d7088 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:50:48.339795 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-5fb156ff-7483-4f8a-abbd-c5e0224d7088 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] [instance: 242ed9b0-fe03-4583-ad2f-4760e86d2031] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:50:48.352292 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-5fb156ff-7483-4f8a-abbd-c5e0224d7088 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:48.353523 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-5fb156ff-7483-4f8a-abbd-c5e0224d7088 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:48.354273 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-5fb156ff-7483-4f8a-abbd-c5e0224d7088 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:48.356930 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-5fb156ff-7483-4f8a-abbd-c5e0224d7088 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:48.358560 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-5fb156ff-7483-4f8a-abbd-c5e0224d7088 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:48.360719 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-5fb156ff-7483-4f8a-abbd-c5e0224d7088 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:48.698472 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-de7e690e-442b-4de0-bbbf-67adf842751c tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:50:48.704594 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-de7e690e-442b-4de0-bbbf-67adf842751c tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] [instance: bbd01fa3-108f-4365-b722-b2a0af32983b] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:50:48.725309 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-de7e690e-442b-4de0-bbbf-67adf842751c tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:48.726808 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-de7e690e-442b-4de0-bbbf-67adf842751c tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:48.727525 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-de7e690e-442b-4de0-bbbf-67adf842751c tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:48.729363 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-de7e690e-442b-4de0-bbbf-67adf842751c tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:48.729846 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-de7e690e-442b-4de0-bbbf-67adf842751c tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:48.732918 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-de7e690e-442b-4de0-bbbf-67adf842751c tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:48.891709 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-5fb156ff-7483-4f8a-abbd-c5e0224d7088 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5150c06020594efe957359f641eba5da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a0813bae074cd2aa552be82abe8493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:50:48.905714 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-5fb156ff-7483-4f8a-abbd-c5e0224d7088 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] 10.222.0.36 "GET /compute/v2.1/servers/242ed9b0-fe03-4583-ad2f-4760e86d2031" status: 200 len: 1523 microversion: 2.1 time: 0.571512 Oct 15 13:50:48.906916 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 146/283] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:50:48 2022] GET /compute/v2.1/servers/242ed9b0-fe03-4583-ad2f-4760e86d2031 => generated 1523 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 13:50:48.917214 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [req-1ba3a8e6-bc07-4d8d-bf2f-a4cc41a4e0f8 req-a75a67f1-5577-4389-9066-131f4abc9efe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbd01fa3-108f-4365-b722-b2a0af32983b", "name": "network-vif-deleted", "tag": "8383672e-6343-4633-a903-42e13011e626"}]} {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 13:50:48.929236 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-de7e690e-442b-4de0-bbbf-67adf842751c tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af1daddbc1b84ab79f269e124cbea4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b58d317ad84e46be85ed15b3e51c2f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:50:48.939989 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-de7e690e-442b-4de0-bbbf-67adf842751c tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] 10.222.0.36 "GET /compute/v2.1/servers/bbd01fa3-108f-4365-b722-b2a0af32983b" status: 200 len: 1463 microversion: 2.1 time: 0.245355 Oct 15 13:50:48.942975 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 138/284] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:50:48 2022] GET /compute/v2.1/servers/bbd01fa3-108f-4365-b722-b2a0af32983b => generated 1463 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:50:48.944455 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [req-1ba3a8e6-bc07-4d8d-bf2f-a4cc41a4e0f8 req-a75a67f1-5577-4389-9066-131f4abc9efe service nova] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:48.945130 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [req-1ba3a8e6-bc07-4d8d-bf2f-a4cc41a4e0f8 req-a75a67f1-5577-4389-9066-131f4abc9efe service nova] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:48.945844 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [req-1ba3a8e6-bc07-4d8d-bf2f-a4cc41a4e0f8 req-a75a67f1-5577-4389-9066-131f4abc9efe service nova] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:48.958721 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.compute.server_external_events [req-1ba3a8e6-bc07-4d8d-bf2f-a4cc41a4e0f8 req-a75a67f1-5577-4389-9066-131f4abc9efe service nova] Creating event network-vif-deleted:8383672e-6343-4633-a903-42e13011e626 for instance bbd01fa3-108f-4365-b722-b2a0af32983b on hv-cinder-86149 Oct 15 13:50:48.964630 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [req-1ba3a8e6-bc07-4d8d-bf2f-a4cc41a4e0f8 req-a75a67f1-5577-4389-9066-131f4abc9efe service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051403 Oct 15 13:50:48.970186 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 147/285] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 15 13:50:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 15 13:50:49.954261 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-ebbed1d1-2c61-4004-a121-1d7386149e84 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:50:49.956275 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-ebbed1d1-2c61-4004-a121-1d7386149e84 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] [instance: 242ed9b0-fe03-4583-ad2f-4760e86d2031] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:50:49.970428 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-ebbed1d1-2c61-4004-a121-1d7386149e84 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:49.971843 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-ebbed1d1-2c61-4004-a121-1d7386149e84 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:49.972756 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-ebbed1d1-2c61-4004-a121-1d7386149e84 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:49.974120 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-ebbed1d1-2c61-4004-a121-1d7386149e84 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:49.975113 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-ebbed1d1-2c61-4004-a121-1d7386149e84 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:49.975943 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-ebbed1d1-2c61-4004-a121-1d7386149e84 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:49.996058 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-9e52f2f5-ec45-4e73-89ee-06f6717deb6c tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:50:49.999228 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-9e52f2f5-ec45-4e73-89ee-06f6717deb6c tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] [instance: bbd01fa3-108f-4365-b722-b2a0af32983b] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:50:50.013176 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-9e52f2f5-ec45-4e73-89ee-06f6717deb6c tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:50.015429 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-9e52f2f5-ec45-4e73-89ee-06f6717deb6c tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:50.017341 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-9e52f2f5-ec45-4e73-89ee-06f6717deb6c tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:50.018975 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-9e52f2f5-ec45-4e73-89ee-06f6717deb6c tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:50.020115 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-9e52f2f5-ec45-4e73-89ee-06f6717deb6c tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:50.021122 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-9e52f2f5-ec45-4e73-89ee-06f6717deb6c tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:50.112361 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-9e52f2f5-ec45-4e73-89ee-06f6717deb6c tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:50.113821 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-9e52f2f5-ec45-4e73-89ee-06f6717deb6c tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:50.115090 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-9e52f2f5-ec45-4e73-89ee-06f6717deb6c tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:50.116180 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.objects.instance [None req-9e52f2f5-ec45-4e73-89ee-06f6717deb6c tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lazy-loading 'fault' on Instance uuid bbd01fa3-108f-4365-b722-b2a0af32983b {{(pid=125243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 15 13:50:50.191746 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-9e52f2f5-ec45-4e73-89ee-06f6717deb6c tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af1daddbc1b84ab79f269e124cbea4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b58d317ad84e46be85ed15b3e51c2f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:50:50.213861 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-9e52f2f5-ec45-4e73-89ee-06f6717deb6c tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] 10.222.0.36 "GET /compute/v2.1/servers/bbd01fa3-108f-4365-b722-b2a0af32983b" status: 200 len: 1304 microversion: 2.1 time: 0.227167 Oct 15 13:50:50.228041 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 148/286] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:50:49 2022] GET /compute/v2.1/servers/bbd01fa3-108f-4365-b722-b2a0af32983b => generated 1304 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:50:50.261593 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-ebbed1d1-2c61-4004-a121-1d7386149e84 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5150c06020594efe957359f641eba5da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a0813bae074cd2aa552be82abe8493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:50:50.271829 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-ebbed1d1-2c61-4004-a121-1d7386149e84 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] 10.222.0.36 "GET /compute/v2.1/servers/242ed9b0-fe03-4583-ad2f-4760e86d2031" status: 200 len: 1503 microversion: 2.1 time: 0.325725 Oct 15 13:50:50.273047 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 139/287] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:50:49 2022] GET /compute/v2.1/servers/242ed9b0-fe03-4583-ad2f-4760e86d2031 => generated 1503 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:50:50.304817 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-39597220-5764-471d-ae41-64c727773444 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "59340521-76a5-4a5f-8718-8d115e6b5c8f"}} {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 13:50:50.308958 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-39597220-5764-471d-ae41-64c727773444 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] [instance: 242ed9b0-fe03-4583-ad2f-4760e86d2031] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:50:50.324783 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-39597220-5764-471d-ae41-64c727773444 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:50.325363 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-39597220-5764-471d-ae41-64c727773444 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:50.325811 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-39597220-5764-471d-ae41-64c727773444 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:50.330444 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-39597220-5764-471d-ae41-64c727773444 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:50.331985 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-39597220-5764-471d-ae41-64c727773444 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:50.333013 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-39597220-5764-471d-ae41-64c727773444 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:50.543495 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.wsgi [None req-39597220-5764-471d-ae41-64c727773444 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] HTTP exception thrown: Cannot 'attach_volume' instance 242ed9b0-fe03-4583-ad2f-4760e86d2031 while it is in vm_state rescued Oct 15 13:50:50.545788 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-39597220-5764-471d-ae41-64c727773444 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Request method failure captured: Oct 15 13:50:50.545788 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: request: POST /compute/v2.1/servers/242ed9b0-fe03-4583-ad2f-4760e86d2031/os-volume_attachments HTTP/1.1 Oct 15 13:50:50.545788 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: Accept: application/json Oct 15 13:50:50.545788 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: Accept-Encoding: identity Oct 15 13:50:50.545788 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: Connection: close Oct 15 13:50:50.545788 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: Content-Length: 74 Oct 15 13:50:50.545788 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: Content-Type: application/json Oct 15 13:50:50.545788 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: Host: 10.222.0.36 Oct 15 13:50:50.545788 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: Openstack-System-Scope: None Oct 15 13:50:50.545788 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: User-Agent: python-urllib3/1.26.12 Oct 15 13:50:50.545788 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Auth-Token: gAAAAABjSrpDCbLnTEW_xEPAEWkhuHsRghFnNiYiSlFqABBnErC6h60c64D-HBU-sQLJ5OEFDKVHgv-ufGo5DM3852LBGobRbu9Cvywx7lBbDmHNFrYQMi7AZajfH_h200LKqYKwyZ50VzbOvILBgFaEam8UeQ6PXpFFptes7s3dL6W33wOCdG0 Oct 15 13:50:50.545788 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Domain-Id: None Oct 15 13:50:50.545788 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Domain-Name: None Oct 15 13:50:50.545788 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Identity-Status: Confirmed Oct 15 13:50:50.545788 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Is-Admin-Project: True Oct 15 13:50:50.545788 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Project-Domain-Id: default Oct 15 13:50:50.545788 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Project-Domain-Name: Default Oct 15 13:50:50.545788 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Project-Id: 09a0813bae074cd2aa552be82abe8493 Oct 15 13:50:50.545788 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1946714780 Oct 15 13:50:50.545788 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Role: member,reader Oct 15 13:50:50.545788 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Roles: member,reader Oct 15 13:50:50.549127 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_09a0813bae074cd2aa552be82abe8493", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/09a0813bae074cd2aa552be82abe8493"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/09a0813bae074cd2aa552be82abe8493"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/09a0813bae074cd2aa552be82abe8493"}]}] Oct 15 13:50:50.549127 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1946714780 Oct 15 13:50:50.549127 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Tenant-Id: 09a0813bae074cd2aa552be82abe8493 Oct 15 13:50:50.549127 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1946714780 Oct 15 13:50:50.549127 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-User: tempest-ServerRescueNegativeTestJSON-1946714780-project Oct 15 13:50:50.549127 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-User-Domain-Id: default Oct 15 13:50:50.549127 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-User-Domain-Name: Default Oct 15 13:50:50.549127 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-User-Id: 5150c06020594efe957359f641eba5da Oct 15 13:50:50.549127 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1946714780-project Oct 15 13:50:50.549127 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: Oct 15 13:50:50.549127 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: {"volumeAttachment": {"volumeId": "59340521-76a5-4a5f-8718-8d115e6b5c8f"}} Oct 15 13:50:50.549127 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: method: > Oct 15 13:50:50.552032 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: exception: Cannot 'attach_volume' instance 242ed9b0-fe03-4583-ad2f-4760e86d2031 while it is in vm_state rescued Oct 15 13:50:50.552032 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: action_args: {'server_id': '242ed9b0-fe03-4583-ad2f-4760e86d2031', 'body': {'volumeAttachment': {'volumeId': '59340521-76a5-4a5f-8718-8d115e6b5c8f'}}} Oct 15 13:50:50.552032 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 15 13:50:50.552032 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 13:50:50.552032 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 15 13:50:50.552032 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 15 13:50:50.552032 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 15 13:50:50.552032 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 15 13:50:50.552032 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 15 13:50:50.552032 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 15 13:50:50.552032 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 242ed9b0-fe03-4583-ad2f-4760e86d2031 in vm_state rescued. Cannot attach_volume while the instance is in this state. Oct 15 13:50:50.552032 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Oct 15 13:50:50.552032 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 13:50:50.552032 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Oct 15 13:50:50.552032 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 13:50:50.552032 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 13:50:50.552032 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 13:50:50.552032 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 15 13:50:50.552032 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 15 13:50:50.554556 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 15 13:50:50.554556 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 15 13:50:50.554556 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 15 13:50:50.554556 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 15 13:50:50.554556 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 15 13:50:50.554556 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 15 13:50:50.554556 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 15 13:50:50.554556 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 15 13:50:50.554556 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Oct 15 13:50:50.554556 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 15 13:50:50.554556 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 15 13:50:50.554556 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 15 13:50:50.554556 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 242ed9b0-fe03-4583-ad2f-4760e86d2031 while it is in vm_state rescued Oct 15 13:50:50.554556 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Oct 15 13:50:50.554556 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 13:50:50.554556 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Oct 15 13:50:50.554556 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 13:50:50.554556 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 13:50:50.554556 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 13:50:50.559507 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 15 13:50:50.559507 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 15 13:50:50.559507 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 242ed9b0-fe03-4583-ad2f-4760e86d2031 while it is in vm_state rescued Oct 15 13:50:50.559507 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Oct 15 13:50:50.559507 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-39597220-5764-471d-ae41-64c727773444 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Returning 409 to user: Cannot 'attach_volume' instance 242ed9b0-fe03-4583-ad2f-4760e86d2031 while it is in vm_state rescued {{(pid=125243) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 15 13:50:50.559507 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-39597220-5764-471d-ae41-64c727773444 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] 10.222.0.36 "POST /compute/v2.1/servers/242ed9b0-fe03-4583-ad2f-4760e86d2031/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.255093 Oct 15 13:50:50.559507 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 149/288] 10.222.0.36 () {60 vars in 1323 bytes} [Sat Oct 15 13:50:50 2022] POST /compute/v2.1/servers/242ed9b0-fe03-4583-ad2f-4760e86d2031/os-volume_attachments => generated 152 bytes in 258 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 15 13:50:50.561109 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-2d774eb6-e17e-47ff-b23e-fa7db5bea34c tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 13:50:50.561109 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-2d774eb6-e17e-47ff-b23e-fa7db5bea34c tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] [instance: 242ed9b0-fe03-4583-ad2f-4760e86d2031] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:50:50.578185 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-2d774eb6-e17e-47ff-b23e-fa7db5bea34c tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:50.578185 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-2d774eb6-e17e-47ff-b23e-fa7db5bea34c tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:50.578735 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-2d774eb6-e17e-47ff-b23e-fa7db5bea34c tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:50.579339 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-2d774eb6-e17e-47ff-b23e-fa7db5bea34c tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:50.579749 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-2d774eb6-e17e-47ff-b23e-fa7db5bea34c tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:50.580234 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-2d774eb6-e17e-47ff-b23e-fa7db5bea34c tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:50.672156 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-2d774eb6-e17e-47ff-b23e-fa7db5bea34c tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] 10.222.0.36 "POST /compute/v2.1/servers/242ed9b0-fe03-4583-ad2f-4760e86d2031/action" status: 202 len: 0 microversion: 2.1 time: 0.113503 Oct 15 13:50:50.676960 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 140/289] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 15 13:50:50 2022] POST /compute/v2.1/servers/242ed9b0-fe03-4583-ad2f-4760e86d2031/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 15 13:50:50.693056 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-e16f8e42-d730-4d0f-bdfa-f636e336ce82 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:50:50.697260 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-e16f8e42-d730-4d0f-bdfa-f636e336ce82 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] [instance: 242ed9b0-fe03-4583-ad2f-4760e86d2031] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:50:50.715955 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-e16f8e42-d730-4d0f-bdfa-f636e336ce82 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:50.717225 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-e16f8e42-d730-4d0f-bdfa-f636e336ce82 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:50.717992 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-e16f8e42-d730-4d0f-bdfa-f636e336ce82 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:50.719457 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-e16f8e42-d730-4d0f-bdfa-f636e336ce82 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:50.720971 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-e16f8e42-d730-4d0f-bdfa-f636e336ce82 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:50.721879 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-e16f8e42-d730-4d0f-bdfa-f636e336ce82 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:51.095445 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-e16f8e42-d730-4d0f-bdfa-f636e336ce82 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5150c06020594efe957359f641eba5da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a0813bae074cd2aa552be82abe8493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:50:51.110897 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-e16f8e42-d730-4d0f-bdfa-f636e336ce82 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] 10.222.0.36 "GET /compute/v2.1/servers/242ed9b0-fe03-4583-ad2f-4760e86d2031" status: 200 len: 1511 microversion: 2.1 time: 0.427974 Oct 15 13:50:51.112250 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 150/290] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:50:50 2022] GET /compute/v2.1/servers/242ed9b0-fe03-4583-ad2f-4760e86d2031 => generated 1511 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 13:50:51.260707 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-08ba2a39-fdf4-4f67-9f30-700f09115232 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:50:51.262942 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-08ba2a39-fdf4-4f67-9f30-700f09115232 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] [instance: bbd01fa3-108f-4365-b722-b2a0af32983b] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:50:51.293639 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-08ba2a39-fdf4-4f67-9f30-700f09115232 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:51.295036 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-08ba2a39-fdf4-4f67-9f30-700f09115232 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:51.296118 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-08ba2a39-fdf4-4f67-9f30-700f09115232 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:51.298162 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-08ba2a39-fdf4-4f67-9f30-700f09115232 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:51.302362 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-08ba2a39-fdf4-4f67-9f30-700f09115232 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:51.303113 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-08ba2a39-fdf4-4f67-9f30-700f09115232 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:51.373496 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.wsgi [None req-08ba2a39-fdf4-4f67-9f30-700f09115232 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] HTTP exception thrown: Instance bbd01fa3-108f-4365-b722-b2a0af32983b could not be found. Oct 15 13:50:51.380352 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-08ba2a39-fdf4-4f67-9f30-700f09115232 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Request method failure captured: Oct 15 13:50:51.380352 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: request: GET /compute/v2.1/servers/bbd01fa3-108f-4365-b722-b2a0af32983b HTTP/1.1 Oct 15 13:50:51.380352 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Accept: application/json Oct 15 13:50:51.380352 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Accept-Encoding: identity Oct 15 13:50:51.380352 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Connection: close Oct 15 13:50:51.380352 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Content-Length: 0 Oct 15 13:50:51.380352 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Content-Type: application/json Oct 15 13:50:51.380352 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Host: 10.222.0.36 Oct 15 13:50:51.380352 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Openstack-System-Scope: None Oct 15 13:50:51.380352 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: User-Agent: python-urllib3/1.26.12 Oct 15 13:50:51.380352 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Auth-Token: gAAAAABjSrqNrHuKlzS3sCf4phixfbY8S16llIeGSZ-cSrlfMLSx1K31AIZdBxfdxUKDZc7EKCOPzPJ2-_HOB9pHsJ7sXDh4-z_FzQP1F3Ytuy4p1lFavoyZdJHN29ALsLVqcSGgYDi_thBCjxJ5bihkZWfeleXHKKFeDWeDCRF2xLXtZh6rMDw Oct 15 13:50:51.380352 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Domain-Id: None Oct 15 13:50:51.380352 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Domain-Name: None Oct 15 13:50:51.380352 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Identity-Status: Confirmed Oct 15 13:50:51.380352 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Is-Admin-Project: True Oct 15 13:50:51.380352 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Project-Domain-Id: default Oct 15 13:50:51.380352 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Project-Domain-Name: Default Oct 15 13:50:51.380352 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Project-Id: b58d317ad84e46be85ed15b3e51c2f97 Oct 15 13:50:51.380352 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Project-Name: tempest-VolumesActionsTest-1758441097 Oct 15 13:50:51.380352 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Role: member,reader Oct 15 13:50:51.380352 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Roles: member,reader Oct 15 13:50:51.382721 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_b58d317ad84e46be85ed15b3e51c2f97", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b58d317ad84e46be85ed15b3e51c2f97"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b58d317ad84e46be85ed15b3e51c2f97"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/b58d317ad84e46be85ed15b3e51c2f97"}]}] Oct 15 13:50:51.382721 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Tenant: tempest-VolumesActionsTest-1758441097 Oct 15 13:50:51.382721 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Tenant-Id: b58d317ad84e46be85ed15b3e51c2f97 Oct 15 13:50:51.382721 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Tenant-Name: tempest-VolumesActionsTest-1758441097 Oct 15 13:50:51.382721 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-User: tempest-VolumesActionsTest-1758441097-project Oct 15 13:50:51.382721 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-User-Domain-Id: default Oct 15 13:50:51.382721 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-User-Domain-Name: Default Oct 15 13:50:51.382721 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-User-Id: af1daddbc1b84ab79f269e124cbea4fb Oct 15 13:50:51.382721 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-User-Name: tempest-VolumesActionsTest-1758441097-project Oct 15 13:50:51.382721 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: method: > Oct 15 13:50:51.382721 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: exception: Instance bbd01fa3-108f-4365-b722-b2a0af32983b could not be found. Oct 15 13:50:51.382721 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: action_args: {'id': 'bbd01fa3-108f-4365-b722-b2a0af32983b'} Oct 15 13:50:51.384119 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 15 13:50:51.384119 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 13:50:51.384119 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 15 13:50:51.384119 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 15 13:50:51.384119 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 15 13:50:51.384119 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 15 13:50:51.384119 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 15 13:50:51.384119 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 15 13:50:51.384119 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 15 13:50:51.384119 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 15 13:50:51.384119 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bbd01fa3-108f-4365-b722-b2a0af32983b could not be found. Oct 15 13:50:51.384119 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Oct 15 13:50:51.384119 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 13:50:51.384119 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Oct 15 13:50:51.384119 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 13:50:51.384119 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 13:50:51.384119 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 13:50:51.384119 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 15 13:50:51.384119 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 15 13:50:51.384119 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 15 13:50:51.387432 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 15 13:50:51.387432 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 15 13:50:51.387432 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 15 13:50:51.387432 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 15 13:50:51.387432 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 15 13:50:51.387432 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 15 13:50:51.387432 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 15 13:50:51.387432 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bbd01fa3-108f-4365-b722-b2a0af32983b could not be found. Oct 15 13:50:51.387432 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Oct 15 13:50:51.387432 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 13:50:51.387432 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Oct 15 13:50:51.387432 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 13:50:51.387432 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 13:50:51.387432 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 13:50:51.387432 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 15 13:50:51.387432 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 15 13:50:51.387432 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bbd01fa3-108f-4365-b722-b2a0af32983b could not be found. Oct 15 13:50:51.387432 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Oct 15 13:50:51.391130 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-08ba2a39-fdf4-4f67-9f30-700f09115232 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Returning 404 to user: Instance bbd01fa3-108f-4365-b722-b2a0af32983b could not be found. {{(pid=125242) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 15 13:50:51.394342 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-08ba2a39-fdf4-4f67-9f30-700f09115232 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] 10.222.0.36 "GET /compute/v2.1/servers/bbd01fa3-108f-4365-b722-b2a0af32983b" status: 404 len: 111 microversion: 2.1 time: 0.151192 Oct 15 13:50:51.395461 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 141/291] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:50:51 2022] GET /compute/v2.1/servers/bbd01fa3-108f-4365-b722-b2a0af32983b => generated 111 bytes in 155 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 15 13:50:51.574183 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-2a06fd48-f463-438a-b43f-0c7a18ca8f36 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1467002163", "imageRef": "26e64909-1cae-49ca-af5e-adea40c062d7", "flavorRef": "452", "networks": [{"uuid": "48059652-91b4-4864-bff2-b040e5893a7d"}]}} {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 13:50:51.674917 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.network.neutron [None req-2a06fd48-f463-438a-b43f-0c7a18ca8f36 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] validate_networks() for [('48059652-91b4-4864-bff2-b040e5893a7d', None, None, None, None, None)] {{(pid=125243) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 15 13:50:52.137276 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-e37a13e9-ff3f-423f-a673-6348bcbbdc81 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:50:52.138215 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-e37a13e9-ff3f-423f-a673-6348bcbbdc81 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] [instance: 242ed9b0-fe03-4583-ad2f-4760e86d2031] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:50:52.145692 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-e37a13e9-ff3f-423f-a673-6348bcbbdc81 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:52.146305 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-e37a13e9-ff3f-423f-a673-6348bcbbdc81 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:52.146957 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-e37a13e9-ff3f-423f-a673-6348bcbbdc81 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:52.148222 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-e37a13e9-ff3f-423f-a673-6348bcbbdc81 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:52.148935 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-e37a13e9-ff3f-423f-a673-6348bcbbdc81 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:52.149369 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-e37a13e9-ff3f-423f-a673-6348bcbbdc81 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:52.162769 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.virt.hardware [None req-2a06fd48-f463-438a-b43f-0c7a18ca8f36 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Flavor limits 0:0:0 {{(pid=125243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 15 13:50:52.164908 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.virt.hardware [None req-2a06fd48-f463-438a-b43f-0c7a18ca8f36 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Image limits 0:0:0 {{(pid=125243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 15 13:50:52.165713 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.virt.hardware [None req-2a06fd48-f463-438a-b43f-0c7a18ca8f36 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Flavor pref 0:0:0 {{(pid=125243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 15 13:50:52.166141 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.virt.hardware [None req-2a06fd48-f463-438a-b43f-0c7a18ca8f36 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Image pref 0:0:0 {{(pid=125243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 15 13:50:52.166578 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.virt.hardware [None req-2a06fd48-f463-438a-b43f-0c7a18ca8f36 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 15 13:50:52.176276 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-2a06fd48-f463-438a-b43f-0c7a18ca8f36 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:52.176670 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-2a06fd48-f463-438a-b43f-0c7a18ca8f36 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:52.177104 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-2a06fd48-f463-438a-b43f-0c7a18ca8f36 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:52.177816 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-2a06fd48-f463-438a-b43f-0c7a18ca8f36 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:52.178264 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-2a06fd48-f463-438a-b43f-0c7a18ca8f36 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:52.178681 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-2a06fd48-f463-438a-b43f-0c7a18ca8f36 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:52.201045 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.quota [None req-2a06fd48-f463-438a-b43f-0c7a18ca8f36 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Getting quotas for project b58d317ad84e46be85ed15b3e51c2f97. Resources: {'cores', 'ram', 'instances'} {{(pid=125243) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 15 13:50:52.206153 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.quota [None req-2a06fd48-f463-438a-b43f-0c7a18ca8f36 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Getting quotas for user af1daddbc1b84ab79f269e124cbea4fb and project b58d317ad84e46be85ed15b3e51c2f97. Resources: {'cores', 'ram', 'instances'} {{(pid=125243) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 15 13:50:52.216381 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG dbcounter [-] [125243] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=125243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:50:52.220791 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-2a06fd48-f463-438a-b43f-0c7a18ca8f36 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Going to run 1 instances... {{(pid=125243) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 15 13:50:52.223135 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-2a06fd48-f463-438a-b43f-0c7a18ca8f36 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] [instance: 825eb626-f7a1-4cf6-b2f7-d7b31fd2e4fc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='26e64909-1cae-49ca-af5e-adea40c062d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125243) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 15 13:50:52.296312 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-2a06fd48-f463-438a-b43f-0c7a18ca8f36 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.729408 Oct 15 13:50:52.298330 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 151/292] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 15 13:50:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 733 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 15 13:50:52.311007 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-af7a8b00-691e-46ac-a75a-bf202146a2b0 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:50:52.311822 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-af7a8b00-691e-46ac-a75a-bf202146a2b0 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] [instance: 825eb626-f7a1-4cf6-b2f7-d7b31fd2e4fc] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:50:52.343109 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-e37a13e9-ff3f-423f-a673-6348bcbbdc81 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5150c06020594efe957359f641eba5da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a0813bae074cd2aa552be82abe8493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:50:52.358964 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-e37a13e9-ff3f-423f-a673-6348bcbbdc81 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] 10.222.0.36 "GET /compute/v2.1/servers/242ed9b0-fe03-4583-ad2f-4760e86d2031" status: 200 len: 1511 microversion: 2.1 time: 0.227258 Oct 15 13:50:52.360979 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 142/293] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:50:52 2022] GET /compute/v2.1/servers/242ed9b0-fe03-4583-ad2f-4760e86d2031 => generated 1511 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 13:50:52.384582 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-af7a8b00-691e-46ac-a75a-bf202146a2b0 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af1daddbc1b84ab79f269e124cbea4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b58d317ad84e46be85ed15b3e51c2f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:50:52.393270 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-af7a8b00-691e-46ac-a75a-bf202146a2b0 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] 10.222.0.36 "GET /compute/v2.1/servers/825eb626-f7a1-4cf6-b2f7-d7b31fd2e4fc" status: 200 len: 1214 microversion: 2.1 time: 0.086406 Oct 15 13:50:52.395979 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 152/294] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:50:52 2022] GET /compute/v2.1/servers/825eb626-f7a1-4cf6-b2f7-d7b31fd2e4fc => generated 1214 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:50:53.403010 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-499f4840-2080-4224-86ec-b86e74978f7c tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:50:53.403725 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-499f4840-2080-4224-86ec-b86e74978f7c tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] [instance: 242ed9b0-fe03-4583-ad2f-4760e86d2031] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:50:53.411523 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-499f4840-2080-4224-86ec-b86e74978f7c tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:53.412056 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-499f4840-2080-4224-86ec-b86e74978f7c tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:53.412500 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-499f4840-2080-4224-86ec-b86e74978f7c tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:53.413224 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-499f4840-2080-4224-86ec-b86e74978f7c tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:53.413707 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-499f4840-2080-4224-86ec-b86e74978f7c tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:53.414130 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-499f4840-2080-4224-86ec-b86e74978f7c tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:53.427515 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-8c18e17e-930d-47d8-a450-63961832479e tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:50:53.428335 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-8c18e17e-930d-47d8-a450-63961832479e tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] [instance: 825eb626-f7a1-4cf6-b2f7-d7b31fd2e4fc] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:50:53.434801 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-8c18e17e-930d-47d8-a450-63961832479e tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:53.435676 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-8c18e17e-930d-47d8-a450-63961832479e tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:53.436753 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-8c18e17e-930d-47d8-a450-63961832479e tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:53.436753 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-8c18e17e-930d-47d8-a450-63961832479e tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:53.437190 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-8c18e17e-930d-47d8-a450-63961832479e tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:53.437585 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-8c18e17e-930d-47d8-a450-63961832479e tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:53.565340 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-8c18e17e-930d-47d8-a450-63961832479e tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af1daddbc1b84ab79f269e124cbea4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b58d317ad84e46be85ed15b3e51c2f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:50:53.576328 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-8c18e17e-930d-47d8-a450-63961832479e tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] 10.222.0.36 "GET /compute/v2.1/servers/825eb626-f7a1-4cf6-b2f7-d7b31fd2e4fc" status: 200 len: 1218 microversion: 2.1 time: 0.152603 Oct 15 13:50:53.577247 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 153/295] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:50:53 2022] GET /compute/v2.1/servers/825eb626-f7a1-4cf6-b2f7-d7b31fd2e4fc => generated 1218 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:50:53.583848 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-9ac9e580-ba59-4ecc-af49-2c86dff254d3 tempest-VolumesTestJSON-1469365267 tempest-VolumesTestJSON-1469365267-project] Calling method '.version_select at 0x7f1b5e3cac10>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:50:53.650577 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-9ac9e580-ba59-4ecc-af49-2c86dff254d3 tempest-VolumesTestJSON-1469365267 tempest-VolumesTestJSON-1469365267-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/106f70e3-71ef-4342-98e6-9d0db1cd5123" status: 200 len: 351 microversion: 2.1 time: 0.071509 Oct 15 13:50:53.655949 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 154/296] 10.222.0.36 () {58 vars in 1245 bytes} [Sat Oct 15 13:50:53 2022] GET /compute/v2.1/os-volumes/106f70e3-71ef-4342-98e6-9d0db1cd5123 => generated 351 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 13:50:53.661202 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-499f4840-2080-4224-86ec-b86e74978f7c tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5150c06020594efe957359f641eba5da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a0813bae074cd2aa552be82abe8493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:50:53.667241 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG dbcounter [-] [125242] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:50:53.673048 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-499f4840-2080-4224-86ec-b86e74978f7c tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] 10.222.0.36 "GET /compute/v2.1/servers/242ed9b0-fe03-4583-ad2f-4760e86d2031" status: 200 len: 1511 microversion: 2.1 time: 0.274127 Oct 15 13:50:53.673955 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 143/297] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:50:53 2022] GET /compute/v2.1/servers/242ed9b0-fe03-4583-ad2f-4760e86d2031 => generated 1511 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:50:54.616642 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-ef9f0f2b-c97f-473d-b9b1-b11f6ba6edcd tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:50:54.617764 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-ef9f0f2b-c97f-473d-b9b1-b11f6ba6edcd tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] [instance: 825eb626-f7a1-4cf6-b2f7-d7b31fd2e4fc] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:50:54.629600 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-ef9f0f2b-c97f-473d-b9b1-b11f6ba6edcd tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:54.630288 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-ef9f0f2b-c97f-473d-b9b1-b11f6ba6edcd tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:54.630814 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-ef9f0f2b-c97f-473d-b9b1-b11f6ba6edcd tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:54.631554 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-ef9f0f2b-c97f-473d-b9b1-b11f6ba6edcd tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:54.632053 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-ef9f0f2b-c97f-473d-b9b1-b11f6ba6edcd tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:54.632478 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-ef9f0f2b-c97f-473d-b9b1-b11f6ba6edcd tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:54.700882 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-f54c338b-a113-4db5-afcd-acb13b6f9086 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:50:54.702584 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-f54c338b-a113-4db5-afcd-acb13b6f9086 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] [instance: 242ed9b0-fe03-4583-ad2f-4760e86d2031] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:50:54.706001 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG dbcounter [-] [125242] Writing DB stats nova_api:SELECT=74 {{(pid=125242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:50:54.715951 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-f54c338b-a113-4db5-afcd-acb13b6f9086 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:54.716448 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-f54c338b-a113-4db5-afcd-acb13b6f9086 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:54.716935 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-f54c338b-a113-4db5-afcd-acb13b6f9086 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:54.718046 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-f54c338b-a113-4db5-afcd-acb13b6f9086 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:54.718510 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-f54c338b-a113-4db5-afcd-acb13b6f9086 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:54.719039 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-f54c338b-a113-4db5-afcd-acb13b6f9086 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:54.768928 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-ef9f0f2b-c97f-473d-b9b1-b11f6ba6edcd tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af1daddbc1b84ab79f269e124cbea4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b58d317ad84e46be85ed15b3e51c2f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:50:54.791736 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-ef9f0f2b-c97f-473d-b9b1-b11f6ba6edcd tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] 10.222.0.36 "GET /compute/v2.1/servers/825eb626-f7a1-4cf6-b2f7-d7b31fd2e4fc" status: 200 len: 1218 microversion: 2.1 time: 0.184195 Oct 15 13:50:54.794120 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 155/298] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:50:54 2022] GET /compute/v2.1/servers/825eb626-f7a1-4cf6-b2f7-d7b31fd2e4fc => generated 1218 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:50:55.001282 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-f54c338b-a113-4db5-afcd-acb13b6f9086 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5150c06020594efe957359f641eba5da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a0813bae074cd2aa552be82abe8493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:50:55.011307 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-f54c338b-a113-4db5-afcd-acb13b6f9086 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] 10.222.0.36 "GET /compute/v2.1/servers/242ed9b0-fe03-4583-ad2f-4760e86d2031" status: 200 len: 1511 microversion: 2.1 time: 0.317165 Oct 15 13:50:55.011941 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 144/299] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:50:54 2022] GET /compute/v2.1/servers/242ed9b0-fe03-4583-ad2f-4760e86d2031 => generated 1511 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:50:55.816334 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-3e03e37b-05e4-42b3-a61a-da9ecc8272b6 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:50:55.816948 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-3e03e37b-05e4-42b3-a61a-da9ecc8272b6 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] [instance: 825eb626-f7a1-4cf6-b2f7-d7b31fd2e4fc] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:50:55.823650 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-3e03e37b-05e4-42b3-a61a-da9ecc8272b6 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:55.824212 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-3e03e37b-05e4-42b3-a61a-da9ecc8272b6 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:55.824618 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-3e03e37b-05e4-42b3-a61a-da9ecc8272b6 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:55.825353 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-3e03e37b-05e4-42b3-a61a-da9ecc8272b6 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:55.825799 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-3e03e37b-05e4-42b3-a61a-da9ecc8272b6 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:55.826230 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-3e03e37b-05e4-42b3-a61a-da9ecc8272b6 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:55.979619 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-3e03e37b-05e4-42b3-a61a-da9ecc8272b6 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af1daddbc1b84ab79f269e124cbea4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b58d317ad84e46be85ed15b3e51c2f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:50:55.989321 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-3e03e37b-05e4-42b3-a61a-da9ecc8272b6 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] 10.222.0.36 "GET /compute/v2.1/servers/825eb626-f7a1-4cf6-b2f7-d7b31fd2e4fc" status: 200 len: 1266 microversion: 2.1 time: 0.176378 Oct 15 13:50:55.990049 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 156/300] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:50:55 2022] GET /compute/v2.1/servers/825eb626-f7a1-4cf6-b2f7-d7b31fd2e4fc => generated 1266 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:50:56.044190 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-71231dd5-0c5b-4da9-bf3e-e34a07be3712 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:50:56.044911 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-71231dd5-0c5b-4da9-bf3e-e34a07be3712 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] [instance: 242ed9b0-fe03-4583-ad2f-4760e86d2031] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:50:56.062925 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-71231dd5-0c5b-4da9-bf3e-e34a07be3712 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:56.063814 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-71231dd5-0c5b-4da9-bf3e-e34a07be3712 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:56.064332 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-71231dd5-0c5b-4da9-bf3e-e34a07be3712 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:56.065124 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-71231dd5-0c5b-4da9-bf3e-e34a07be3712 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:56.065532 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-71231dd5-0c5b-4da9-bf3e-e34a07be3712 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:56.066138 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-71231dd5-0c5b-4da9-bf3e-e34a07be3712 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:56.226939 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-76bdfa7e-0095-4135-8faf-a558a266b57c tempest-VolumesTestJSON-1469365267 tempest-VolumesTestJSON-1469365267-project] Calling method '.version_select at 0x7f1b5e60b700>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:50:56.264970 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-71231dd5-0c5b-4da9-bf3e-e34a07be3712 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5150c06020594efe957359f641eba5da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a0813bae074cd2aa552be82abe8493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:50:56.274840 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-71231dd5-0c5b-4da9-bf3e-e34a07be3712 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] 10.222.0.36 "GET /compute/v2.1/servers/242ed9b0-fe03-4583-ad2f-4760e86d2031" status: 200 len: 1517 microversion: 2.1 time: 0.242949 Oct 15 13:50:56.275708 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 145/301] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:50:56 2022] GET /compute/v2.1/servers/242ed9b0-fe03-4583-ad2f-4760e86d2031 => generated 1517 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:50:56.345810 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-76bdfa7e-0095-4135-8faf-a558a266b57c tempest-VolumesTestJSON-1469365267 tempest-VolumesTestJSON-1469365267-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/9cbaa1b9-93d5-46f9-ba0d-fd4803ed251c" status: 200 len: 351 microversion: 2.1 time: 0.123187 Oct 15 13:50:56.346537 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 157/302] 10.222.0.36 () {58 vars in 1245 bytes} [Sat Oct 15 13:50:56 2022] GET /compute/v2.1/os-volumes/9cbaa1b9-93d5-46f9-ba0d-fd4803ed251c => generated 351 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 15 13:50:57.024340 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-a464261d-7aec-4dd8-89a6-73a83a314c6d tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:50:57.025373 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-a464261d-7aec-4dd8-89a6-73a83a314c6d tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] [instance: 825eb626-f7a1-4cf6-b2f7-d7b31fd2e4fc] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:50:57.056115 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-a464261d-7aec-4dd8-89a6-73a83a314c6d tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:57.056978 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-a464261d-7aec-4dd8-89a6-73a83a314c6d tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:57.057733 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-a464261d-7aec-4dd8-89a6-73a83a314c6d tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:57.062397 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-a464261d-7aec-4dd8-89a6-73a83a314c6d tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:57.066448 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-a464261d-7aec-4dd8-89a6-73a83a314c6d tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:57.067490 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-a464261d-7aec-4dd8-89a6-73a83a314c6d tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:57.422999 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-a464261d-7aec-4dd8-89a6-73a83a314c6d tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af1daddbc1b84ab79f269e124cbea4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b58d317ad84e46be85ed15b3e51c2f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:50:57.434286 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-a464261d-7aec-4dd8-89a6-73a83a314c6d tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] 10.222.0.36 "GET /compute/v2.1/servers/825eb626-f7a1-4cf6-b2f7-d7b31fd2e4fc" status: 200 len: 1314 microversion: 2.1 time: 0.422834 Oct 15 13:50:57.434898 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 146/303] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:50:57 2022] GET /compute/v2.1/servers/825eb626-f7a1-4cf6-b2f7-d7b31fd2e4fc => generated 1314 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:50:58.126939 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [req-bebecc77-8b22-4cd5-aec0-5b3c29a57df8 req-4d8e8527-8838-47d3-8796-1a8109f0690f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "825eb626-f7a1-4cf6-b2f7-d7b31fd2e4fc", "tag": "866f3568-c979-4710-80ce-b8cc5ebc5360"}]} {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 13:50:58.148530 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [req-bebecc77-8b22-4cd5-aec0-5b3c29a57df8 req-4d8e8527-8838-47d3-8796-1a8109f0690f service nova] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:58.149310 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [req-bebecc77-8b22-4cd5-aec0-5b3c29a57df8 req-4d8e8527-8838-47d3-8796-1a8109f0690f service nova] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:58.150050 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [req-bebecc77-8b22-4cd5-aec0-5b3c29a57df8 req-4d8e8527-8838-47d3-8796-1a8109f0690f service nova] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:58.177749 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.compute.server_external_events [req-bebecc77-8b22-4cd5-aec0-5b3c29a57df8 req-4d8e8527-8838-47d3-8796-1a8109f0690f service nova] Creating event network-changed:866f3568-c979-4710-80ce-b8cc5ebc5360 for instance 825eb626-f7a1-4cf6-b2f7-d7b31fd2e4fc on hv-cinder-86149 Oct 15 13:50:58.186330 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [req-bebecc77-8b22-4cd5-aec0-5b3c29a57df8 req-4d8e8527-8838-47d3-8796-1a8109f0690f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066453 Oct 15 13:50:58.189604 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 158/304] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 15 13:50:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 13:50:58.471011 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-43ff4482-4e77-456b-b6a3-afc619d42d8f tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:50:58.471944 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-43ff4482-4e77-456b-b6a3-afc619d42d8f tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] [instance: 825eb626-f7a1-4cf6-b2f7-d7b31fd2e4fc] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:50:58.479131 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-43ff4482-4e77-456b-b6a3-afc619d42d8f tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:58.479695 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-43ff4482-4e77-456b-b6a3-afc619d42d8f tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:58.480431 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-43ff4482-4e77-456b-b6a3-afc619d42d8f tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:58.481261 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-43ff4482-4e77-456b-b6a3-afc619d42d8f tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:58.481825 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-43ff4482-4e77-456b-b6a3-afc619d42d8f tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:58.482330 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-43ff4482-4e77-456b-b6a3-afc619d42d8f tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:58.675905 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-43ff4482-4e77-456b-b6a3-afc619d42d8f tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af1daddbc1b84ab79f269e124cbea4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b58d317ad84e46be85ed15b3e51c2f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:50:58.686437 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-43ff4482-4e77-456b-b6a3-afc619d42d8f tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] 10.222.0.36 "GET /compute/v2.1/servers/825eb626-f7a1-4cf6-b2f7-d7b31fd2e4fc" status: 200 len: 1314 microversion: 2.1 time: 0.219655 Oct 15 13:50:58.687301 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 147/305] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:50:58 2022] GET /compute/v2.1/servers/825eb626-f7a1-4cf6-b2f7-d7b31fd2e4fc => generated 1314 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:50:58.977128 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-6ba5e71c-c860-4303-a4c0-046f481e7be9 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Action: 'create', calling method: .version_select at 0x7f1b5e3cf040>, body: {"keypair": {"name": "tempest-keypair-835936382", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDPts4bqspSuHr4QkqyBCxdUZA8U2YYppKOSCzCFhDORod1eqLEso/aXeoJqhG3QcNHQF5BJjZidHzzqCp8kgJL4rQswhtYHtUsRRUZznNzk6J7Di2CqIm4W/FaYgQtJfQ=="}} {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 13:50:58.999324 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.quota [None req-6ba5e71c-c860-4303-a4c0-046f481e7be9 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Getting quotas for project 09a0813bae074cd2aa552be82abe8493. Resources: {'key_pairs'} {{(pid=125243) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 15 13:50:59.003856 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.quota [None req-6ba5e71c-c860-4303-a4c0-046f481e7be9 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Getting quotas for user 5150c06020594efe957359f641eba5da and project 09a0813bae074cd2aa552be82abe8493. Resources: {'key_pairs'} {{(pid=125243) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 15 13:50:59.047256 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-6ba5e71c-c860-4303-a4c0-046f481e7be9 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.074003 Oct 15 13:50:59.047774 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 159/306] 10.222.0.36 () {60 vars in 1159 bytes} [Sat Oct 15 13:50:58 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 13:50:59.733632 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-e9283247-651d-4010-a9d3-5468d9d2a7e7 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:50:59.733632 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-e9283247-651d-4010-a9d3-5468d9d2a7e7 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] [instance: 825eb626-f7a1-4cf6-b2f7-d7b31fd2e4fc] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:50:59.742834 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-e9283247-651d-4010-a9d3-5468d9d2a7e7 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:59.743707 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-e9283247-651d-4010-a9d3-5468d9d2a7e7 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:59.744513 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-e9283247-651d-4010-a9d3-5468d9d2a7e7 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:50:59.745778 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-e9283247-651d-4010-a9d3-5468d9d2a7e7 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:50:59.746592 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-e9283247-651d-4010-a9d3-5468d9d2a7e7 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:50:59.747339 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-e9283247-651d-4010-a9d3-5468d9d2a7e7 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:51:00.003691 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-e9283247-651d-4010-a9d3-5468d9d2a7e7 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af1daddbc1b84ab79f269e124cbea4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b58d317ad84e46be85ed15b3e51c2f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:51:00.034058 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-e9283247-651d-4010-a9d3-5468d9d2a7e7 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] 10.222.0.36 "GET /compute/v2.1/servers/825eb626-f7a1-4cf6-b2f7-d7b31fd2e4fc" status: 200 len: 1314 microversion: 2.1 time: 0.312186 Oct 15 13:51:00.035437 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 148/307] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:50:59 2022] GET /compute/v2.1/servers/825eb626-f7a1-4cf6-b2f7-d7b31fd2e4fc => generated 1314 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:51:00.139304 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-4f3951b5-d2e0-4bf3-be35-c88d04609787 tempest-VolumesTestJSON-1469365267 tempest-VolumesTestJSON-1469365267-project] Calling method '.version_select at 0x7f1b5e3cf5e0>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:51:00.229836 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-4f3951b5-d2e0-4bf3-be35-c88d04609787 tempest-VolumesTestJSON-1469365267 tempest-VolumesTestJSON-1469365267-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/f5666db3-2d3c-4465-a69d-943611ba1814" status: 200 len: 351 microversion: 2.1 time: 0.095000 Oct 15 13:51:00.230985 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 160/308] 10.222.0.36 () {58 vars in 1245 bytes} [Sat Oct 15 13:51:00 2022] GET /compute/v2.1/os-volumes/f5666db3-2d3c-4465-a69d-943611ba1814 => generated 351 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 13:51:00.253661 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-da6f8290-64c7-45ed-99a6-5c7842ed1bae tempest-VolumesTestJSON-1469365267 tempest-VolumesTestJSON-1469365267-project] Calling method '.version_select at 0x7f1b5e4c7700>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:51:00.364470 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-da6f8290-64c7-45ed-99a6-5c7842ed1bae tempest-VolumesTestJSON-1469365267 tempest-VolumesTestJSON-1469365267-project] 10.222.0.36 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.117433 Oct 15 13:51:00.365866 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 149/309] 10.222.0.36 () {58 vars in 1134 bytes} [Sat Oct 15 13:51:00 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:51:00.395864 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-9289a8dc-fc7c-413a-8503-08db98ec9206 tempest-VolumesTestJSON-1469365267 tempest-VolumesTestJSON-1469365267-project] Calling method '.version_select at 0x7f1b5e60b700>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:51:00.504711 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-9289a8dc-fc7c-413a-8503-08db98ec9206 tempest-VolumesTestJSON-1469365267 tempest-VolumesTestJSON-1469365267-project] 10.222.0.36 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.114730 Oct 15 13:51:00.506230 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 161/310] 10.222.0.36 () {58 vars in 1149 bytes} [Sat Oct 15 13:51:00 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 13:51:00.522751 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-88169333-5bdc-4bb3-97dd-4bbf172e014c tempest-VolumesTestJSON-1469365267 tempest-VolumesTestJSON-1469365267-project] Calling method '.version_select at 0x7f1b5e5431f0>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:51:00.638006 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-88169333-5bdc-4bb3-97dd-4bbf172e014c tempest-VolumesTestJSON-1469365267 tempest-VolumesTestJSON-1469365267-project] 10.222.0.36 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.120139 Oct 15 13:51:00.639050 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 150/311] 10.222.0.36 () {58 vars in 1134 bytes} [Sat Oct 15 13:51:00 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:51:00.663116 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-a5695059-e0eb-4941-be84-8625b87cb4f0 tempest-VolumesTestJSON-1469365267 tempest-VolumesTestJSON-1469365267-project] Calling method '.version_select at 0x7f1b5e6aae50>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:51:00.815164 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-a5695059-e0eb-4941-be84-8625b87cb4f0 tempest-VolumesTestJSON-1469365267 tempest-VolumesTestJSON-1469365267-project] 10.222.0.36 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.158735 Oct 15 13:51:00.816859 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 162/312] 10.222.0.36 () {58 vars in 1167 bytes} [Sat Oct 15 13:51:00 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 15 13:51:00.830675 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-3350fac9-ec25-4d12-8d44-9fd05e78149f tempest-VolumesTestJSON-1469365267 tempest-VolumesTestJSON-1469365267-project] Calling method '.version_select at 0x7f1b5e439700>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:51:00.925154 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-0827013a-c5e8-4c90-b0e1-21a66dc04651 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1916375966", "imageRef": "26e64909-1cae-49ca-af5e-adea40c062d7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c1b0ef41-77c8-4965-9ff6-7478183c5789"}], "security_groups": [{"name": "tempest-securitygroup--220052493"}], "key_name": "tempest-keypair-835936382", "user_data": "}} {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 13:51:00.957575 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-3350fac9-ec25-4d12-8d44-9fd05e78149f tempest-VolumesTestJSON-1469365267 tempest-VolumesTestJSON-1469365267-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.130560 Oct 15 13:51:00.957841 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 151/313] 10.222.0.36 () {58 vars in 1170 bytes} [Sat Oct 15 13:51:00 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 13:51:00.973620 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-1bcf5087-b3a2-438e-a9d5-8b2e9af62649 tempest-VolumesTestJSON-1469365267 tempest-VolumesTestJSON-1469365267-project] Calling method '.version_select at 0x7f1b5e51f550>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:51:01.128112 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-1bcf5087-b3a2-438e-a9d5-8b2e9af62649 tempest-VolumesTestJSON-1469365267 tempest-VolumesTestJSON-1469365267-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.158776 Oct 15 13:51:01.131675 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.network.neutron [None req-0827013a-c5e8-4c90-b0e1-21a66dc04651 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] validate_networks() for [('c1b0ef41-77c8-4965-9ff6-7478183c5789', None, None, None, None, None)] {{(pid=125243) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 15 13:51:01.138906 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 152/314] 10.222.0.36 () {58 vars in 1155 bytes} [Sat Oct 15 13:51:00 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:51:01.144345 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-a3dae6b4-5001-4c5c-94c8-94ba307f376e tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:51:01.144955 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-a3dae6b4-5001-4c5c-94c8-94ba307f376e tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] [instance: 825eb626-f7a1-4cf6-b2f7-d7b31fd2e4fc] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:51:01.153390 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-a3dae6b4-5001-4c5c-94c8-94ba307f376e tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:51:01.153885 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-a3dae6b4-5001-4c5c-94c8-94ba307f376e tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:51:01.154324 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-a3dae6b4-5001-4c5c-94c8-94ba307f376e tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:51:01.155071 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-a3dae6b4-5001-4c5c-94c8-94ba307f376e tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:51:01.155739 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-a3dae6b4-5001-4c5c-94c8-94ba307f376e tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:51:01.156205 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-a3dae6b4-5001-4c5c-94c8-94ba307f376e tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:51:01.443514 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-a3dae6b4-5001-4c5c-94c8-94ba307f376e tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af1daddbc1b84ab79f269e124cbea4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b58d317ad84e46be85ed15b3e51c2f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:51:01.459927 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-a3dae6b4-5001-4c5c-94c8-94ba307f376e tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] 10.222.0.36 "GET /compute/v2.1/servers/825eb626-f7a1-4cf6-b2f7-d7b31fd2e4fc" status: 200 len: 1314 microversion: 2.1 time: 0.319085 Oct 15 13:51:01.461478 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 153/315] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:51:01 2022] GET /compute/v2.1/servers/825eb626-f7a1-4cf6-b2f7-d7b31fd2e4fc => generated 1314 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:51:01.474394 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-3f129a42-83f2-418d-89bf-794fd0fe5c03 tempest-VolumesTestJSON-1469365267 tempest-VolumesTestJSON-1469365267-project] Calling method '.version_select at 0x7f1b5e6448b0>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:51:01.692683 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-3f129a42-83f2-418d-89bf-794fd0fe5c03 tempest-VolumesTestJSON-1469365267 tempest-VolumesTestJSON-1469365267-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.229041 Oct 15 13:51:01.693853 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 154/316] 10.222.0.36 () {58 vars in 1188 bytes} [Sat Oct 15 13:51:01 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 13:51:01.725729 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-60f80f49-866a-422a-98b9-e54d65c9e5ad tempest-VolumesTestJSON-1469365267 tempest-VolumesTestJSON-1469365267-project] Calling method '.version_select at 0x7f1b5e438280>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:51:01.818838 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.virt.hardware [None req-0827013a-c5e8-4c90-b0e1-21a66dc04651 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Flavor limits 0:0:0 {{(pid=125243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 15 13:51:01.819448 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.virt.hardware [None req-0827013a-c5e8-4c90-b0e1-21a66dc04651 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Image limits 0:0:0 {{(pid=125243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 15 13:51:01.819704 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.virt.hardware [None req-0827013a-c5e8-4c90-b0e1-21a66dc04651 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Flavor pref 0:0:0 {{(pid=125243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 15 13:51:01.820635 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.virt.hardware [None req-0827013a-c5e8-4c90-b0e1-21a66dc04651 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Image pref 0:0:0 {{(pid=125243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 15 13:51:01.821247 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.virt.hardware [None req-0827013a-c5e8-4c90-b0e1-21a66dc04651 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 15 13:51:01.833249 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-0827013a-c5e8-4c90-b0e1-21a66dc04651 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:51:01.833744 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-0827013a-c5e8-4c90-b0e1-21a66dc04651 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:51:01.834170 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-0827013a-c5e8-4c90-b0e1-21a66dc04651 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:51:01.834884 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-0827013a-c5e8-4c90-b0e1-21a66dc04651 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:51:01.835328 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-0827013a-c5e8-4c90-b0e1-21a66dc04651 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:51:01.835733 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-0827013a-c5e8-4c90-b0e1-21a66dc04651 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:51:01.871572 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.quota [None req-0827013a-c5e8-4c90-b0e1-21a66dc04651 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Getting quotas for project 09a0813bae074cd2aa552be82abe8493. Resources: {'cores', 'ram', 'instances'} {{(pid=125243) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 15 13:51:01.880440 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.quota [None req-0827013a-c5e8-4c90-b0e1-21a66dc04651 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Getting quotas for user 5150c06020594efe957359f641eba5da and project 09a0813bae074cd2aa552be82abe8493. Resources: {'cores', 'ram', 'instances'} {{(pid=125243) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 15 13:51:01.905837 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-0827013a-c5e8-4c90-b0e1-21a66dc04651 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Going to run 1 instances... {{(pid=125243) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 15 13:51:01.909513 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-0827013a-c5e8-4c90-b0e1-21a66dc04651 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] [instance: cb269dd0-b5af-4013-9ded-062f40176b8f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='26e64909-1cae-49ca-af5e-adea40c062d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125243) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 15 13:51:01.995097 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-0827013a-c5e8-4c90-b0e1-21a66dc04651 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.076107 Oct 15 13:51:01.997146 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 163/317] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 15 13:51:00 2022] POST /compute/v2.1/servers => generated 408 bytes in 1079 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 15 13:51:02.011409 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-b634bd79-b889-4e5a-be2b-d81e1445c043 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:51:02.012060 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-b634bd79-b889-4e5a-be2b-d81e1445c043 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] [instance: cb269dd0-b5af-4013-9ded-062f40176b8f] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:51:02.056135 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-60f80f49-866a-422a-98b9-e54d65c9e5ad tempest-VolumesTestJSON-1469365267 tempest-VolumesTestJSON-1469365267-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.347268 Oct 15 13:51:02.058485 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 155/318] 10.222.0.36 () {58 vars in 1155 bytes} [Sat Oct 15 13:51:01 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:51:02.127157 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-b634bd79-b889-4e5a-be2b-d81e1445c043 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5150c06020594efe957359f641eba5da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a0813bae074cd2aa552be82abe8493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:51:02.138991 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-b634bd79-b889-4e5a-be2b-d81e1445c043 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] 10.222.0.36 "GET /compute/v2.1/servers/cb269dd0-b5af-4013-9ded-062f40176b8f" status: 200 len: 1245 microversion: 2.1 time: 0.133775 Oct 15 13:51:02.140345 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 164/319] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:51:02 2022] GET /compute/v2.1/servers/cb269dd0-b5af-4013-9ded-062f40176b8f => generated 1245 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 13:51:02.499448 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-a18fbc11-aaf1-441d-b48a-0388d8e69f40 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:51:02.500226 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-a18fbc11-aaf1-441d-b48a-0388d8e69f40 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] [instance: 825eb626-f7a1-4cf6-b2f7-d7b31fd2e4fc] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:51:02.507588 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-a18fbc11-aaf1-441d-b48a-0388d8e69f40 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:51:02.508518 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-a18fbc11-aaf1-441d-b48a-0388d8e69f40 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:51:02.508953 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-a18fbc11-aaf1-441d-b48a-0388d8e69f40 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:51:02.509681 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-a18fbc11-aaf1-441d-b48a-0388d8e69f40 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:51:02.511434 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-a18fbc11-aaf1-441d-b48a-0388d8e69f40 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:51:02.516883 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-a18fbc11-aaf1-441d-b48a-0388d8e69f40 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:51:02.700771 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-a18fbc11-aaf1-441d-b48a-0388d8e69f40 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af1daddbc1b84ab79f269e124cbea4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b58d317ad84e46be85ed15b3e51c2f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:51:02.711904 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-a18fbc11-aaf1-441d-b48a-0388d8e69f40 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] 10.222.0.36 "GET /compute/v2.1/servers/825eb626-f7a1-4cf6-b2f7-d7b31fd2e4fc" status: 200 len: 1314 microversion: 2.1 time: 0.216768 Oct 15 13:51:02.727306 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 156/320] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:51:02 2022] GET /compute/v2.1/servers/825eb626-f7a1-4cf6-b2f7-d7b31fd2e4fc => generated 1314 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:51:03.166265 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-3188d45d-e0a7-4ce8-b90c-d55e7558bceb tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:51:03.168453 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-3188d45d-e0a7-4ce8-b90c-d55e7558bceb tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] [instance: cb269dd0-b5af-4013-9ded-062f40176b8f] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:51:03.179660 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-3188d45d-e0a7-4ce8-b90c-d55e7558bceb tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:51:03.180500 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-3188d45d-e0a7-4ce8-b90c-d55e7558bceb tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:51:03.181241 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-3188d45d-e0a7-4ce8-b90c-d55e7558bceb tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:51:03.183488 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-3188d45d-e0a7-4ce8-b90c-d55e7558bceb tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:51:03.184169 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-3188d45d-e0a7-4ce8-b90c-d55e7558bceb tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:51:03.184739 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-3188d45d-e0a7-4ce8-b90c-d55e7558bceb tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:51:03.189393 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG dbcounter [-] [125243] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:51:03.291914 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-3188d45d-e0a7-4ce8-b90c-d55e7558bceb tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5150c06020594efe957359f641eba5da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a0813bae074cd2aa552be82abe8493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:51:03.308585 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-3188d45d-e0a7-4ce8-b90c-d55e7558bceb tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] 10.222.0.36 "GET /compute/v2.1/servers/cb269dd0-b5af-4013-9ded-062f40176b8f" status: 200 len: 1241 microversion: 2.1 time: 0.149003 Oct 15 13:51:03.309895 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 165/321] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:51:03 2022] GET /compute/v2.1/servers/cb269dd0-b5af-4013-9ded-062f40176b8f => generated 1241 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:51:03.735555 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-30783121-10f1-473a-bc22-734bbb4ca212 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:51:03.736366 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-30783121-10f1-473a-bc22-734bbb4ca212 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] [instance: 825eb626-f7a1-4cf6-b2f7-d7b31fd2e4fc] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:51:03.745314 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-30783121-10f1-473a-bc22-734bbb4ca212 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:51:03.745811 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-30783121-10f1-473a-bc22-734bbb4ca212 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:51:03.746240 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-30783121-10f1-473a-bc22-734bbb4ca212 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:51:03.746925 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-30783121-10f1-473a-bc22-734bbb4ca212 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:51:03.747398 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-30783121-10f1-473a-bc22-734bbb4ca212 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:51:03.747819 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-30783121-10f1-473a-bc22-734bbb4ca212 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:51:03.931410 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-30783121-10f1-473a-bc22-734bbb4ca212 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af1daddbc1b84ab79f269e124cbea4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b58d317ad84e46be85ed15b3e51c2f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:51:03.969688 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-30783121-10f1-473a-bc22-734bbb4ca212 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] 10.222.0.36 "GET /compute/v2.1/servers/825eb626-f7a1-4cf6-b2f7-d7b31fd2e4fc" status: 200 len: 1314 microversion: 2.1 time: 0.237968 Oct 15 13:51:03.970775 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 157/322] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:51:03 2022] GET /compute/v2.1/servers/825eb626-f7a1-4cf6-b2f7-d7b31fd2e4fc => generated 1314 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:51:04.347178 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-aae7ea24-940a-4617-bd44-51978cce630c tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:51:04.348668 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-aae7ea24-940a-4617-bd44-51978cce630c tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] [instance: cb269dd0-b5af-4013-9ded-062f40176b8f] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:51:04.359604 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-aae7ea24-940a-4617-bd44-51978cce630c tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:51:04.360456 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-aae7ea24-940a-4617-bd44-51978cce630c tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:51:04.361166 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-aae7ea24-940a-4617-bd44-51978cce630c tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:51:04.362396 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-aae7ea24-940a-4617-bd44-51978cce630c tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:51:04.364596 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-aae7ea24-940a-4617-bd44-51978cce630c tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:51:04.365481 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-aae7ea24-940a-4617-bd44-51978cce630c tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:51:04.470021 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-aae7ea24-940a-4617-bd44-51978cce630c tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5150c06020594efe957359f641eba5da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a0813bae074cd2aa552be82abe8493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:51:04.486084 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-aae7ea24-940a-4617-bd44-51978cce630c tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] 10.222.0.36 "GET /compute/v2.1/servers/cb269dd0-b5af-4013-9ded-062f40176b8f" status: 200 len: 1297 microversion: 2.1 time: 0.145464 Oct 15 13:51:04.487566 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 166/323] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:51:04 2022] GET /compute/v2.1/servers/cb269dd0-b5af-4013-9ded-062f40176b8f => generated 1297 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:51:04.995459 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-8cb09d1b-91b2-401d-a131-c7050b7fff20 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:51:04.996274 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-8cb09d1b-91b2-401d-a131-c7050b7fff20 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] [instance: 825eb626-f7a1-4cf6-b2f7-d7b31fd2e4fc] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:51:05.005173 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-8cb09d1b-91b2-401d-a131-c7050b7fff20 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:51:05.005779 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-8cb09d1b-91b2-401d-a131-c7050b7fff20 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:51:05.006274 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-8cb09d1b-91b2-401d-a131-c7050b7fff20 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:51:05.007189 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-8cb09d1b-91b2-401d-a131-c7050b7fff20 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:51:05.007709 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-8cb09d1b-91b2-401d-a131-c7050b7fff20 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:51:05.008235 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-8cb09d1b-91b2-401d-a131-c7050b7fff20 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:51:05.181308 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-8cb09d1b-91b2-401d-a131-c7050b7fff20 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af1daddbc1b84ab79f269e124cbea4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b58d317ad84e46be85ed15b3e51c2f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:51:05.190596 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-8cb09d1b-91b2-401d-a131-c7050b7fff20 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] 10.222.0.36 "GET /compute/v2.1/servers/825eb626-f7a1-4cf6-b2f7-d7b31fd2e4fc" status: 200 len: 1314 microversion: 2.1 time: 0.199816 Oct 15 13:51:05.191187 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 158/324] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:51:04 2022] GET /compute/v2.1/servers/825eb626-f7a1-4cf6-b2f7-d7b31fd2e4fc => generated 1314 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:51:05.521636 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-2a2332fc-3da4-45d0-97b3-0a8d0f555ac5 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:51:05.522777 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-2a2332fc-3da4-45d0-97b3-0a8d0f555ac5 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] [instance: cb269dd0-b5af-4013-9ded-062f40176b8f] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:51:05.534689 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-2a2332fc-3da4-45d0-97b3-0a8d0f555ac5 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:51:05.535527 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-2a2332fc-3da4-45d0-97b3-0a8d0f555ac5 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:51:05.536330 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-2a2332fc-3da4-45d0-97b3-0a8d0f555ac5 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:51:05.537580 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-2a2332fc-3da4-45d0-97b3-0a8d0f555ac5 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:51:05.538393 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-2a2332fc-3da4-45d0-97b3-0a8d0f555ac5 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:51:05.539136 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-2a2332fc-3da4-45d0-97b3-0a8d0f555ac5 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:51:05.637421 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-2a2332fc-3da4-45d0-97b3-0a8d0f555ac5 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5150c06020594efe957359f641eba5da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a0813bae074cd2aa552be82abe8493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:51:05.651253 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-2a2332fc-3da4-45d0-97b3-0a8d0f555ac5 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] 10.222.0.36 "GET /compute/v2.1/servers/cb269dd0-b5af-4013-9ded-062f40176b8f" status: 200 len: 1297 microversion: 2.1 time: 0.137113 Oct 15 13:51:05.652353 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 167/325] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:51:05 2022] GET /compute/v2.1/servers/cb269dd0-b5af-4013-9ded-062f40176b8f => generated 1297 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:51:06.216510 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-96ab16ac-2765-4fda-b3b6-4ebd1af2612b tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:51:06.217529 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-96ab16ac-2765-4fda-b3b6-4ebd1af2612b tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] [instance: 825eb626-f7a1-4cf6-b2f7-d7b31fd2e4fc] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:51:06.227443 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-96ab16ac-2765-4fda-b3b6-4ebd1af2612b tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:51:06.228606 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-96ab16ac-2765-4fda-b3b6-4ebd1af2612b tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:51:06.229909 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-96ab16ac-2765-4fda-b3b6-4ebd1af2612b tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:51:06.230823 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-96ab16ac-2765-4fda-b3b6-4ebd1af2612b tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:51:06.231441 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-96ab16ac-2765-4fda-b3b6-4ebd1af2612b tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:51:06.232177 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-96ab16ac-2765-4fda-b3b6-4ebd1af2612b tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:51:06.415583 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-96ab16ac-2765-4fda-b3b6-4ebd1af2612b tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af1daddbc1b84ab79f269e124cbea4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b58d317ad84e46be85ed15b3e51c2f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:51:06.425765 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-96ab16ac-2765-4fda-b3b6-4ebd1af2612b tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] 10.222.0.36 "GET /compute/v2.1/servers/825eb626-f7a1-4cf6-b2f7-d7b31fd2e4fc" status: 200 len: 1314 microversion: 2.1 time: 0.214370 Oct 15 13:51:06.426800 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 159/326] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:51:06 2022] GET /compute/v2.1/servers/825eb626-f7a1-4cf6-b2f7-d7b31fd2e4fc => generated 1314 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:51:06.677371 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-76394899-211e-4585-866c-37e24e42b264 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:51:06.678249 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-76394899-211e-4585-866c-37e24e42b264 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] [instance: cb269dd0-b5af-4013-9ded-062f40176b8f] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:51:06.685535 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-76394899-211e-4585-866c-37e24e42b264 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:51:06.686042 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-76394899-211e-4585-866c-37e24e42b264 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:51:06.686552 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-76394899-211e-4585-866c-37e24e42b264 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:51:06.687452 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-76394899-211e-4585-866c-37e24e42b264 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:51:06.687927 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-76394899-211e-4585-866c-37e24e42b264 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:51:06.688374 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-76394899-211e-4585-866c-37e24e42b264 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:51:06.769838 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-76394899-211e-4585-866c-37e24e42b264 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5150c06020594efe957359f641eba5da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a0813bae074cd2aa552be82abe8493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:51:06.782878 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-76394899-211e-4585-866c-37e24e42b264 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] 10.222.0.36 "GET /compute/v2.1/servers/cb269dd0-b5af-4013-9ded-062f40176b8f" status: 200 len: 1297 microversion: 2.1 time: 0.109427 Oct 15 13:51:06.787577 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 168/327] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:51:06 2022] GET /compute/v2.1/servers/cb269dd0-b5af-4013-9ded-062f40176b8f => generated 1297 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:51:07.455932 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-337e7481-6a72-46b2-a45e-d46b466854d1 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:51:07.456903 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-337e7481-6a72-46b2-a45e-d46b466854d1 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] [instance: 825eb626-f7a1-4cf6-b2f7-d7b31fd2e4fc] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:51:07.470854 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-337e7481-6a72-46b2-a45e-d46b466854d1 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:51:07.471741 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-337e7481-6a72-46b2-a45e-d46b466854d1 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:51:07.472534 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-337e7481-6a72-46b2-a45e-d46b466854d1 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:51:07.473950 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-337e7481-6a72-46b2-a45e-d46b466854d1 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:51:07.474835 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-337e7481-6a72-46b2-a45e-d46b466854d1 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:51:07.475407 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-337e7481-6a72-46b2-a45e-d46b466854d1 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:51:07.695439 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-337e7481-6a72-46b2-a45e-d46b466854d1 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af1daddbc1b84ab79f269e124cbea4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b58d317ad84e46be85ed15b3e51c2f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:51:07.705037 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-337e7481-6a72-46b2-a45e-d46b466854d1 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] 10.222.0.36 "GET /compute/v2.1/servers/825eb626-f7a1-4cf6-b2f7-d7b31fd2e4fc" status: 200 len: 1314 microversion: 2.1 time: 0.257827 Oct 15 13:51:07.706134 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 160/328] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:51:07 2022] GET /compute/v2.1/servers/825eb626-f7a1-4cf6-b2f7-d7b31fd2e4fc => generated 1314 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:51:07.811675 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-e7a41a58-31ef-4f30-8162-f737a7180bd9 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:51:07.812723 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-e7a41a58-31ef-4f30-8162-f737a7180bd9 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] [instance: cb269dd0-b5af-4013-9ded-062f40176b8f] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:51:07.820214 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-e7a41a58-31ef-4f30-8162-f737a7180bd9 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:51:07.820560 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-e7a41a58-31ef-4f30-8162-f737a7180bd9 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:51:07.821305 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-e7a41a58-31ef-4f30-8162-f737a7180bd9 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:51:07.822301 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-e7a41a58-31ef-4f30-8162-f737a7180bd9 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:51:07.822777 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-e7a41a58-31ef-4f30-8162-f737a7180bd9 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:51:07.823275 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-e7a41a58-31ef-4f30-8162-f737a7180bd9 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:51:07.926379 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-e7a41a58-31ef-4f30-8162-f737a7180bd9 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5150c06020594efe957359f641eba5da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a0813bae074cd2aa552be82abe8493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:51:07.941471 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-e7a41a58-31ef-4f30-8162-f737a7180bd9 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] 10.222.0.36 "GET /compute/v2.1/servers/cb269dd0-b5af-4013-9ded-062f40176b8f" status: 200 len: 1303 microversion: 2.1 time: 0.135261 Oct 15 13:51:07.942528 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 169/329] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:51:07 2022] GET /compute/v2.1/servers/cb269dd0-b5af-4013-9ded-062f40176b8f => generated 1303 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 13:51:08.734728 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-170484d0-cd4e-47e6-b0e1-e59b81f0d8da tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:51:08.737123 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-170484d0-cd4e-47e6-b0e1-e59b81f0d8da tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] [instance: 825eb626-f7a1-4cf6-b2f7-d7b31fd2e4fc] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:51:08.749419 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-170484d0-cd4e-47e6-b0e1-e59b81f0d8da tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:51:08.751143 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-170484d0-cd4e-47e6-b0e1-e59b81f0d8da tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:51:08.753264 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-170484d0-cd4e-47e6-b0e1-e59b81f0d8da tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:51:08.754746 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-170484d0-cd4e-47e6-b0e1-e59b81f0d8da tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:51:08.755691 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-170484d0-cd4e-47e6-b0e1-e59b81f0d8da tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:51:08.756586 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-170484d0-cd4e-47e6-b0e1-e59b81f0d8da tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:51:08.817863 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [req-4d90690f-8df4-4607-9974-e53af1134c46 req-60db5a69-fa10-48e6-9978-994d410e592a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "825eb626-f7a1-4cf6-b2f7-d7b31fd2e4fc", "name": "network-vif-plugged", "status": "completed", "tag": "866f3568-c979-4710-80ce-b8cc5ebc5360"}]} {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 13:51:08.838240 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [req-4d90690f-8df4-4607-9974-e53af1134c46 req-60db5a69-fa10-48e6-9978-994d410e592a service nova] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:51:08.839157 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [req-4d90690f-8df4-4607-9974-e53af1134c46 req-60db5a69-fa10-48e6-9978-994d410e592a service nova] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:51:08.840201 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [req-4d90690f-8df4-4607-9974-e53af1134c46 req-60db5a69-fa10-48e6-9978-994d410e592a service nova] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:51:08.878909 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.compute.server_external_events [req-4d90690f-8df4-4607-9974-e53af1134c46 req-60db5a69-fa10-48e6-9978-994d410e592a service nova] Creating event network-vif-plugged:866f3568-c979-4710-80ce-b8cc5ebc5360 for instance 825eb626-f7a1-4cf6-b2f7-d7b31fd2e4fc on hv-cinder-86149 Oct 15 13:51:08.891071 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [req-4d90690f-8df4-4607-9974-e53af1134c46 req-60db5a69-fa10-48e6-9978-994d410e592a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081044 Oct 15 13:51:08.900725 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 170/330] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 15 13:51:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 15 13:51:08.983100 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-626a1d6c-2d24-4782-9147-e3b5cbc0d81e tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:51:08.983918 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-626a1d6c-2d24-4782-9147-e3b5cbc0d81e tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] [instance: cb269dd0-b5af-4013-9ded-062f40176b8f] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:51:08.994888 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-626a1d6c-2d24-4782-9147-e3b5cbc0d81e tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:51:08.995592 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-626a1d6c-2d24-4782-9147-e3b5cbc0d81e tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:51:08.996981 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-626a1d6c-2d24-4782-9147-e3b5cbc0d81e tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:51:08.998096 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-626a1d6c-2d24-4782-9147-e3b5cbc0d81e tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:51:08.999713 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-626a1d6c-2d24-4782-9147-e3b5cbc0d81e tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:51:09.000580 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-626a1d6c-2d24-4782-9147-e3b5cbc0d81e tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:51:09.041896 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-170484d0-cd4e-47e6-b0e1-e59b81f0d8da tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af1daddbc1b84ab79f269e124cbea4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b58d317ad84e46be85ed15b3e51c2f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:51:09.065402 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-170484d0-cd4e-47e6-b0e1-e59b81f0d8da tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] 10.222.0.36 "GET /compute/v2.1/servers/825eb626-f7a1-4cf6-b2f7-d7b31fd2e4fc" status: 200 len: 1314 microversion: 2.1 time: 0.337932 Oct 15 13:51:09.068576 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 161/331] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:51:08 2022] GET /compute/v2.1/servers/825eb626-f7a1-4cf6-b2f7-d7b31fd2e4fc => generated 1314 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:51:09.234478 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [req-6d6b581d-aa7c-40b4-887f-3ae0bef7f3a5 req-39bc5582-78b0-407c-9dd9-6856f4c3b0c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb269dd0-b5af-4013-9ded-062f40176b8f", "tag": "4fc36f1c-5dfc-463e-b40a-40955077b6d2"}]} {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 13:51:09.262102 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [req-6d6b581d-aa7c-40b4-887f-3ae0bef7f3a5 req-39bc5582-78b0-407c-9dd9-6856f4c3b0c4 service nova] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:51:09.262102 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [req-6d6b581d-aa7c-40b4-887f-3ae0bef7f3a5 req-39bc5582-78b0-407c-9dd9-6856f4c3b0c4 service nova] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:51:09.262102 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [req-6d6b581d-aa7c-40b4-887f-3ae0bef7f3a5 req-39bc5582-78b0-407c-9dd9-6856f4c3b0c4 service nova] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:51:09.317586 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.compute.server_external_events [req-6d6b581d-aa7c-40b4-887f-3ae0bef7f3a5 req-39bc5582-78b0-407c-9dd9-6856f4c3b0c4 service nova] Creating event network-changed:4fc36f1c-5dfc-463e-b40a-40955077b6d2 for instance cb269dd0-b5af-4013-9ded-062f40176b8f on hv-cinder-86149 Oct 15 13:51:09.333316 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-626a1d6c-2d24-4782-9147-e3b5cbc0d81e tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5150c06020594efe957359f641eba5da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a0813bae074cd2aa552be82abe8493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:51:09.341659 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [req-6d6b581d-aa7c-40b4-887f-3ae0bef7f3a5 req-39bc5582-78b0-407c-9dd9-6856f4c3b0c4 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110764 Oct 15 13:51:09.343464 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 162/332] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 15 13:51:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 13:51:09.351912 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-626a1d6c-2d24-4782-9147-e3b5cbc0d81e tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] 10.222.0.36 "GET /compute/v2.1/servers/cb269dd0-b5af-4013-9ded-062f40176b8f" status: 200 len: 1370 microversion: 2.1 time: 0.373438 Oct 15 13:51:09.369249 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 171/333] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:51:08 2022] GET /compute/v2.1/servers/cb269dd0-b5af-4013-9ded-062f40176b8f => generated 1370 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 13:51:10.110537 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-91cbd0fb-787d-46dd-a530-425251eab11b tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:51:10.111343 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-91cbd0fb-787d-46dd-a530-425251eab11b tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] [instance: 825eb626-f7a1-4cf6-b2f7-d7b31fd2e4fc] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:51:10.122008 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-91cbd0fb-787d-46dd-a530-425251eab11b tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:51:10.122690 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-91cbd0fb-787d-46dd-a530-425251eab11b tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:51:10.123262 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-91cbd0fb-787d-46dd-a530-425251eab11b tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:51:10.124902 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-91cbd0fb-787d-46dd-a530-425251eab11b tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:51:10.125402 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-91cbd0fb-787d-46dd-a530-425251eab11b tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:51:10.125906 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-91cbd0fb-787d-46dd-a530-425251eab11b tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:51:10.401210 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-566eeeb3-4c38-45b9-a71d-07e093170faa tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:51:10.402532 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-566eeeb3-4c38-45b9-a71d-07e093170faa tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] [instance: cb269dd0-b5af-4013-9ded-062f40176b8f] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:51:10.414232 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-566eeeb3-4c38-45b9-a71d-07e093170faa tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:51:10.415187 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-566eeeb3-4c38-45b9-a71d-07e093170faa tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:51:10.415861 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-566eeeb3-4c38-45b9-a71d-07e093170faa tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:51:10.417114 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-566eeeb3-4c38-45b9-a71d-07e093170faa tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:51:10.417922 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-566eeeb3-4c38-45b9-a71d-07e093170faa tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:51:10.418652 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-566eeeb3-4c38-45b9-a71d-07e093170faa tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:51:10.450140 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-91cbd0fb-787d-46dd-a530-425251eab11b tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af1daddbc1b84ab79f269e124cbea4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b58d317ad84e46be85ed15b3e51c2f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:51:10.466181 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-91cbd0fb-787d-46dd-a530-425251eab11b tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] 10.222.0.36 "GET /compute/v2.1/servers/825eb626-f7a1-4cf6-b2f7-d7b31fd2e4fc" status: 200 len: 1314 microversion: 2.1 time: 0.360902 Oct 15 13:51:10.467277 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 163/334] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:51:10 2022] GET /compute/v2.1/servers/825eb626-f7a1-4cf6-b2f7-d7b31fd2e4fc => generated 1314 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:51:10.685243 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-566eeeb3-4c38-45b9-a71d-07e093170faa tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5150c06020594efe957359f641eba5da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a0813bae074cd2aa552be82abe8493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:51:10.698342 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-566eeeb3-4c38-45b9-a71d-07e093170faa tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] 10.222.0.36 "GET /compute/v2.1/servers/cb269dd0-b5af-4013-9ded-062f40176b8f" status: 200 len: 1370 microversion: 2.1 time: 0.303971 Oct 15 13:51:10.699521 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 172/335] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:51:10 2022] GET /compute/v2.1/servers/cb269dd0-b5af-4013-9ded-062f40176b8f => generated 1370 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 13:51:11.505891 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-ffd48651-e974-4864-8403-79b374ff2b56 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:51:11.507051 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-ffd48651-e974-4864-8403-79b374ff2b56 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] [instance: 825eb626-f7a1-4cf6-b2f7-d7b31fd2e4fc] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:51:11.516877 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-ffd48651-e974-4864-8403-79b374ff2b56 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:51:11.517580 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-ffd48651-e974-4864-8403-79b374ff2b56 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:51:11.518179 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-ffd48651-e974-4864-8403-79b374ff2b56 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:51:11.519106 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-ffd48651-e974-4864-8403-79b374ff2b56 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:51:11.519830 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-ffd48651-e974-4864-8403-79b374ff2b56 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:51:11.520536 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-ffd48651-e974-4864-8403-79b374ff2b56 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:51:11.731627 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-96646a82-2148-49c6-b4b4-707e0482623a tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:51:11.735967 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-96646a82-2148-49c6-b4b4-707e0482623a tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] [instance: cb269dd0-b5af-4013-9ded-062f40176b8f] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:51:11.750923 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-96646a82-2148-49c6-b4b4-707e0482623a tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:51:11.752104 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-96646a82-2148-49c6-b4b4-707e0482623a tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:51:11.753504 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-96646a82-2148-49c6-b4b4-707e0482623a tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:51:11.756612 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-96646a82-2148-49c6-b4b4-707e0482623a tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:51:11.758145 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-96646a82-2148-49c6-b4b4-707e0482623a tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:51:11.759512 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-96646a82-2148-49c6-b4b4-707e0482623a tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:51:11.795554 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-ffd48651-e974-4864-8403-79b374ff2b56 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af1daddbc1b84ab79f269e124cbea4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b58d317ad84e46be85ed15b3e51c2f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:51:11.827201 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-ffd48651-e974-4864-8403-79b374ff2b56 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] 10.222.0.36 "GET /compute/v2.1/servers/825eb626-f7a1-4cf6-b2f7-d7b31fd2e4fc" status: 200 len: 1314 microversion: 2.1 time: 0.326840 Oct 15 13:51:11.840233 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 164/336] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:51:11 2022] GET /compute/v2.1/servers/825eb626-f7a1-4cf6-b2f7-d7b31fd2e4fc => generated 1314 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:51:11.844120 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG dbcounter [-] [125243] Writing DB stats nova_cell0:SELECT=4 {{(pid=125243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:51:12.066153 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-96646a82-2148-49c6-b4b4-707e0482623a tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5150c06020594efe957359f641eba5da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a0813bae074cd2aa552be82abe8493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:51:12.081043 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-96646a82-2148-49c6-b4b4-707e0482623a tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] 10.222.0.36 "GET /compute/v2.1/servers/cb269dd0-b5af-4013-9ded-062f40176b8f" status: 200 len: 1370 microversion: 2.1 time: 0.360332 Oct 15 13:51:12.081945 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 173/337] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:51:11 2022] GET /compute/v2.1/servers/cb269dd0-b5af-4013-9ded-062f40176b8f => generated 1370 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:51:12.869893 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-4f1288c8-bdfd-46e9-b59f-749bc36258fc tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:51:12.871147 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-4f1288c8-bdfd-46e9-b59f-749bc36258fc tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] [instance: 825eb626-f7a1-4cf6-b2f7-d7b31fd2e4fc] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:51:12.883332 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-4f1288c8-bdfd-46e9-b59f-749bc36258fc tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:51:12.884023 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-4f1288c8-bdfd-46e9-b59f-749bc36258fc tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:51:12.884743 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-4f1288c8-bdfd-46e9-b59f-749bc36258fc tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:51:12.885632 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-4f1288c8-bdfd-46e9-b59f-749bc36258fc tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:51:12.886231 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-4f1288c8-bdfd-46e9-b59f-749bc36258fc tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:51:12.886934 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-4f1288c8-bdfd-46e9-b59f-749bc36258fc tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:51:13.112196 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-da53f629-d52f-4c87-96f3-6483fc36561a tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:51:13.113807 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-da53f629-d52f-4c87-96f3-6483fc36561a tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] [instance: cb269dd0-b5af-4013-9ded-062f40176b8f] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:51:13.133890 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG dbcounter [-] [125243] Writing DB stats nova_cell0:SELECT=20 {{(pid=125243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:51:13.152476 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-4f1288c8-bdfd-46e9-b59f-749bc36258fc tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af1daddbc1b84ab79f269e124cbea4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b58d317ad84e46be85ed15b3e51c2f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:51:13.155990 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-da53f629-d52f-4c87-96f3-6483fc36561a tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:51:13.160220 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-da53f629-d52f-4c87-96f3-6483fc36561a tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:51:13.161412 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-da53f629-d52f-4c87-96f3-6483fc36561a tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:51:13.163154 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-da53f629-d52f-4c87-96f3-6483fc36561a tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:51:13.166478 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-da53f629-d52f-4c87-96f3-6483fc36561a tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:51:13.167472 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-da53f629-d52f-4c87-96f3-6483fc36561a tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:51:13.177242 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-4f1288c8-bdfd-46e9-b59f-749bc36258fc tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] 10.222.0.36 "GET /compute/v2.1/servers/825eb626-f7a1-4cf6-b2f7-d7b31fd2e4fc" status: 200 len: 1314 microversion: 2.1 time: 0.312078 Oct 15 13:51:13.179152 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 165/338] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:51:12 2022] GET /compute/v2.1/servers/825eb626-f7a1-4cf6-b2f7-d7b31fd2e4fc => generated 1314 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:51:13.437400 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-da53f629-d52f-4c87-96f3-6483fc36561a tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5150c06020594efe957359f641eba5da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a0813bae074cd2aa552be82abe8493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:51:13.477073 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-da53f629-d52f-4c87-96f3-6483fc36561a tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] 10.222.0.36 "GET /compute/v2.1/servers/cb269dd0-b5af-4013-9ded-062f40176b8f" status: 200 len: 1370 microversion: 2.1 time: 0.368594 Oct 15 13:51:13.491907 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 174/339] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:51:13 2022] GET /compute/v2.1/servers/cb269dd0-b5af-4013-9ded-062f40176b8f => generated 1370 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:51:14.221737 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-e515cd59-945c-4f2f-9ca6-4f5979ec9c5d tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:51:14.222861 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-e515cd59-945c-4f2f-9ca6-4f5979ec9c5d tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] [instance: 825eb626-f7a1-4cf6-b2f7-d7b31fd2e4fc] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:51:14.248293 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-e515cd59-945c-4f2f-9ca6-4f5979ec9c5d tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:51:14.249230 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-e515cd59-945c-4f2f-9ca6-4f5979ec9c5d tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:51:14.249987 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-e515cd59-945c-4f2f-9ca6-4f5979ec9c5d tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:51:14.253335 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-e515cd59-945c-4f2f-9ca6-4f5979ec9c5d tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:51:14.257066 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-e515cd59-945c-4f2f-9ca6-4f5979ec9c5d tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:51:14.261073 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-e515cd59-945c-4f2f-9ca6-4f5979ec9c5d tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:51:14.508712 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-6b0bb3cd-c94a-4354-bd1a-9c83dccbc395 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:51:14.510230 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-6b0bb3cd-c94a-4354-bd1a-9c83dccbc395 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] [instance: cb269dd0-b5af-4013-9ded-062f40176b8f] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:51:14.522927 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-6b0bb3cd-c94a-4354-bd1a-9c83dccbc395 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:51:14.524059 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-6b0bb3cd-c94a-4354-bd1a-9c83dccbc395 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:51:14.525898 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-6b0bb3cd-c94a-4354-bd1a-9c83dccbc395 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:51:14.527487 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-6b0bb3cd-c94a-4354-bd1a-9c83dccbc395 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:51:14.529004 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-6b0bb3cd-c94a-4354-bd1a-9c83dccbc395 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:51:14.530623 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-6b0bb3cd-c94a-4354-bd1a-9c83dccbc395 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:51:14.786218 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-e515cd59-945c-4f2f-9ca6-4f5979ec9c5d tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af1daddbc1b84ab79f269e124cbea4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b58d317ad84e46be85ed15b3e51c2f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:51:14.838507 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-e515cd59-945c-4f2f-9ca6-4f5979ec9c5d tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] 10.222.0.36 "GET /compute/v2.1/servers/825eb626-f7a1-4cf6-b2f7-d7b31fd2e4fc" status: 200 len: 1498 microversion: 2.1 time: 0.632244 Oct 15 13:51:14.846865 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 166/340] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:51:14 2022] GET /compute/v2.1/servers/825eb626-f7a1-4cf6-b2f7-d7b31fd2e4fc => generated 1498 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:51:14.972265 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-6b0bb3cd-c94a-4354-bd1a-9c83dccbc395 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5150c06020594efe957359f641eba5da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a0813bae074cd2aa552be82abe8493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:51:14.992453 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-6b0bb3cd-c94a-4354-bd1a-9c83dccbc395 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] 10.222.0.36 "GET /compute/v2.1/servers/cb269dd0-b5af-4013-9ded-062f40176b8f" status: 200 len: 1370 microversion: 2.1 time: 0.492890 Oct 15 13:51:14.993582 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 175/341] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:51:14 2022] GET /compute/v2.1/servers/cb269dd0-b5af-4013-9ded-062f40176b8f => generated 1370 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:51:16.038126 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-8690b34a-be66-41e4-8427-2d97e25accbc tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:51:16.043770 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-8690b34a-be66-41e4-8427-2d97e25accbc tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] [instance: cb269dd0-b5af-4013-9ded-062f40176b8f] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:51:16.064630 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-8690b34a-be66-41e4-8427-2d97e25accbc tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:51:16.066356 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-8690b34a-be66-41e4-8427-2d97e25accbc tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:51:16.067471 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-8690b34a-be66-41e4-8427-2d97e25accbc tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:51:16.069526 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-8690b34a-be66-41e4-8427-2d97e25accbc tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:51:16.070809 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-8690b34a-be66-41e4-8427-2d97e25accbc tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:51:16.072013 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-8690b34a-be66-41e4-8427-2d97e25accbc tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:51:16.083753 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG dbcounter [-] [125242] Writing DB stats nova_cell1:SELECT=100 {{(pid=125242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:51:16.423385 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-8690b34a-be66-41e4-8427-2d97e25accbc tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5150c06020594efe957359f641eba5da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a0813bae074cd2aa552be82abe8493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:51:16.442262 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-8690b34a-be66-41e4-8427-2d97e25accbc tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] 10.222.0.36 "GET /compute/v2.1/servers/cb269dd0-b5af-4013-9ded-062f40176b8f" status: 200 len: 1370 microversion: 2.1 time: 0.413628 Oct 15 13:51:16.444309 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 167/342] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:51:16 2022] GET /compute/v2.1/servers/cb269dd0-b5af-4013-9ded-062f40176b8f => generated 1370 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:51:17.470232 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-5629f50b-20b9-4f76-8ce1-aa5e565220bf tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:51:17.470965 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-5629f50b-20b9-4f76-8ce1-aa5e565220bf tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] [instance: cb269dd0-b5af-4013-9ded-062f40176b8f] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:51:17.482244 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-5629f50b-20b9-4f76-8ce1-aa5e565220bf tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:51:17.484596 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-5629f50b-20b9-4f76-8ce1-aa5e565220bf tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:51:17.485384 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-5629f50b-20b9-4f76-8ce1-aa5e565220bf tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:51:17.486706 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-5629f50b-20b9-4f76-8ce1-aa5e565220bf tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:51:17.488657 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-5629f50b-20b9-4f76-8ce1-aa5e565220bf tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:51:17.489350 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-5629f50b-20b9-4f76-8ce1-aa5e565220bf tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:51:17.764485 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-5629f50b-20b9-4f76-8ce1-aa5e565220bf tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5150c06020594efe957359f641eba5da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a0813bae074cd2aa552be82abe8493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:51:17.780088 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-5629f50b-20b9-4f76-8ce1-aa5e565220bf tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] 10.222.0.36 "GET /compute/v2.1/servers/cb269dd0-b5af-4013-9ded-062f40176b8f" status: 200 len: 1370 microversion: 2.1 time: 0.313467 Oct 15 13:51:17.781313 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 176/343] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:51:17 2022] GET /compute/v2.1/servers/cb269dd0-b5af-4013-9ded-062f40176b8f => generated 1370 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:51:18.814669 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-e43d9c68-0ce4-45d2-8b06-c50286b649d0 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:51:18.815714 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-e43d9c68-0ce4-45d2-8b06-c50286b649d0 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] [instance: cb269dd0-b5af-4013-9ded-062f40176b8f] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:51:18.827761 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-e43d9c68-0ce4-45d2-8b06-c50286b649d0 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:51:18.828683 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-e43d9c68-0ce4-45d2-8b06-c50286b649d0 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:51:18.829627 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-e43d9c68-0ce4-45d2-8b06-c50286b649d0 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:51:18.831080 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-e43d9c68-0ce4-45d2-8b06-c50286b649d0 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:51:18.831935 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-e43d9c68-0ce4-45d2-8b06-c50286b649d0 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:51:18.832697 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-e43d9c68-0ce4-45d2-8b06-c50286b649d0 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:51:19.125795 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-e43d9c68-0ce4-45d2-8b06-c50286b649d0 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5150c06020594efe957359f641eba5da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a0813bae074cd2aa552be82abe8493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:51:19.141730 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-e43d9c68-0ce4-45d2-8b06-c50286b649d0 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] 10.222.0.36 "GET /compute/v2.1/servers/cb269dd0-b5af-4013-9ded-062f40176b8f" status: 200 len: 1370 microversion: 2.1 time: 0.334048 Oct 15 13:51:19.156308 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 168/344] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:51:18 2022] GET /compute/v2.1/servers/cb269dd0-b5af-4013-9ded-062f40176b8f => generated 1370 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:51:19.498053 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-24eb546b-53f3-4a87-85de-3681da374cd4 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:51:19.498923 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-24eb546b-53f3-4a87-85de-3681da374cd4 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] [instance: 825eb626-f7a1-4cf6-b2f7-d7b31fd2e4fc] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:51:19.509663 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-24eb546b-53f3-4a87-85de-3681da374cd4 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:51:19.510784 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-24eb546b-53f3-4a87-85de-3681da374cd4 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:51:19.511799 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-24eb546b-53f3-4a87-85de-3681da374cd4 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:51:19.513303 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-24eb546b-53f3-4a87-85de-3681da374cd4 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:51:19.514305 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-24eb546b-53f3-4a87-85de-3681da374cd4 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:51:19.515137 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-24eb546b-53f3-4a87-85de-3681da374cd4 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:51:19.564702 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-24eb546b-53f3-4a87-85de-3681da374cd4 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] [instance: 825eb626-f7a1-4cf6-b2f7-d7b31fd2e4fc] Going to try to terminate instance {{(pid=125243) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 15 13:51:19.801862 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-24eb546b-53f3-4a87-85de-3681da374cd4 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] 10.222.0.36 "DELETE /compute/v2.1/servers/825eb626-f7a1-4cf6-b2f7-d7b31fd2e4fc" status: 204 len: 0 microversion: 2.1 time: 0.310868 Oct 15 13:51:19.802554 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 177/345] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 15 13:51:19 2022] DELETE /compute/v2.1/servers/825eb626-f7a1-4cf6-b2f7-d7b31fd2e4fc => generated 0 bytes in 313 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 15 13:51:19.830324 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-159f3755-fe38-4506-9778-f41ae029f3a5 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:51:19.831572 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-159f3755-fe38-4506-9778-f41ae029f3a5 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] [instance: 825eb626-f7a1-4cf6-b2f7-d7b31fd2e4fc] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:51:19.844483 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-159f3755-fe38-4506-9778-f41ae029f3a5 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:51:19.845337 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-159f3755-fe38-4506-9778-f41ae029f3a5 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:51:19.846114 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-159f3755-fe38-4506-9778-f41ae029f3a5 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:51:19.847410 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-159f3755-fe38-4506-9778-f41ae029f3a5 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:51:19.848301 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-159f3755-fe38-4506-9778-f41ae029f3a5 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:51:19.849081 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-159f3755-fe38-4506-9778-f41ae029f3a5 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:51:20.184178 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-f192712d-a89d-4ef7-832b-2bc3a4c28ae6 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:51:20.185140 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-f192712d-a89d-4ef7-832b-2bc3a4c28ae6 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] [instance: cb269dd0-b5af-4013-9ded-062f40176b8f] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:51:20.198119 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-f192712d-a89d-4ef7-832b-2bc3a4c28ae6 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:51:20.198973 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-f192712d-a89d-4ef7-832b-2bc3a4c28ae6 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:51:20.199600 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-f192712d-a89d-4ef7-832b-2bc3a4c28ae6 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:51:20.200587 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-f192712d-a89d-4ef7-832b-2bc3a4c28ae6 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:51:20.201252 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-f192712d-a89d-4ef7-832b-2bc3a4c28ae6 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:51:20.201715 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-f192712d-a89d-4ef7-832b-2bc3a4c28ae6 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:51:20.528591 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-159f3755-fe38-4506-9778-f41ae029f3a5 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af1daddbc1b84ab79f269e124cbea4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b58d317ad84e46be85ed15b3e51c2f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:51:20.551263 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-159f3755-fe38-4506-9778-f41ae029f3a5 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] 10.222.0.36 "GET /compute/v2.1/servers/825eb626-f7a1-4cf6-b2f7-d7b31fd2e4fc" status: 200 len: 1504 microversion: 2.1 time: 0.737710 Oct 15 13:51:20.553136 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 169/346] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:51:19 2022] GET /compute/v2.1/servers/825eb626-f7a1-4cf6-b2f7-d7b31fd2e4fc => generated 1504 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:51:20.700556 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-f192712d-a89d-4ef7-832b-2bc3a4c28ae6 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5150c06020594efe957359f641eba5da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a0813bae074cd2aa552be82abe8493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:51:20.719108 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-f192712d-a89d-4ef7-832b-2bc3a4c28ae6 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] 10.222.0.36 "GET /compute/v2.1/servers/cb269dd0-b5af-4013-9ded-062f40176b8f" status: 200 len: 1370 microversion: 2.1 time: 0.542330 Oct 15 13:51:20.731913 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 178/347] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:51:20 2022] GET /compute/v2.1/servers/cb269dd0-b5af-4013-9ded-062f40176b8f => generated 1370 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 13:51:21.597961 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-83c93fc2-d612-4e2b-9e80-48babc5f6884 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:51:21.600907 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-83c93fc2-d612-4e2b-9e80-48babc5f6884 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] [instance: 825eb626-f7a1-4cf6-b2f7-d7b31fd2e4fc] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:51:21.618434 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-83c93fc2-d612-4e2b-9e80-48babc5f6884 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:51:21.619516 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-83c93fc2-d612-4e2b-9e80-48babc5f6884 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:51:21.620288 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-83c93fc2-d612-4e2b-9e80-48babc5f6884 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:51:21.621516 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-83c93fc2-d612-4e2b-9e80-48babc5f6884 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:51:21.629374 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-83c93fc2-d612-4e2b-9e80-48babc5f6884 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:51:21.631106 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-83c93fc2-d612-4e2b-9e80-48babc5f6884 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:51:21.745286 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-e32e18be-9610-4fb8-83ef-740bc91dd24a tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:51:21.746525 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-e32e18be-9610-4fb8-83ef-740bc91dd24a tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] [instance: cb269dd0-b5af-4013-9ded-062f40176b8f] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:51:21.763662 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-e32e18be-9610-4fb8-83ef-740bc91dd24a tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:51:21.764716 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-e32e18be-9610-4fb8-83ef-740bc91dd24a tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:51:21.765425 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-e32e18be-9610-4fb8-83ef-740bc91dd24a tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:51:21.766428 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-e32e18be-9610-4fb8-83ef-740bc91dd24a tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:51:21.767113 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-e32e18be-9610-4fb8-83ef-740bc91dd24a tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:51:21.767747 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-e32e18be-9610-4fb8-83ef-740bc91dd24a tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:51:22.059135 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-83c93fc2-d612-4e2b-9e80-48babc5f6884 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af1daddbc1b84ab79f269e124cbea4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b58d317ad84e46be85ed15b3e51c2f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:51:22.076305 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-83c93fc2-d612-4e2b-9e80-48babc5f6884 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] 10.222.0.36 "GET /compute/v2.1/servers/825eb626-f7a1-4cf6-b2f7-d7b31fd2e4fc" status: 200 len: 1504 microversion: 2.1 time: 0.483530 Oct 15 13:51:22.084958 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 170/348] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:51:21 2022] GET /compute/v2.1/servers/825eb626-f7a1-4cf6-b2f7-d7b31fd2e4fc => generated 1504 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:51:22.129221 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-e32e18be-9610-4fb8-83ef-740bc91dd24a tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5150c06020594efe957359f641eba5da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a0813bae074cd2aa552be82abe8493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:51:22.150294 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-e32e18be-9610-4fb8-83ef-740bc91dd24a tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] 10.222.0.36 "GET /compute/v2.1/servers/cb269dd0-b5af-4013-9ded-062f40176b8f" status: 200 len: 1370 microversion: 2.1 time: 0.408038 Oct 15 13:51:22.152123 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 179/349] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:51:21 2022] GET /compute/v2.1/servers/cb269dd0-b5af-4013-9ded-062f40176b8f => generated 1370 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:51:22.256392 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [req-f24aa1b6-cd6e-4426-8727-8955725ea88a req-4a5e7e83-47df-47df-bb80-2afff662ab92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb269dd0-b5af-4013-9ded-062f40176b8f", "name": "network-vif-plugged", "status": "completed", "tag": "4fc36f1c-5dfc-463e-b40a-40955077b6d2"}]} {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 13:51:22.308474 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [req-f24aa1b6-cd6e-4426-8727-8955725ea88a req-4a5e7e83-47df-47df-bb80-2afff662ab92 service nova] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:51:22.309960 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [req-f24aa1b6-cd6e-4426-8727-8955725ea88a req-4a5e7e83-47df-47df-bb80-2afff662ab92 service nova] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:51:22.311228 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [req-f24aa1b6-cd6e-4426-8727-8955725ea88a req-4a5e7e83-47df-47df-bb80-2afff662ab92 service nova] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:51:22.333778 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.compute.server_external_events [req-f24aa1b6-cd6e-4426-8727-8955725ea88a req-4a5e7e83-47df-47df-bb80-2afff662ab92 service nova] Creating event network-vif-plugged:4fc36f1c-5dfc-463e-b40a-40955077b6d2 for instance cb269dd0-b5af-4013-9ded-062f40176b8f on hv-cinder-86149 Oct 15 13:51:22.341088 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [req-f24aa1b6-cd6e-4426-8727-8955725ea88a req-4a5e7e83-47df-47df-bb80-2afff662ab92 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106097 Oct 15 13:51:22.342421 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 171/350] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 15 13:51:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 13:51:23.037453 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [req-ebf266e4-8f68-471a-86b8-dc5b96ecfefe req-3d984d5e-0f9e-4371-93e3-fb8ef934a2e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "825eb626-f7a1-4cf6-b2f7-d7b31fd2e4fc", "name": "network-vif-deleted", "tag": "866f3568-c979-4710-80ce-b8cc5ebc5360"}]} {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 13:51:23.100018 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG dbcounter [-] [125243] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=125243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:51:23.109129 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [req-ebf266e4-8f68-471a-86b8-dc5b96ecfefe req-3d984d5e-0f9e-4371-93e3-fb8ef934a2e8 service nova] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:51:23.122454 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [req-ebf266e4-8f68-471a-86b8-dc5b96ecfefe req-3d984d5e-0f9e-4371-93e3-fb8ef934a2e8 service nova] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:51:23.124365 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [req-ebf266e4-8f68-471a-86b8-dc5b96ecfefe req-3d984d5e-0f9e-4371-93e3-fb8ef934a2e8 service nova] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:51:23.129932 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-88b43554-b271-4622-b93b-10e08c8fd556 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:51:23.132580 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-88b43554-b271-4622-b93b-10e08c8fd556 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] [instance: 825eb626-f7a1-4cf6-b2f7-d7b31fd2e4fc] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:51:23.157296 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-88b43554-b271-4622-b93b-10e08c8fd556 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:51:23.160272 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-88b43554-b271-4622-b93b-10e08c8fd556 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:51:23.160789 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-88b43554-b271-4622-b93b-10e08c8fd556 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:51:23.161550 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-88b43554-b271-4622-b93b-10e08c8fd556 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:51:23.162022 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-88b43554-b271-4622-b93b-10e08c8fd556 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:51:23.162445 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-88b43554-b271-4622-b93b-10e08c8fd556 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:51:23.183021 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.compute.server_external_events [req-ebf266e4-8f68-471a-86b8-dc5b96ecfefe req-3d984d5e-0f9e-4371-93e3-fb8ef934a2e8 service nova] Creating event network-vif-deleted:866f3568-c979-4710-80ce-b8cc5ebc5360 for instance 825eb626-f7a1-4cf6-b2f7-d7b31fd2e4fc on hv-cinder-86149 Oct 15 13:51:23.197559 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [req-ebf266e4-8f68-471a-86b8-dc5b96ecfefe req-3d984d5e-0f9e-4371-93e3-fb8ef934a2e8 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.198330 Oct 15 13:51:23.200049 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 180/351] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 15 13:51:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 13:51:23.214403 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-f877c82d-45c0-4133-922e-f430b4c8be75 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:51:23.216287 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-f877c82d-45c0-4133-922e-f430b4c8be75 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] [instance: cb269dd0-b5af-4013-9ded-062f40176b8f] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:51:23.231261 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-f877c82d-45c0-4133-922e-f430b4c8be75 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:51:23.232709 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-f877c82d-45c0-4133-922e-f430b4c8be75 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:51:23.233921 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-f877c82d-45c0-4133-922e-f430b4c8be75 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:51:23.235625 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-f877c82d-45c0-4133-922e-f430b4c8be75 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:51:23.236864 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-f877c82d-45c0-4133-922e-f430b4c8be75 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:51:23.237947 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-f877c82d-45c0-4133-922e-f430b4c8be75 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:51:23.284434 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG dbcounter [-] [125243] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:51:23.468963 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-88b43554-b271-4622-b93b-10e08c8fd556 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af1daddbc1b84ab79f269e124cbea4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b58d317ad84e46be85ed15b3e51c2f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:51:23.503597 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-88b43554-b271-4622-b93b-10e08c8fd556 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] 10.222.0.36 "GET /compute/v2.1/servers/825eb626-f7a1-4cf6-b2f7-d7b31fd2e4fc" status: 200 len: 1299 microversion: 2.1 time: 0.378061 Oct 15 13:51:23.519064 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 172/352] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:51:23 2022] GET /compute/v2.1/servers/825eb626-f7a1-4cf6-b2f7-d7b31fd2e4fc => generated 1299 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 13:51:23.558832 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-f877c82d-45c0-4133-922e-f430b4c8be75 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5150c06020594efe957359f641eba5da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a0813bae074cd2aa552be82abe8493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:51:23.571595 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-f877c82d-45c0-4133-922e-f430b4c8be75 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] 10.222.0.36 "GET /compute/v2.1/servers/cb269dd0-b5af-4013-9ded-062f40176b8f" status: 200 len: 1370 microversion: 2.1 time: 0.366775 Oct 15 13:51:23.573162 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 181/353] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:51:23 2022] GET /compute/v2.1/servers/cb269dd0-b5af-4013-9ded-062f40176b8f => generated 1370 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:51:24.588793 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-36d36bc1-ef8f-48da-a69c-149c1a5fdab9 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:51:24.591141 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-36d36bc1-ef8f-48da-a69c-149c1a5fdab9 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] [instance: 825eb626-f7a1-4cf6-b2f7-d7b31fd2e4fc] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:51:24.615214 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-36d36bc1-ef8f-48da-a69c-149c1a5fdab9 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:51:24.615740 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-36d36bc1-ef8f-48da-a69c-149c1a5fdab9 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:51:24.623188 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-36d36bc1-ef8f-48da-a69c-149c1a5fdab9 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:51:24.626205 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-36d36bc1-ef8f-48da-a69c-149c1a5fdab9 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:51:24.626462 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-5076575e-af87-4e07-a1aa-f0ee402c9766 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:51:24.626462 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-5076575e-af87-4e07-a1aa-f0ee402c9766 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] [instance: cb269dd0-b5af-4013-9ded-062f40176b8f] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:51:24.627288 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-36d36bc1-ef8f-48da-a69c-149c1a5fdab9 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:51:24.627288 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-36d36bc1-ef8f-48da-a69c-149c1a5fdab9 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:51:24.642195 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-5076575e-af87-4e07-a1aa-f0ee402c9766 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:51:24.642920 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-5076575e-af87-4e07-a1aa-f0ee402c9766 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:51:24.643432 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-5076575e-af87-4e07-a1aa-f0ee402c9766 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:51:24.644285 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-5076575e-af87-4e07-a1aa-f0ee402c9766 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:51:24.644757 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-5076575e-af87-4e07-a1aa-f0ee402c9766 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:51:24.659343 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-5076575e-af87-4e07-a1aa-f0ee402c9766 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:51:24.749343 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG dbcounter [-] [125242] Writing DB stats nova_api:SELECT=48 {{(pid=125242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:51:24.762190 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-36d36bc1-ef8f-48da-a69c-149c1a5fdab9 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:51:24.763685 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-36d36bc1-ef8f-48da-a69c-149c1a5fdab9 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:51:24.767623 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-36d36bc1-ef8f-48da-a69c-149c1a5fdab9 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:51:24.769158 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.objects.instance [None req-36d36bc1-ef8f-48da-a69c-149c1a5fdab9 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lazy-loading 'fault' on Instance uuid 825eb626-f7a1-4cf6-b2f7-d7b31fd2e4fc {{(pid=125242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 15 13:51:24.971850 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-36d36bc1-ef8f-48da-a69c-149c1a5fdab9 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af1daddbc1b84ab79f269e124cbea4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b58d317ad84e46be85ed15b3e51c2f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:51:25.002164 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-36d36bc1-ef8f-48da-a69c-149c1a5fdab9 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] 10.222.0.36 "GET /compute/v2.1/servers/825eb626-f7a1-4cf6-b2f7-d7b31fd2e4fc" status: 200 len: 1304 microversion: 2.1 time: 0.447386 Oct 15 13:51:25.004234 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 173/354] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:51:24 2022] GET /compute/v2.1/servers/825eb626-f7a1-4cf6-b2f7-d7b31fd2e4fc => generated 1304 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:51:25.222297 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-5076575e-af87-4e07-a1aa-f0ee402c9766 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5150c06020594efe957359f641eba5da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a0813bae074cd2aa552be82abe8493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:51:25.241097 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-5076575e-af87-4e07-a1aa-f0ee402c9766 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] 10.222.0.36 "GET /compute/v2.1/servers/cb269dd0-b5af-4013-9ded-062f40176b8f" status: 200 len: 1370 microversion: 2.1 time: 0.624890 Oct 15 13:51:25.252445 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 182/355] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:51:24 2022] GET /compute/v2.1/servers/cb269dd0-b5af-4013-9ded-062f40176b8f => generated 1370 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:51:26.039383 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-0bfcc190-310f-41b5-b58a-8d95e2557ae1 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:51:26.040430 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-0bfcc190-310f-41b5-b58a-8d95e2557ae1 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] [instance: 825eb626-f7a1-4cf6-b2f7-d7b31fd2e4fc] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:51:26.066319 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-0bfcc190-310f-41b5-b58a-8d95e2557ae1 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:51:26.067367 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-0bfcc190-310f-41b5-b58a-8d95e2557ae1 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:51:26.068374 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-0bfcc190-310f-41b5-b58a-8d95e2557ae1 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:51:26.105624 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-0bfcc190-310f-41b5-b58a-8d95e2557ae1 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:51:26.106579 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-0bfcc190-310f-41b5-b58a-8d95e2557ae1 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.036s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:51:26.107204 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-0bfcc190-310f-41b5-b58a-8d95e2557ae1 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:51:26.153994 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.wsgi [None req-0bfcc190-310f-41b5-b58a-8d95e2557ae1 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] HTTP exception thrown: Instance 825eb626-f7a1-4cf6-b2f7-d7b31fd2e4fc could not be found. Oct 15 13:51:26.170079 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-0bfcc190-310f-41b5-b58a-8d95e2557ae1 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Request method failure captured: Oct 15 13:51:26.170079 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: request: GET /compute/v2.1/servers/825eb626-f7a1-4cf6-b2f7-d7b31fd2e4fc HTTP/1.1 Oct 15 13:51:26.170079 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Accept: application/json Oct 15 13:51:26.170079 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Accept-Encoding: identity Oct 15 13:51:26.170079 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Connection: close Oct 15 13:51:26.170079 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Content-Length: 0 Oct 15 13:51:26.170079 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Content-Type: application/json Oct 15 13:51:26.170079 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Host: 10.222.0.36 Oct 15 13:51:26.170079 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Openstack-System-Scope: None Oct 15 13:51:26.170079 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: User-Agent: python-urllib3/1.26.12 Oct 15 13:51:26.170079 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Auth-Token: gAAAAABjSrqNrHuKlzS3sCf4phixfbY8S16llIeGSZ-cSrlfMLSx1K31AIZdBxfdxUKDZc7EKCOPzPJ2-_HOB9pHsJ7sXDh4-z_FzQP1F3Ytuy4p1lFavoyZdJHN29ALsLVqcSGgYDi_thBCjxJ5bihkZWfeleXHKKFeDWeDCRF2xLXtZh6rMDw Oct 15 13:51:26.170079 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Domain-Id: None Oct 15 13:51:26.170079 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Domain-Name: None Oct 15 13:51:26.170079 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Identity-Status: Confirmed Oct 15 13:51:26.170079 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Is-Admin-Project: True Oct 15 13:51:26.170079 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Project-Domain-Id: default Oct 15 13:51:26.170079 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Project-Domain-Name: Default Oct 15 13:51:26.170079 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Project-Id: b58d317ad84e46be85ed15b3e51c2f97 Oct 15 13:51:26.170079 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Project-Name: tempest-VolumesActionsTest-1758441097 Oct 15 13:51:26.170079 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Role: member,reader Oct 15 13:51:26.170079 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Roles: member,reader Oct 15 13:51:26.171676 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_b58d317ad84e46be85ed15b3e51c2f97", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b58d317ad84e46be85ed15b3e51c2f97"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b58d317ad84e46be85ed15b3e51c2f97"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/b58d317ad84e46be85ed15b3e51c2f97"}]}] Oct 15 13:51:26.171676 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Tenant: tempest-VolumesActionsTest-1758441097 Oct 15 13:51:26.171676 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Tenant-Id: b58d317ad84e46be85ed15b3e51c2f97 Oct 15 13:51:26.171676 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Tenant-Name: tempest-VolumesActionsTest-1758441097 Oct 15 13:51:26.171676 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-User: tempest-VolumesActionsTest-1758441097-project Oct 15 13:51:26.171676 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-User-Domain-Id: default Oct 15 13:51:26.171676 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-User-Domain-Name: Default Oct 15 13:51:26.171676 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-User-Id: af1daddbc1b84ab79f269e124cbea4fb Oct 15 13:51:26.171676 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-User-Name: tempest-VolumesActionsTest-1758441097-project Oct 15 13:51:26.171676 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: method: > Oct 15 13:51:26.171676 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: exception: Instance 825eb626-f7a1-4cf6-b2f7-d7b31fd2e4fc could not be found. Oct 15 13:51:26.171676 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: action_args: {'id': '825eb626-f7a1-4cf6-b2f7-d7b31fd2e4fc'} Oct 15 13:51:26.172647 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 15 13:51:26.172647 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 13:51:26.172647 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 15 13:51:26.172647 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 15 13:51:26.172647 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 15 13:51:26.172647 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 15 13:51:26.172647 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 15 13:51:26.172647 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 15 13:51:26.172647 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 15 13:51:26.172647 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 15 13:51:26.172647 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 825eb626-f7a1-4cf6-b2f7-d7b31fd2e4fc could not be found. Oct 15 13:51:26.172647 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Oct 15 13:51:26.172647 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 13:51:26.172647 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Oct 15 13:51:26.172647 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 13:51:26.172647 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 13:51:26.172647 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 13:51:26.172647 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 15 13:51:26.172647 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 15 13:51:26.172647 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 15 13:51:26.176134 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 15 13:51:26.176134 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 15 13:51:26.176134 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 15 13:51:26.176134 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 15 13:51:26.176134 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 15 13:51:26.176134 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 15 13:51:26.176134 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 15 13:51:26.176134 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 825eb626-f7a1-4cf6-b2f7-d7b31fd2e4fc could not be found. Oct 15 13:51:26.176134 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Oct 15 13:51:26.176134 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 13:51:26.176134 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Oct 15 13:51:26.176134 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 13:51:26.176134 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 13:51:26.176134 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 13:51:26.176134 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 15 13:51:26.176134 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 15 13:51:26.176134 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 825eb626-f7a1-4cf6-b2f7-d7b31fd2e4fc could not be found. Oct 15 13:51:26.176134 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Oct 15 13:51:26.182170 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-0bfcc190-310f-41b5-b58a-8d95e2557ae1 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] Returning 404 to user: Instance 825eb626-f7a1-4cf6-b2f7-d7b31fd2e4fc could not be found. {{(pid=125242) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 15 13:51:26.185020 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-0bfcc190-310f-41b5-b58a-8d95e2557ae1 tempest-VolumesActionsTest-1758441097 tempest-VolumesActionsTest-1758441097-project] 10.222.0.36 "GET /compute/v2.1/servers/825eb626-f7a1-4cf6-b2f7-d7b31fd2e4fc" status: 404 len: 111 microversion: 2.1 time: 0.152665 Oct 15 13:51:26.186842 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 174/356] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:51:26 2022] GET /compute/v2.1/servers/825eb626-f7a1-4cf6-b2f7-d7b31fd2e4fc => generated 111 bytes in 155 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 15 13:51:26.298127 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-b86cf4d2-7a68-4434-8ffa-d1245cd5cbf4 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:51:26.299194 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-b86cf4d2-7a68-4434-8ffa-d1245cd5cbf4 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] [instance: cb269dd0-b5af-4013-9ded-062f40176b8f] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:51:26.325873 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-b86cf4d2-7a68-4434-8ffa-d1245cd5cbf4 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:51:26.327007 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-b86cf4d2-7a68-4434-8ffa-d1245cd5cbf4 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:51:26.327815 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-b86cf4d2-7a68-4434-8ffa-d1245cd5cbf4 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:51:26.330074 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-b86cf4d2-7a68-4434-8ffa-d1245cd5cbf4 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:51:26.333687 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-b86cf4d2-7a68-4434-8ffa-d1245cd5cbf4 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:51:26.334239 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-b86cf4d2-7a68-4434-8ffa-d1245cd5cbf4 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:51:26.607341 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-b86cf4d2-7a68-4434-8ffa-d1245cd5cbf4 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5150c06020594efe957359f641eba5da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a0813bae074cd2aa552be82abe8493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:51:26.616634 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-b86cf4d2-7a68-4434-8ffa-d1245cd5cbf4 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] 10.222.0.36 "GET /compute/v2.1/servers/cb269dd0-b5af-4013-9ded-062f40176b8f" status: 200 len: 1565 microversion: 2.1 time: 0.325263 Oct 15 13:51:26.617238 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 183/357] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:51:26 2022] GET /compute/v2.1/servers/cb269dd0-b5af-4013-9ded-062f40176b8f => generated 1565 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:51:26.640150 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-38ac32a3-980f-4bf4-9a9c-cb5aaf9780e2 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:51:26.640737 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-38ac32a3-980f-4bf4-9a9c-cb5aaf9780e2 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] [instance: cb269dd0-b5af-4013-9ded-062f40176b8f] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:51:26.647619 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-38ac32a3-980f-4bf4-9a9c-cb5aaf9780e2 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:51:26.648500 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-38ac32a3-980f-4bf4-9a9c-cb5aaf9780e2 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:51:26.649150 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-38ac32a3-980f-4bf4-9a9c-cb5aaf9780e2 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:51:26.649942 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-38ac32a3-980f-4bf4-9a9c-cb5aaf9780e2 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:51:26.650466 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-38ac32a3-980f-4bf4-9a9c-cb5aaf9780e2 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:51:26.650882 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-38ac32a3-980f-4bf4-9a9c-cb5aaf9780e2 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:51:26.853474 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-38ac32a3-980f-4bf4-9a9c-cb5aaf9780e2 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] 10.222.0.36 "GET /compute/v2.1/servers/cb269dd0-b5af-4013-9ded-062f40176b8f/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.216413 Oct 15 13:51:26.854804 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 175/358] 10.222.0.36 () {58 vars in 1275 bytes} [Sat Oct 15 13:51:26 2022] GET /compute/v2.1/servers/cb269dd0-b5af-4013-9ded-062f40176b8f/os-interface => generated 285 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 13:51:28.925096 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [req-3facfed0-4ec8-4e7f-ba77-f96d8217dda1 req-c75af7a8-033e-429a-aa63-a92e173db364 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb269dd0-b5af-4013-9ded-062f40176b8f", "tag": "4fc36f1c-5dfc-463e-b40a-40955077b6d2"}]} {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 13:51:28.946540 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [req-3facfed0-4ec8-4e7f-ba77-f96d8217dda1 req-c75af7a8-033e-429a-aa63-a92e173db364 service nova] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:51:28.958451 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [req-3facfed0-4ec8-4e7f-ba77-f96d8217dda1 req-c75af7a8-033e-429a-aa63-a92e173db364 service nova] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:51:28.960983 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [req-3facfed0-4ec8-4e7f-ba77-f96d8217dda1 req-c75af7a8-033e-429a-aa63-a92e173db364 service nova] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:51:29.000676 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.compute.server_external_events [req-3facfed0-4ec8-4e7f-ba77-f96d8217dda1 req-c75af7a8-033e-429a-aa63-a92e173db364 service nova] Creating event network-changed:4fc36f1c-5dfc-463e-b40a-40955077b6d2 for instance cb269dd0-b5af-4013-9ded-062f40176b8f on hv-cinder-86149 Oct 15 13:51:29.025446 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [req-3facfed0-4ec8-4e7f-ba77-f96d8217dda1 req-c75af7a8-033e-429a-aa63-a92e173db364 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105627 Oct 15 13:51:29.028453 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 184/359] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 15 13:51:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 15 13:51:34.688441 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-26b1eeb4-63ff-4584-92ac-cfbd5590345f tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1382402985", "imageRef": "26e64909-1cae-49ca-af5e-adea40c062d7", "flavorRef": "452"}} {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 13:51:36.707021 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG dbcounter [-] [125242] Writing DB stats nova_cell1:SELECT=44 {{(pid=125242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:51:38.944282 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG dbcounter [-] [125243] Writing DB stats nova_api:SELECT=9 {{(pid=125243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:51:38.975522 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG dbcounter [-] [125243] Writing DB stats nova_cell1:SELECT=17 {{(pid=125243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:51:39.479262 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-d7d6fb5b-77a3-4476-89f1-4c03f773abf9 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Action: 'create', calling method: .version_select at 0x7f1b5e3cf550>, body: {"keypair": {"name": "tempest-TestShelveInstance-492113451", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIUk6fuOw0d3/x1Mcyxm9C4y+vo1yrBrOthkJ85epE3pzbgOZSOpjlrji2AP1i8zAfXOPtTh7MmTfGr3RAt1B9s252Tv7f2u+RbUkrXF6HTNdzPCPwIKEiMs7vdE4H3sYQ=="}} {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 13:51:39.533796 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.quota [None req-d7d6fb5b-77a3-4476-89f1-4c03f773abf9 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Getting quotas for project 9a6be8e43c7742be84f4dc3c95a990e5. Resources: {'key_pairs'} {{(pid=125243) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 15 13:51:39.542700 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.quota [None req-d7d6fb5b-77a3-4476-89f1-4c03f773abf9 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Getting quotas for user ed6e530c3f544748bd3ffc256b1630b6 and project 9a6be8e43c7742be84f4dc3c95a990e5. Resources: {'key_pairs'} {{(pid=125243) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 15 13:51:39.627830 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-d7d6fb5b-77a3-4476-89f1-4c03f773abf9 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.724564 Oct 15 13:51:39.629987 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 185/360] 10.222.0.36 () {60 vars in 1159 bytes} [Sat Oct 15 13:51:38 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 13:51:44.729452 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG dbcounter [-] [125242] Writing DB stats nova_api:SELECT=7 {{(pid=125242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:51:45.573815 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.network.neutron [None req-26b1eeb4-63ff-4584-92ac-cfbd5590345f tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] validate_networks() for None {{(pid=125242) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 15 13:51:46.225038 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.virt.hardware [None req-26b1eeb4-63ff-4584-92ac-cfbd5590345f tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Flavor limits 0:0:0 {{(pid=125242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 15 13:51:46.226626 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.virt.hardware [None req-26b1eeb4-63ff-4584-92ac-cfbd5590345f tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Image limits 0:0:0 {{(pid=125242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 15 13:51:46.228826 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.virt.hardware [None req-26b1eeb4-63ff-4584-92ac-cfbd5590345f tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Flavor pref 0:0:0 {{(pid=125242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 15 13:51:46.229535 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.virt.hardware [None req-26b1eeb4-63ff-4584-92ac-cfbd5590345f tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Image pref 0:0:0 {{(pid=125242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 15 13:51:46.230383 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.virt.hardware [None req-26b1eeb4-63ff-4584-92ac-cfbd5590345f tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 15 13:51:46.245187 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-26b1eeb4-63ff-4584-92ac-cfbd5590345f tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:51:46.246136 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-26b1eeb4-63ff-4584-92ac-cfbd5590345f tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:51:46.246938 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-26b1eeb4-63ff-4584-92ac-cfbd5590345f tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:51:46.248756 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-26b1eeb4-63ff-4584-92ac-cfbd5590345f tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:51:46.249719 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-26b1eeb4-63ff-4584-92ac-cfbd5590345f tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:51:46.251155 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-26b1eeb4-63ff-4584-92ac-cfbd5590345f tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:51:46.286347 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.quota [None req-26b1eeb4-63ff-4584-92ac-cfbd5590345f tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Getting quotas for project 9da8e5e0fae247f48af6d303ae2fcdff. Resources: {'cores', 'ram', 'instances'} {{(pid=125242) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 15 13:51:46.292295 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.quota [None req-26b1eeb4-63ff-4584-92ac-cfbd5590345f tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Getting quotas for user a02652d1b503426cac6e77aa68f2e98c and project 9da8e5e0fae247f48af6d303ae2fcdff. Resources: {'cores', 'ram', 'instances'} {{(pid=125242) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 15 13:51:46.310721 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-26b1eeb4-63ff-4584-92ac-cfbd5590345f tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Going to run 1 instances... {{(pid=125242) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 15 13:51:46.321097 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-26b1eeb4-63ff-4584-92ac-cfbd5590345f tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] [instance: 9de39d23-3a0f-466b-82ea-fe384248d2dd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='26e64909-1cae-49ca-af5e-adea40c062d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125242) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 15 13:51:46.573654 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-26b1eeb4-63ff-4584-92ac-cfbd5590345f tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 11.890439 Oct 15 13:51:46.575277 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 176/361] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 15 13:51:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 11893 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 15 13:51:46.591068 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-cb7a64c7-c0da-4185-b98e-34ac09afa851 tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:51:46.591943 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-cb7a64c7-c0da-4185-b98e-34ac09afa851 tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] [instance: 9de39d23-3a0f-466b-82ea-fe384248d2dd] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:51:46.701859 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-cb7a64c7-c0da-4185-b98e-34ac09afa851 tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02652d1b503426cac6e77aa68f2e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da8e5e0fae247f48af6d303ae2fcdff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:51:46.715626 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-cb7a64c7-c0da-4185-b98e-34ac09afa851 tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] 10.222.0.36 "GET /compute/v2.1/servers/9de39d23-3a0f-466b-82ea-fe384248d2dd" status: 200 len: 1215 microversion: 2.1 time: 0.129375 Oct 15 13:51:46.748878 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 186/362] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:51:46 2022] GET /compute/v2.1/servers/9de39d23-3a0f-466b-82ea-fe384248d2dd => generated 1215 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 13:51:47.761126 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-46d4289b-4538-43bf-b7cc-314587ddb644 tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:51:47.765931 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-46d4289b-4538-43bf-b7cc-314587ddb644 tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] [instance: 9de39d23-3a0f-466b-82ea-fe384248d2dd] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:51:47.796756 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-46d4289b-4538-43bf-b7cc-314587ddb644 tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:51:47.797931 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-46d4289b-4538-43bf-b7cc-314587ddb644 tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:51:47.798967 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-46d4289b-4538-43bf-b7cc-314587ddb644 tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:51:47.799865 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-46d4289b-4538-43bf-b7cc-314587ddb644 tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:51:47.800376 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-46d4289b-4538-43bf-b7cc-314587ddb644 tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:51:47.800897 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-46d4289b-4538-43bf-b7cc-314587ddb644 tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:51:47.918989 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-46d4289b-4538-43bf-b7cc-314587ddb644 tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02652d1b503426cac6e77aa68f2e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da8e5e0fae247f48af6d303ae2fcdff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:51:47.931157 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-46d4289b-4538-43bf-b7cc-314587ddb644 tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] 10.222.0.36 "GET /compute/v2.1/servers/9de39d23-3a0f-466b-82ea-fe384248d2dd" status: 200 len: 1219 microversion: 2.1 time: 0.188082 Oct 15 13:51:47.932477 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 177/363] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:51:47 2022] GET /compute/v2.1/servers/9de39d23-3a0f-466b-82ea-fe384248d2dd => generated 1219 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:51:48.971575 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-8cf57d4a-24a6-45a1-90bb-a52167ce5ed6 tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:51:48.973376 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-8cf57d4a-24a6-45a1-90bb-a52167ce5ed6 tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] [instance: 9de39d23-3a0f-466b-82ea-fe384248d2dd] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:51:48.996925 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-8cf57d4a-24a6-45a1-90bb-a52167ce5ed6 tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:51:48.998011 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-8cf57d4a-24a6-45a1-90bb-a52167ce5ed6 tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:51:49.001081 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-8cf57d4a-24a6-45a1-90bb-a52167ce5ed6 tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:51:49.010176 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-8cf57d4a-24a6-45a1-90bb-a52167ce5ed6 tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:51:49.010923 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-8cf57d4a-24a6-45a1-90bb-a52167ce5ed6 tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:51:49.016272 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-8cf57d4a-24a6-45a1-90bb-a52167ce5ed6 tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:51:49.116954 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-8cf57d4a-24a6-45a1-90bb-a52167ce5ed6 tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02652d1b503426cac6e77aa68f2e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da8e5e0fae247f48af6d303ae2fcdff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:51:49.127197 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-8cf57d4a-24a6-45a1-90bb-a52167ce5ed6 tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] 10.222.0.36 "GET /compute/v2.1/servers/9de39d23-3a0f-466b-82ea-fe384248d2dd" status: 200 len: 1267 microversion: 2.1 time: 0.160228 Oct 15 13:51:49.128290 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 187/364] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:51:48 2022] GET /compute/v2.1/servers/9de39d23-3a0f-466b-82ea-fe384248d2dd => generated 1267 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:51:50.158358 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-b04a836e-29b9-44c8-9818-193bf07a6554 tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:51:50.169169 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-b04a836e-29b9-44c8-9818-193bf07a6554 tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] [instance: 9de39d23-3a0f-466b-82ea-fe384248d2dd] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:51:50.203829 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-b04a836e-29b9-44c8-9818-193bf07a6554 tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:51:50.209862 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-b04a836e-29b9-44c8-9818-193bf07a6554 tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:51:50.212422 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-b04a836e-29b9-44c8-9818-193bf07a6554 tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:51:50.216732 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-b04a836e-29b9-44c8-9818-193bf07a6554 tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:51:50.220905 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-b04a836e-29b9-44c8-9818-193bf07a6554 tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:51:50.222589 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-b04a836e-29b9-44c8-9818-193bf07a6554 tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:51:50.428835 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-b04a836e-29b9-44c8-9818-193bf07a6554 tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02652d1b503426cac6e77aa68f2e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da8e5e0fae247f48af6d303ae2fcdff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:51:50.457722 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-b04a836e-29b9-44c8-9818-193bf07a6554 tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] 10.222.0.36 "GET /compute/v2.1/servers/9de39d23-3a0f-466b-82ea-fe384248d2dd" status: 200 len: 1273 microversion: 2.1 time: 0.307264 Oct 15 13:51:50.468066 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 178/365] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:51:50 2022] GET /compute/v2.1/servers/9de39d23-3a0f-466b-82ea-fe384248d2dd => generated 1273 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:51:51.531795 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-aadb068e-d602-4955-b9fc-a0401f6f1070 tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:51:51.532916 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-aadb068e-d602-4955-b9fc-a0401f6f1070 tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] [instance: 9de39d23-3a0f-466b-82ea-fe384248d2dd] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:51:51.554037 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-aadb068e-d602-4955-b9fc-a0401f6f1070 tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:51:51.554893 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-aadb068e-d602-4955-b9fc-a0401f6f1070 tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:51:51.555621 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-aadb068e-d602-4955-b9fc-a0401f6f1070 tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:51:51.556989 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-aadb068e-d602-4955-b9fc-a0401f6f1070 tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:51:51.558328 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-aadb068e-d602-4955-b9fc-a0401f6f1070 tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:51:51.575518 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-aadb068e-d602-4955-b9fc-a0401f6f1070 tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:51:52.197869 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-aadb068e-d602-4955-b9fc-a0401f6f1070 tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02652d1b503426cac6e77aa68f2e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da8e5e0fae247f48af6d303ae2fcdff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:51:52.262466 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-aadb068e-d602-4955-b9fc-a0401f6f1070 tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] 10.222.0.36 "GET /compute/v2.1/servers/9de39d23-3a0f-466b-82ea-fe384248d2dd" status: 200 len: 1315 microversion: 2.1 time: 0.749698 Oct 15 13:51:52.278512 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 188/366] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:51:51 2022] GET /compute/v2.1/servers/9de39d23-3a0f-466b-82ea-fe384248d2dd => generated 1315 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:51:52.898816 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [req-e9729d67-0854-488c-bcbc-b694c2f280fc req-6e0ab373-4748-4238-9e9c-1412dc809f9a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9de39d23-3a0f-466b-82ea-fe384248d2dd", "tag": "3484d704-d05b-44ba-96f9-421f472f80fb"}]} {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 13:51:52.929253 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [req-e9729d67-0854-488c-bcbc-b694c2f280fc req-6e0ab373-4748-4238-9e9c-1412dc809f9a service nova] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:51:52.931334 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [req-e9729d67-0854-488c-bcbc-b694c2f280fc req-6e0ab373-4748-4238-9e9c-1412dc809f9a service nova] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:51:52.933091 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [req-e9729d67-0854-488c-bcbc-b694c2f280fc req-6e0ab373-4748-4238-9e9c-1412dc809f9a service nova] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:51:52.976368 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.compute.server_external_events [req-e9729d67-0854-488c-bcbc-b694c2f280fc req-6e0ab373-4748-4238-9e9c-1412dc809f9a service nova] Creating event network-changed:3484d704-d05b-44ba-96f9-421f472f80fb for instance 9de39d23-3a0f-466b-82ea-fe384248d2dd on hv-cinder-86149 Oct 15 13:51:52.983206 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [req-e9729d67-0854-488c-bcbc-b694c2f280fc req-6e0ab373-4748-4238-9e9c-1412dc809f9a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088788 Oct 15 13:51:52.984903 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 179/367] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 15 13:51:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 13:51:53.304708 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-1d220274-9e4b-4aae-bad8-34aeddae7e11 tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:51:53.306252 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-1d220274-9e4b-4aae-bad8-34aeddae7e11 tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] [instance: 9de39d23-3a0f-466b-82ea-fe384248d2dd] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:51:53.314546 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-1d220274-9e4b-4aae-bad8-34aeddae7e11 tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:51:53.315440 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-1d220274-9e4b-4aae-bad8-34aeddae7e11 tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:51:53.316194 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-1d220274-9e4b-4aae-bad8-34aeddae7e11 tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:51:53.317004 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-1d220274-9e4b-4aae-bad8-34aeddae7e11 tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:51:53.317678 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-1d220274-9e4b-4aae-bad8-34aeddae7e11 tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:51:53.318172 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-1d220274-9e4b-4aae-bad8-34aeddae7e11 tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:51:53.972787 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-1d220274-9e4b-4aae-bad8-34aeddae7e11 tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02652d1b503426cac6e77aa68f2e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da8e5e0fae247f48af6d303ae2fcdff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:51:54.002413 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-1d220274-9e4b-4aae-bad8-34aeddae7e11 tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] 10.222.0.36 "GET /compute/v2.1/servers/9de39d23-3a0f-466b-82ea-fe384248d2dd" status: 200 len: 1315 microversion: 2.1 time: 0.702959 Oct 15 13:51:54.018688 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 189/368] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:51:53 2022] GET /compute/v2.1/servers/9de39d23-3a0f-466b-82ea-fe384248d2dd => generated 1315 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 13:51:55.037397 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-0f7c4dad-3697-490c-a32e-a8c452bf6d7c tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:51:55.038420 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-0f7c4dad-3697-490c-a32e-a8c452bf6d7c tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] [instance: 9de39d23-3a0f-466b-82ea-fe384248d2dd] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:51:55.046225 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-0f7c4dad-3697-490c-a32e-a8c452bf6d7c tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:51:55.047160 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-0f7c4dad-3697-490c-a32e-a8c452bf6d7c tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:51:55.048247 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-0f7c4dad-3697-490c-a32e-a8c452bf6d7c tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:51:55.049393 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-0f7c4dad-3697-490c-a32e-a8c452bf6d7c tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:51:55.050083 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-0f7c4dad-3697-490c-a32e-a8c452bf6d7c tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:51:55.050817 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-0f7c4dad-3697-490c-a32e-a8c452bf6d7c tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:51:55.345293 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-0f7c4dad-3697-490c-a32e-a8c452bf6d7c tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02652d1b503426cac6e77aa68f2e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da8e5e0fae247f48af6d303ae2fcdff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:51:55.354714 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-0f7c4dad-3697-490c-a32e-a8c452bf6d7c tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] 10.222.0.36 "GET /compute/v2.1/servers/9de39d23-3a0f-466b-82ea-fe384248d2dd" status: 200 len: 1315 microversion: 2.1 time: 0.323565 Oct 15 13:51:55.371381 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 180/369] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:51:55 2022] GET /compute/v2.1/servers/9de39d23-3a0f-466b-82ea-fe384248d2dd => generated 1315 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 13:51:56.430495 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-f91badd8-bbb9-40ac-87f5-4de008d97597 tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:51:56.431795 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-f91badd8-bbb9-40ac-87f5-4de008d97597 tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] [instance: 9de39d23-3a0f-466b-82ea-fe384248d2dd] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:51:56.453588 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-f91badd8-bbb9-40ac-87f5-4de008d97597 tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:51:56.454700 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-f91badd8-bbb9-40ac-87f5-4de008d97597 tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:51:56.455514 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-f91badd8-bbb9-40ac-87f5-4de008d97597 tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:51:56.457157 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-f91badd8-bbb9-40ac-87f5-4de008d97597 tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:51:56.458524 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-f91badd8-bbb9-40ac-87f5-4de008d97597 tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:51:56.459420 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-f91badd8-bbb9-40ac-87f5-4de008d97597 tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:51:56.715539 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG dbcounter [-] [125243] Writing DB stats nova_cell0:SELECT=6 {{(pid=125243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:51:56.760389 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-f91badd8-bbb9-40ac-87f5-4de008d97597 tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02652d1b503426cac6e77aa68f2e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da8e5e0fae247f48af6d303ae2fcdff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:51:56.796470 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-f91badd8-bbb9-40ac-87f5-4de008d97597 tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] 10.222.0.36 "GET /compute/v2.1/servers/9de39d23-3a0f-466b-82ea-fe384248d2dd" status: 200 len: 1315 microversion: 2.1 time: 0.389207 Oct 15 13:51:56.804717 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 190/370] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:51:56 2022] GET /compute/v2.1/servers/9de39d23-3a0f-466b-82ea-fe384248d2dd => generated 1315 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:51:57.856331 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-f6806345-2190-49c1-8391-ff7bcca1e4b7 tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:51:57.860565 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-f6806345-2190-49c1-8391-ff7bcca1e4b7 tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] [instance: 9de39d23-3a0f-466b-82ea-fe384248d2dd] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:51:57.866530 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG dbcounter [-] [125242] Writing DB stats nova_cell0:SELECT=2 {{(pid=125242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:51:57.869738 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG dbcounter [-] [125242] Writing DB stats nova_cell0:SELECT=6 {{(pid=125242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:51:57.882099 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-f6806345-2190-49c1-8391-ff7bcca1e4b7 tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:51:57.883947 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-f6806345-2190-49c1-8391-ff7bcca1e4b7 tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:51:57.885639 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-f6806345-2190-49c1-8391-ff7bcca1e4b7 tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:51:57.887217 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-f6806345-2190-49c1-8391-ff7bcca1e4b7 tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:51:57.888442 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-f6806345-2190-49c1-8391-ff7bcca1e4b7 tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:51:57.890171 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-f6806345-2190-49c1-8391-ff7bcca1e4b7 tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:51:58.241837 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-f6806345-2190-49c1-8391-ff7bcca1e4b7 tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02652d1b503426cac6e77aa68f2e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da8e5e0fae247f48af6d303ae2fcdff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:51:58.261006 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-f6806345-2190-49c1-8391-ff7bcca1e4b7 tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] 10.222.0.36 "GET /compute/v2.1/servers/9de39d23-3a0f-466b-82ea-fe384248d2dd" status: 200 len: 1315 microversion: 2.1 time: 0.414289 Oct 15 13:51:58.263029 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 181/371] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:51:57 2022] GET /compute/v2.1/servers/9de39d23-3a0f-466b-82ea-fe384248d2dd => generated 1315 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:51:59.456754 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-da5640cc-08fb-48cf-a1f1-2ed30c2dcba0 tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:51:59.457682 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-da5640cc-08fb-48cf-a1f1-2ed30c2dcba0 tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] [instance: 9de39d23-3a0f-466b-82ea-fe384248d2dd] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:51:59.488149 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-da5640cc-08fb-48cf-a1f1-2ed30c2dcba0 tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:51:59.489013 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-da5640cc-08fb-48cf-a1f1-2ed30c2dcba0 tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:51:59.489675 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-da5640cc-08fb-48cf-a1f1-2ed30c2dcba0 tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:51:59.490646 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-da5640cc-08fb-48cf-a1f1-2ed30c2dcba0 tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:51:59.491306 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-da5640cc-08fb-48cf-a1f1-2ed30c2dcba0 tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:51:59.491983 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-da5640cc-08fb-48cf-a1f1-2ed30c2dcba0 tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:51:59.673232 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-da5640cc-08fb-48cf-a1f1-2ed30c2dcba0 tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02652d1b503426cac6e77aa68f2e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da8e5e0fae247f48af6d303ae2fcdff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:51:59.689215 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-da5640cc-08fb-48cf-a1f1-2ed30c2dcba0 tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] 10.222.0.36 "GET /compute/v2.1/servers/9de39d23-3a0f-466b-82ea-fe384248d2dd" status: 200 len: 1315 microversion: 2.1 time: 0.239615 Oct 15 13:51:59.690115 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 191/372] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:51:59 2022] GET /compute/v2.1/servers/9de39d23-3a0f-466b-82ea-fe384248d2dd => generated 1315 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:52:00.713887 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-dd38175b-e839-4a29-84b3-a19a63e7ba84 tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:52:00.715387 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-dd38175b-e839-4a29-84b3-a19a63e7ba84 tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] [instance: 9de39d23-3a0f-466b-82ea-fe384248d2dd] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:52:00.723286 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-dd38175b-e839-4a29-84b3-a19a63e7ba84 tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:00.723866 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-dd38175b-e839-4a29-84b3-a19a63e7ba84 tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:00.724399 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-dd38175b-e839-4a29-84b3-a19a63e7ba84 tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:00.725140 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-dd38175b-e839-4a29-84b3-a19a63e7ba84 tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:00.725645 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-dd38175b-e839-4a29-84b3-a19a63e7ba84 tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:00.726067 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-dd38175b-e839-4a29-84b3-a19a63e7ba84 tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:00.999113 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-dd38175b-e839-4a29-84b3-a19a63e7ba84 tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02652d1b503426cac6e77aa68f2e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da8e5e0fae247f48af6d303ae2fcdff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:52:01.013611 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-dd38175b-e839-4a29-84b3-a19a63e7ba84 tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] 10.222.0.36 "GET /compute/v2.1/servers/9de39d23-3a0f-466b-82ea-fe384248d2dd" status: 200 len: 1315 microversion: 2.1 time: 0.304087 Oct 15 13:52:01.028921 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 182/373] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:52:00 2022] GET /compute/v2.1/servers/9de39d23-3a0f-466b-82ea-fe384248d2dd => generated 1315 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 13:52:02.040487 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-ff2d5c2c-a1d1-41bf-ad3f-1d83336a8c9b tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:52:02.041496 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-ff2d5c2c-a1d1-41bf-ad3f-1d83336a8c9b tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] [instance: 9de39d23-3a0f-466b-82ea-fe384248d2dd] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:52:02.049746 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-ff2d5c2c-a1d1-41bf-ad3f-1d83336a8c9b tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:02.050519 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-ff2d5c2c-a1d1-41bf-ad3f-1d83336a8c9b tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:02.051229 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-ff2d5c2c-a1d1-41bf-ad3f-1d83336a8c9b tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:02.052133 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-ff2d5c2c-a1d1-41bf-ad3f-1d83336a8c9b tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:02.052649 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-ff2d5c2c-a1d1-41bf-ad3f-1d83336a8c9b tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:02.053141 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-ff2d5c2c-a1d1-41bf-ad3f-1d83336a8c9b tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:02.272067 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-ff2d5c2c-a1d1-41bf-ad3f-1d83336a8c9b tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02652d1b503426cac6e77aa68f2e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da8e5e0fae247f48af6d303ae2fcdff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:52:02.283110 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-ff2d5c2c-a1d1-41bf-ad3f-1d83336a8c9b tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] 10.222.0.36 "GET /compute/v2.1/servers/9de39d23-3a0f-466b-82ea-fe384248d2dd" status: 200 len: 1315 microversion: 2.1 time: 0.246824 Oct 15 13:52:02.287951 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 192/374] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:52:02 2022] GET /compute/v2.1/servers/9de39d23-3a0f-466b-82ea-fe384248d2dd => generated 1315 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:52:03.310257 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-e2883cac-7290-4649-b73c-54e5703627cb tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:52:03.311599 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-e2883cac-7290-4649-b73c-54e5703627cb tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] [instance: 9de39d23-3a0f-466b-82ea-fe384248d2dd] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:52:03.324097 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-e2883cac-7290-4649-b73c-54e5703627cb tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:03.324949 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-e2883cac-7290-4649-b73c-54e5703627cb tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:03.325678 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-e2883cac-7290-4649-b73c-54e5703627cb tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:03.326873 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-e2883cac-7290-4649-b73c-54e5703627cb tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:03.329156 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-e2883cac-7290-4649-b73c-54e5703627cb tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:03.330032 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-e2883cac-7290-4649-b73c-54e5703627cb tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:03.598492 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-e2883cac-7290-4649-b73c-54e5703627cb tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02652d1b503426cac6e77aa68f2e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da8e5e0fae247f48af6d303ae2fcdff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:52:03.612240 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-e2883cac-7290-4649-b73c-54e5703627cb tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] 10.222.0.36 "GET /compute/v2.1/servers/9de39d23-3a0f-466b-82ea-fe384248d2dd" status: 200 len: 1315 microversion: 2.1 time: 0.308040 Oct 15 13:52:03.613038 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 183/375] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:52:03 2022] GET /compute/v2.1/servers/9de39d23-3a0f-466b-82ea-fe384248d2dd => generated 1315 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:52:04.641655 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-21986df6-6151-4271-b86f-79e02b75c0d3 tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:52:04.642498 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-21986df6-6151-4271-b86f-79e02b75c0d3 tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] [instance: 9de39d23-3a0f-466b-82ea-fe384248d2dd] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:52:04.649412 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-21986df6-6151-4271-b86f-79e02b75c0d3 tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:04.649927 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-21986df6-6151-4271-b86f-79e02b75c0d3 tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:04.650468 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-21986df6-6151-4271-b86f-79e02b75c0d3 tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:04.651349 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-21986df6-6151-4271-b86f-79e02b75c0d3 tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:04.651664 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-21986df6-6151-4271-b86f-79e02b75c0d3 tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:04.652141 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-21986df6-6151-4271-b86f-79e02b75c0d3 tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:04.841351 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-21986df6-6151-4271-b86f-79e02b75c0d3 tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02652d1b503426cac6e77aa68f2e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da8e5e0fae247f48af6d303ae2fcdff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:52:04.851918 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-21986df6-6151-4271-b86f-79e02b75c0d3 tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] 10.222.0.36 "GET /compute/v2.1/servers/9de39d23-3a0f-466b-82ea-fe384248d2dd" status: 200 len: 1315 microversion: 2.1 time: 0.214833 Oct 15 13:52:04.852989 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 193/376] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:52:04 2022] GET /compute/v2.1/servers/9de39d23-3a0f-466b-82ea-fe384248d2dd => generated 1315 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 13:52:05.893841 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-cef1e432-44db-4952-8861-322e01966657 tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:52:05.893841 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-cef1e432-44db-4952-8861-322e01966657 tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] [instance: 9de39d23-3a0f-466b-82ea-fe384248d2dd] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:52:05.900609 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-cef1e432-44db-4952-8861-322e01966657 tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:05.901438 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-cef1e432-44db-4952-8861-322e01966657 tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:05.901882 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-cef1e432-44db-4952-8861-322e01966657 tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:05.902661 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-cef1e432-44db-4952-8861-322e01966657 tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:05.903125 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-cef1e432-44db-4952-8861-322e01966657 tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:05.903551 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-cef1e432-44db-4952-8861-322e01966657 tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:06.096542 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-cef1e432-44db-4952-8861-322e01966657 tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02652d1b503426cac6e77aa68f2e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da8e5e0fae247f48af6d303ae2fcdff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:52:06.111504 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-cef1e432-44db-4952-8861-322e01966657 tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] 10.222.0.36 "GET /compute/v2.1/servers/9de39d23-3a0f-466b-82ea-fe384248d2dd" status: 200 len: 1315 microversion: 2.1 time: 0.222098 Oct 15 13:52:06.113068 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 184/377] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:52:05 2022] GET /compute/v2.1/servers/9de39d23-3a0f-466b-82ea-fe384248d2dd => generated 1315 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:52:07.088631 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-ea3ccb8c-f698-4e60-93e9-60bbe29dcb6a tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:52:07.089301 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-ea3ccb8c-f698-4e60-93e9-60bbe29dcb6a tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] [instance: 40d67d09-379e-4c12-b36c-21edf3b23e45] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:52:07.099121 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-ea3ccb8c-f698-4e60-93e9-60bbe29dcb6a tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:07.099866 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-ea3ccb8c-f698-4e60-93e9-60bbe29dcb6a tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:07.100517 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-ea3ccb8c-f698-4e60-93e9-60bbe29dcb6a tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:07.102018 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-ea3ccb8c-f698-4e60-93e9-60bbe29dcb6a tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:07.103507 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-ea3ccb8c-f698-4e60-93e9-60bbe29dcb6a tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:07.104078 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-ea3ccb8c-f698-4e60-93e9-60bbe29dcb6a tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:07.135416 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-ea3ccb8c-f698-4e60-93e9-60bbe29dcb6a tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] 10.222.0.36 "GET /compute/v2.1/servers/40d67d09-379e-4c12-b36c-21edf3b23e45/ips" status: 200 len: 147 microversion: 2.1 time: 0.051458 Oct 15 13:52:07.136138 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 194/378] 10.222.0.36 () {58 vars in 1248 bytes} [Sat Oct 15 13:52:07 2022] GET /compute/v2.1/servers/40d67d09-379e-4c12-b36c-21edf3b23e45/ips => generated 147 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 13:52:07.140719 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-834a29ef-ea66-4254-bf95-142b497cfe2e tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:52:07.141891 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-834a29ef-ea66-4254-bf95-142b497cfe2e tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] [instance: 9de39d23-3a0f-466b-82ea-fe384248d2dd] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:52:07.150974 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-834a29ef-ea66-4254-bf95-142b497cfe2e tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:07.151559 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-834a29ef-ea66-4254-bf95-142b497cfe2e tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:07.152149 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-834a29ef-ea66-4254-bf95-142b497cfe2e tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:07.153148 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-834a29ef-ea66-4254-bf95-142b497cfe2e tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:07.153694 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-834a29ef-ea66-4254-bf95-142b497cfe2e tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:07.154204 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-834a29ef-ea66-4254-bf95-142b497cfe2e tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:07.159324 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG dbcounter [-] [125242] Writing DB stats nova_cell1:SELECT=47 {{(pid=125242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:52:07.416198 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-834a29ef-ea66-4254-bf95-142b497cfe2e tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02652d1b503426cac6e77aa68f2e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da8e5e0fae247f48af6d303ae2fcdff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:52:07.426434 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-834a29ef-ea66-4254-bf95-142b497cfe2e tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] 10.222.0.36 "GET /compute/v2.1/servers/9de39d23-3a0f-466b-82ea-fe384248d2dd" status: 200 len: 1315 microversion: 2.1 time: 0.290174 Oct 15 13:52:07.427637 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 185/379] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:52:07 2022] GET /compute/v2.1/servers/9de39d23-3a0f-466b-82ea-fe384248d2dd => generated 1315 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 13:52:08.471838 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-288b9c33-5811-4c66-96d5-ff9698cfa891 tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:52:08.472866 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-288b9c33-5811-4c66-96d5-ff9698cfa891 tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] [instance: 9de39d23-3a0f-466b-82ea-fe384248d2dd] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:52:08.484706 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-288b9c33-5811-4c66-96d5-ff9698cfa891 tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:08.485579 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-288b9c33-5811-4c66-96d5-ff9698cfa891 tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:08.486344 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-288b9c33-5811-4c66-96d5-ff9698cfa891 tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:08.487588 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-288b9c33-5811-4c66-96d5-ff9698cfa891 tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:08.489003 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-288b9c33-5811-4c66-96d5-ff9698cfa891 tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:08.489689 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-288b9c33-5811-4c66-96d5-ff9698cfa891 tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:08.725911 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-288b9c33-5811-4c66-96d5-ff9698cfa891 tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02652d1b503426cac6e77aa68f2e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da8e5e0fae247f48af6d303ae2fcdff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:52:08.741145 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-288b9c33-5811-4c66-96d5-ff9698cfa891 tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] 10.222.0.36 "GET /compute/v2.1/servers/9de39d23-3a0f-466b-82ea-fe384248d2dd" status: 200 len: 1315 microversion: 2.1 time: 0.275530 Oct 15 13:52:08.741924 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 195/380] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:52:08 2022] GET /compute/v2.1/servers/9de39d23-3a0f-466b-82ea-fe384248d2dd => generated 1315 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 13:52:09.800903 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-73f2f089-1abb-492d-aa95-875e50b070c8 tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:52:09.804891 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-73f2f089-1abb-492d-aa95-875e50b070c8 tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] [instance: 9de39d23-3a0f-466b-82ea-fe384248d2dd] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:52:09.817527 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-73f2f089-1abb-492d-aa95-875e50b070c8 tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:09.818533 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-73f2f089-1abb-492d-aa95-875e50b070c8 tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:09.819397 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-73f2f089-1abb-492d-aa95-875e50b070c8 tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:09.821052 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-73f2f089-1abb-492d-aa95-875e50b070c8 tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:09.821705 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-73f2f089-1abb-492d-aa95-875e50b070c8 tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:09.822306 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-73f2f089-1abb-492d-aa95-875e50b070c8 tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:10.087648 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-73f2f089-1abb-492d-aa95-875e50b070c8 tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02652d1b503426cac6e77aa68f2e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da8e5e0fae247f48af6d303ae2fcdff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:52:10.096855 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-73f2f089-1abb-492d-aa95-875e50b070c8 tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] 10.222.0.36 "GET /compute/v2.1/servers/9de39d23-3a0f-466b-82ea-fe384248d2dd" status: 200 len: 1315 microversion: 2.1 time: 0.322263 Oct 15 13:52:10.097453 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 186/381] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:52:09 2022] GET /compute/v2.1/servers/9de39d23-3a0f-466b-82ea-fe384248d2dd => generated 1315 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 13:52:10.415172 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [req-a7862467-c5d9-4ad6-b007-c530d3230e3a req-9544eda9-ac55-49db-abfd-a4556e336429 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9de39d23-3a0f-466b-82ea-fe384248d2dd", "name": "network-vif-plugged", "status": "completed", "tag": "3484d704-d05b-44ba-96f9-421f472f80fb"}]} {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 13:52:10.424714 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG dbcounter [-] [125243] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=1 {{(pid=125243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:52:10.427678 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [req-a7862467-c5d9-4ad6-b007-c530d3230e3a req-9544eda9-ac55-49db-abfd-a4556e336429 service nova] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:10.428565 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [req-a7862467-c5d9-4ad6-b007-c530d3230e3a req-9544eda9-ac55-49db-abfd-a4556e336429 service nova] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:10.429297 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [req-a7862467-c5d9-4ad6-b007-c530d3230e3a req-9544eda9-ac55-49db-abfd-a4556e336429 service nova] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:10.455600 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.compute.server_external_events [req-a7862467-c5d9-4ad6-b007-c530d3230e3a req-9544eda9-ac55-49db-abfd-a4556e336429 service nova] Creating event network-vif-plugged:3484d704-d05b-44ba-96f9-421f472f80fb for instance 9de39d23-3a0f-466b-82ea-fe384248d2dd on hv-cinder-86149 Oct 15 13:52:10.468081 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [req-a7862467-c5d9-4ad6-b007-c530d3230e3a req-9544eda9-ac55-49db-abfd-a4556e336429 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056607 Oct 15 13:52:10.468893 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 196/382] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 15 13:52:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 15 13:52:11.130911 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-da0af204-deea-4a0d-9eb0-7bea0ae8d54d tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:52:11.131743 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-da0af204-deea-4a0d-9eb0-7bea0ae8d54d tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] [instance: 9de39d23-3a0f-466b-82ea-fe384248d2dd] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:52:11.146416 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-da0af204-deea-4a0d-9eb0-7bea0ae8d54d tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:11.146921 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-da0af204-deea-4a0d-9eb0-7bea0ae8d54d tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:11.147351 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-da0af204-deea-4a0d-9eb0-7bea0ae8d54d tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:11.148389 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-da0af204-deea-4a0d-9eb0-7bea0ae8d54d tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:11.150522 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-da0af204-deea-4a0d-9eb0-7bea0ae8d54d tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:11.151348 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-da0af204-deea-4a0d-9eb0-7bea0ae8d54d tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:11.486832 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-da0af204-deea-4a0d-9eb0-7bea0ae8d54d tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02652d1b503426cac6e77aa68f2e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da8e5e0fae247f48af6d303ae2fcdff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:52:11.505878 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-da0af204-deea-4a0d-9eb0-7bea0ae8d54d tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] 10.222.0.36 "GET /compute/v2.1/servers/9de39d23-3a0f-466b-82ea-fe384248d2dd" status: 200 len: 1315 microversion: 2.1 time: 0.378175 Oct 15 13:52:11.506873 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 187/383] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:52:11 2022] GET /compute/v2.1/servers/9de39d23-3a0f-466b-82ea-fe384248d2dd => generated 1315 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 13:52:11.996258 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-cd532363-cf18-4b0f-a6c0-c3cbaafee55a tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "831ba96d-8071-44a9-b3a9-1e54b4af94bb"}} {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 13:52:11.999608 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-cd532363-cf18-4b0f-a6c0-c3cbaafee55a tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] [instance: 40d67d09-379e-4c12-b36c-21edf3b23e45] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:52:12.007529 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-cd532363-cf18-4b0f-a6c0-c3cbaafee55a tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:12.008357 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-cd532363-cf18-4b0f-a6c0-c3cbaafee55a tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:12.008974 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-cd532363-cf18-4b0f-a6c0-c3cbaafee55a tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:12.009951 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-cd532363-cf18-4b0f-a6c0-c3cbaafee55a tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:12.010365 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-cd532363-cf18-4b0f-a6c0-c3cbaafee55a tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:12.010946 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-cd532363-cf18-4b0f-a6c0-c3cbaafee55a tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:12.548160 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-cd532363-cf18-4b0f-a6c0-c3cbaafee55a tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] 10.222.0.36 "POST /compute/v2.1/servers/40d67d09-379e-4c12-b36c-21edf3b23e45/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.557506 Oct 15 13:52:12.549794 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 197/384] 10.222.0.36 () {60 vars in 1323 bytes} [Sat Oct 15 13:52:11 2022] POST /compute/v2.1/servers/40d67d09-379e-4c12-b36c-21edf3b23e45/os-volume_attachments => generated 194 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 13:52:12.550947 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-ba7891da-67df-485b-b7a4-37a30c591942 tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:52:12.551594 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-ba7891da-67df-485b-b7a4-37a30c591942 tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] [instance: 9de39d23-3a0f-466b-82ea-fe384248d2dd] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:52:12.568425 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-ba7891da-67df-485b-b7a4-37a30c591942 tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:12.569409 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-ba7891da-67df-485b-b7a4-37a30c591942 tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:12.570039 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-ba7891da-67df-485b-b7a4-37a30c591942 tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:12.570962 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-ba7891da-67df-485b-b7a4-37a30c591942 tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:12.571589 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-ba7891da-67df-485b-b7a4-37a30c591942 tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:12.572376 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-ba7891da-67df-485b-b7a4-37a30c591942 tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:12.868940 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-ba7891da-67df-485b-b7a4-37a30c591942 tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02652d1b503426cac6e77aa68f2e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da8e5e0fae247f48af6d303ae2fcdff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:52:12.886650 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-ba7891da-67df-485b-b7a4-37a30c591942 tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] 10.222.0.36 "GET /compute/v2.1/servers/9de39d23-3a0f-466b-82ea-fe384248d2dd" status: 200 len: 1315 microversion: 2.1 time: 0.339952 Oct 15 13:52:12.888199 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 188/385] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:52:12 2022] GET /compute/v2.1/servers/9de39d23-3a0f-466b-82ea-fe384248d2dd => generated 1315 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 13:52:13.927946 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-82112e61-a481-4444-ba10-1653582d0c64 tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:52:13.930273 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-82112e61-a481-4444-ba10-1653582d0c64 tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] [instance: 9de39d23-3a0f-466b-82ea-fe384248d2dd] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:52:13.947321 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-82112e61-a481-4444-ba10-1653582d0c64 tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:13.948036 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-82112e61-a481-4444-ba10-1653582d0c64 tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:13.948938 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-82112e61-a481-4444-ba10-1653582d0c64 tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:13.950289 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-82112e61-a481-4444-ba10-1653582d0c64 tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:13.950988 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-82112e61-a481-4444-ba10-1653582d0c64 tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:13.951627 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-82112e61-a481-4444-ba10-1653582d0c64 tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:14.143168 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-82112e61-a481-4444-ba10-1653582d0c64 tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02652d1b503426cac6e77aa68f2e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da8e5e0fae247f48af6d303ae2fcdff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:52:14.152635 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-82112e61-a481-4444-ba10-1653582d0c64 tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] 10.222.0.36 "GET /compute/v2.1/servers/9de39d23-3a0f-466b-82ea-fe384248d2dd" status: 200 len: 1465 microversion: 2.1 time: 0.240518 Oct 15 13:52:14.154030 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 198/386] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:52:13 2022] GET /compute/v2.1/servers/9de39d23-3a0f-466b-82ea-fe384248d2dd => generated 1465 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:52:14.240530 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-7aa9e717-28bb-4866-b952-f09710b6a129 tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:52:14.242913 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-7aa9e717-28bb-4866-b952-f09710b6a129 tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] [instance: 9de39d23-3a0f-466b-82ea-fe384248d2dd] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:52:14.245929 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 15 13:52:14.246342 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Sat Oct 15 13:52:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9de39d23-3a0f-466b-82ea-fe384248d2dd (ip 10.222.0.36) !!! Oct 15 13:52:14.255024 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-7aa9e717-28bb-4866-b952-f09710b6a129 tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:14.255504 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-7aa9e717-28bb-4866-b952-f09710b6a129 tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:14.256089 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-7aa9e717-28bb-4866-b952-f09710b6a129 tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:14.256883 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-7aa9e717-28bb-4866-b952-f09710b6a129 tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:14.257518 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-7aa9e717-28bb-4866-b952-f09710b6a129 tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:14.257959 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-7aa9e717-28bb-4866-b952-f09710b6a129 tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:14.291135 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-7aa9e717-28bb-4866-b952-f09710b6a129 tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] [instance: 9de39d23-3a0f-466b-82ea-fe384248d2dd] Going to try to terminate instance {{(pid=125242) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 15 13:52:14.464117 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-7aa9e717-28bb-4866-b952-f09710b6a129 tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] 10.222.0.36 "DELETE /compute/v2.1/servers/9de39d23-3a0f-466b-82ea-fe384248d2dd" status: 204 len: 0 microversion: 2.1 time: 0.231358 Oct 15 13:52:14.465666 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 189/387] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 15 13:52:14 2022] DELETE /compute/v2.1/servers/9de39d23-3a0f-466b-82ea-fe384248d2dd => generated 0 bytes in 235 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 15 13:52:14.480340 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-34653c07-5069-4b3a-8590-bca5d4e7ccb2 tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:52:14.481870 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-34653c07-5069-4b3a-8590-bca5d4e7ccb2 tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] [instance: 9de39d23-3a0f-466b-82ea-fe384248d2dd] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:52:14.496226 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-34653c07-5069-4b3a-8590-bca5d4e7ccb2 tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:14.499333 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-34653c07-5069-4b3a-8590-bca5d4e7ccb2 tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:14.500806 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-34653c07-5069-4b3a-8590-bca5d4e7ccb2 tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:14.502875 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-34653c07-5069-4b3a-8590-bca5d4e7ccb2 tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:14.504166 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-34653c07-5069-4b3a-8590-bca5d4e7ccb2 tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:14.505071 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-34653c07-5069-4b3a-8590-bca5d4e7ccb2 tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:14.759207 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-34653c07-5069-4b3a-8590-bca5d4e7ccb2 tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02652d1b503426cac6e77aa68f2e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da8e5e0fae247f48af6d303ae2fcdff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:52:14.769141 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-34653c07-5069-4b3a-8590-bca5d4e7ccb2 tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] 10.222.0.36 "GET /compute/v2.1/servers/9de39d23-3a0f-466b-82ea-fe384248d2dd" status: 200 len: 1471 microversion: 2.1 time: 0.296522 Oct 15 13:52:14.770088 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 199/388] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:52:14 2022] GET /compute/v2.1/servers/9de39d23-3a0f-466b-82ea-fe384248d2dd => generated 1471 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:52:15.810329 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-bb167605-3cc1-45aa-bb29-887e6f9da36b tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:52:15.811643 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-bb167605-3cc1-45aa-bb29-887e6f9da36b tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] [instance: 9de39d23-3a0f-466b-82ea-fe384248d2dd] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:52:15.824633 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG dbcounter [-] [125242] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=125242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:52:15.829399 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-bb167605-3cc1-45aa-bb29-887e6f9da36b tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:15.830754 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-bb167605-3cc1-45aa-bb29-887e6f9da36b tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:15.831747 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-bb167605-3cc1-45aa-bb29-887e6f9da36b tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:15.833067 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-bb167605-3cc1-45aa-bb29-887e6f9da36b tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:15.834275 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-bb167605-3cc1-45aa-bb29-887e6f9da36b tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:15.835054 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-bb167605-3cc1-45aa-bb29-887e6f9da36b tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:16.136843 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-bb167605-3cc1-45aa-bb29-887e6f9da36b tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02652d1b503426cac6e77aa68f2e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da8e5e0fae247f48af6d303ae2fcdff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:52:16.161912 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-bb167605-3cc1-45aa-bb29-887e6f9da36b tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] 10.222.0.36 "GET /compute/v2.1/servers/9de39d23-3a0f-466b-82ea-fe384248d2dd" status: 200 len: 1471 microversion: 2.1 time: 0.360712 Oct 15 13:52:16.163154 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 190/389] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:52:15 2022] GET /compute/v2.1/servers/9de39d23-3a0f-466b-82ea-fe384248d2dd => generated 1471 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:52:17.205197 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-d768c00a-b85c-4b6d-b9fa-61d187053257 tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:52:17.205866 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-d768c00a-b85c-4b6d-b9fa-61d187053257 tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] [instance: 9de39d23-3a0f-466b-82ea-fe384248d2dd] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:52:17.215567 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-d768c00a-b85c-4b6d-b9fa-61d187053257 tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:17.216397 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-d768c00a-b85c-4b6d-b9fa-61d187053257 tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:17.230614 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-d768c00a-b85c-4b6d-b9fa-61d187053257 tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:17.231661 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-d768c00a-b85c-4b6d-b9fa-61d187053257 tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:17.232300 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-d768c00a-b85c-4b6d-b9fa-61d187053257 tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:17.233067 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-d768c00a-b85c-4b6d-b9fa-61d187053257 tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:17.416510 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-d768c00a-b85c-4b6d-b9fa-61d187053257 tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02652d1b503426cac6e77aa68f2e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da8e5e0fae247f48af6d303ae2fcdff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:52:17.430308 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-d768c00a-b85c-4b6d-b9fa-61d187053257 tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] 10.222.0.36 "GET /compute/v2.1/servers/9de39d23-3a0f-466b-82ea-fe384248d2dd" status: 200 len: 1429 microversion: 2.1 time: 0.228856 Oct 15 13:52:17.432501 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 200/390] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:52:17 2022] GET /compute/v2.1/servers/9de39d23-3a0f-466b-82ea-fe384248d2dd => generated 1429 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 13:52:17.558337 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [req-0909ffed-a48a-42d0-9b93-b95cd948e352 req-98ba524e-3cd7-4d93-a477-634ac0e95e68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9de39d23-3a0f-466b-82ea-fe384248d2dd", "name": "network-vif-deleted", "tag": "3484d704-d05b-44ba-96f9-421f472f80fb"}]} {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 13:52:17.576432 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [req-0909ffed-a48a-42d0-9b93-b95cd948e352 req-98ba524e-3cd7-4d93-a477-634ac0e95e68 service nova] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:17.577450 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [req-0909ffed-a48a-42d0-9b93-b95cd948e352 req-98ba524e-3cd7-4d93-a477-634ac0e95e68 service nova] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:17.578455 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [req-0909ffed-a48a-42d0-9b93-b95cd948e352 req-98ba524e-3cd7-4d93-a477-634ac0e95e68 service nova] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:17.618795 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.compute.server_external_events [req-0909ffed-a48a-42d0-9b93-b95cd948e352 req-98ba524e-3cd7-4d93-a477-634ac0e95e68 service nova] Creating event network-vif-deleted:3484d704-d05b-44ba-96f9-421f472f80fb for instance 9de39d23-3a0f-466b-82ea-fe384248d2dd on hv-cinder-86149 Oct 15 13:52:17.625063 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [req-0909ffed-a48a-42d0-9b93-b95cd948e352 req-98ba524e-3cd7-4d93-a477-634ac0e95e68 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071611 Oct 15 13:52:17.630924 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 191/391] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 15 13:52:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 15 13:52:18.468564 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-cdb1c56b-21fc-4634-a338-36fe9bc7731a tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:52:18.473019 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-cdb1c56b-21fc-4634-a338-36fe9bc7731a tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] [instance: 9de39d23-3a0f-466b-82ea-fe384248d2dd] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:52:18.494487 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-cdb1c56b-21fc-4634-a338-36fe9bc7731a tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:18.495785 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-cdb1c56b-21fc-4634-a338-36fe9bc7731a tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:18.496828 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-cdb1c56b-21fc-4634-a338-36fe9bc7731a tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:18.498575 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-cdb1c56b-21fc-4634-a338-36fe9bc7731a tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:18.499586 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-cdb1c56b-21fc-4634-a338-36fe9bc7731a tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:18.500731 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-cdb1c56b-21fc-4634-a338-36fe9bc7731a tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:18.597584 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-cdb1c56b-21fc-4634-a338-36fe9bc7731a tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:18.598082 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-cdb1c56b-21fc-4634-a338-36fe9bc7731a tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:18.598521 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-cdb1c56b-21fc-4634-a338-36fe9bc7731a tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:18.598976 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.objects.instance [None req-cdb1c56b-21fc-4634-a338-36fe9bc7731a tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Lazy-loading 'fault' on Instance uuid 9de39d23-3a0f-466b-82ea-fe384248d2dd {{(pid=125243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 15 13:52:18.750024 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-cdb1c56b-21fc-4634-a338-36fe9bc7731a tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02652d1b503426cac6e77aa68f2e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da8e5e0fae247f48af6d303ae2fcdff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:52:18.765752 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-cdb1c56b-21fc-4634-a338-36fe9bc7731a tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] 10.222.0.36 "GET /compute/v2.1/servers/9de39d23-3a0f-466b-82ea-fe384248d2dd" status: 200 len: 1305 microversion: 2.1 time: 0.307437 Oct 15 13:52:18.771852 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 201/392] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:52:18 2022] GET /compute/v2.1/servers/9de39d23-3a0f-466b-82ea-fe384248d2dd => generated 1305 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:52:19.009216 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-9e64207b-a1f3-4aaa-9f74-fefeeb9b6b4d tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:52:19.010036 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-9e64207b-a1f3-4aaa-9f74-fefeeb9b6b4d tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 5fc359cf-ff2c-4189-b058-31eb3c97568c] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:52:19.025818 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-9e64207b-a1f3-4aaa-9f74-fefeeb9b6b4d tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:19.026320 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-9e64207b-a1f3-4aaa-9f74-fefeeb9b6b4d tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:19.026754 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-9e64207b-a1f3-4aaa-9f74-fefeeb9b6b4d tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:19.027472 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-9e64207b-a1f3-4aaa-9f74-fefeeb9b6b4d tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:19.028041 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-9e64207b-a1f3-4aaa-9f74-fefeeb9b6b4d tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:19.028369 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-9e64207b-a1f3-4aaa-9f74-fefeeb9b6b4d tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:19.099108 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-9e64207b-a1f3-4aaa-9f74-fefeeb9b6b4d tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c/ips" status: 200 len: 152 microversion: 2.20 time: 0.095404 Oct 15 13:52:19.099987 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 192/393] 10.222.0.36 () {60 vars in 1289 bytes} [Sat Oct 15 13:52:19 2022] GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c/ips => generated 152 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 13:52:19.816391 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-6c34b6e8-b733-4e5a-afb8-5a129ae73fe4 tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:52:19.817276 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-6c34b6e8-b733-4e5a-afb8-5a129ae73fe4 tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] [instance: 9de39d23-3a0f-466b-82ea-fe384248d2dd] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:52:19.840642 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-6c34b6e8-b733-4e5a-afb8-5a129ae73fe4 tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:19.846165 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-6c34b6e8-b733-4e5a-afb8-5a129ae73fe4 tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:19.846892 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-6c34b6e8-b733-4e5a-afb8-5a129ae73fe4 tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:19.847656 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-6c34b6e8-b733-4e5a-afb8-5a129ae73fe4 tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:19.849007 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-6c34b6e8-b733-4e5a-afb8-5a129ae73fe4 tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:19.850864 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-6c34b6e8-b733-4e5a-afb8-5a129ae73fe4 tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:19.858335 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG dbcounter [-] [125243] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:52:19.911049 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.wsgi [None req-6c34b6e8-b733-4e5a-afb8-5a129ae73fe4 tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] HTTP exception thrown: Instance 9de39d23-3a0f-466b-82ea-fe384248d2dd could not be found. Oct 15 13:52:19.913081 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-6c34b6e8-b733-4e5a-afb8-5a129ae73fe4 tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Request method failure captured: Oct 15 13:52:19.913081 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: request: GET /compute/v2.1/servers/9de39d23-3a0f-466b-82ea-fe384248d2dd HTTP/1.1 Oct 15 13:52:19.913081 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: Accept: application/json Oct 15 13:52:19.913081 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: Accept-Encoding: identity Oct 15 13:52:19.913081 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: Connection: close Oct 15 13:52:19.913081 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: Content-Length: 0 Oct 15 13:52:19.913081 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: Content-Type: application/json Oct 15 13:52:19.913081 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: Host: 10.222.0.36 Oct 15 13:52:19.913081 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: Openstack-System-Scope: None Oct 15 13:52:19.913081 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: User-Agent: python-urllib3/1.26.12 Oct 15 13:52:19.913081 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Auth-Token: gAAAAABjSrrgWzenQLtA0fMdXxAMmlNvI8pcYFW1e-MpywAR2ZokbkCpU57J-2I2sgczvWDw3HaYzBbj66Dkc8DUYu5GWA6DgrL5olj0VdPhucnJHUQSkIlQm0yQC6Qk83UZ4PeVllfvHUhGB99D1NayEyNdY37t3rGahKVzgxCk3TT75quvKhY Oct 15 13:52:19.913081 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Domain-Id: None Oct 15 13:52:19.913081 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Domain-Name: None Oct 15 13:52:19.913081 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Identity-Status: Confirmed Oct 15 13:52:19.913081 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Is-Admin-Project: True Oct 15 13:52:19.913081 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Project-Domain-Id: default Oct 15 13:52:19.913081 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Project-Domain-Name: Default Oct 15 13:52:19.913081 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Project-Id: 9da8e5e0fae247f48af6d303ae2fcdff Oct 15 13:52:19.913081 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Project-Name: tempest-VolumesNegativeTest-803597981 Oct 15 13:52:19.913081 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Role: member,reader Oct 15 13:52:19.913081 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Roles: member,reader Oct 15 13:52:19.914397 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_9da8e5e0fae247f48af6d303ae2fcdff", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/9da8e5e0fae247f48af6d303ae2fcdff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/9da8e5e0fae247f48af6d303ae2fcdff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/9da8e5e0fae247f48af6d303ae2fcdff"}]}] Oct 15 13:52:19.914397 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Tenant: tempest-VolumesNegativeTest-803597981 Oct 15 13:52:19.914397 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Tenant-Id: 9da8e5e0fae247f48af6d303ae2fcdff Oct 15 13:52:19.914397 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Tenant-Name: tempest-VolumesNegativeTest-803597981 Oct 15 13:52:19.914397 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-User: tempest-VolumesNegativeTest-803597981-project Oct 15 13:52:19.914397 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-User-Domain-Id: default Oct 15 13:52:19.914397 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-User-Domain-Name: Default Oct 15 13:52:19.914397 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-User-Id: a02652d1b503426cac6e77aa68f2e98c Oct 15 13:52:19.914397 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-User-Name: tempest-VolumesNegativeTest-803597981-project Oct 15 13:52:19.914397 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: method: > Oct 15 13:52:19.914397 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: exception: Instance 9de39d23-3a0f-466b-82ea-fe384248d2dd could not be found. Oct 15 13:52:19.914397 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: action_args: {'id': '9de39d23-3a0f-466b-82ea-fe384248d2dd'} Oct 15 13:52:19.915139 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 15 13:52:19.915139 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 13:52:19.915139 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 15 13:52:19.915139 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 15 13:52:19.915139 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 15 13:52:19.915139 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 15 13:52:19.915139 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 15 13:52:19.915139 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 15 13:52:19.915139 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 15 13:52:19.915139 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 15 13:52:19.915139 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9de39d23-3a0f-466b-82ea-fe384248d2dd could not be found. Oct 15 13:52:19.915139 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Oct 15 13:52:19.915139 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 13:52:19.915139 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Oct 15 13:52:19.915139 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 13:52:19.915139 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 13:52:19.915139 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 13:52:19.915139 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 15 13:52:19.915139 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 15 13:52:19.915139 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 15 13:52:19.916368 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 15 13:52:19.916368 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 15 13:52:19.916368 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 15 13:52:19.916368 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 15 13:52:19.916368 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 15 13:52:19.916368 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 15 13:52:19.916368 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 15 13:52:19.916368 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9de39d23-3a0f-466b-82ea-fe384248d2dd could not be found. Oct 15 13:52:19.916368 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Oct 15 13:52:19.916368 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 13:52:19.916368 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Oct 15 13:52:19.916368 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 13:52:19.916368 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 13:52:19.916368 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 13:52:19.916368 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 15 13:52:19.916368 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 15 13:52:19.916368 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9de39d23-3a0f-466b-82ea-fe384248d2dd could not be found. Oct 15 13:52:19.916368 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Oct 15 13:52:19.917437 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-6c34b6e8-b733-4e5a-afb8-5a129ae73fe4 tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] Returning 404 to user: Instance 9de39d23-3a0f-466b-82ea-fe384248d2dd could not be found. {{(pid=125243) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 15 13:52:19.917437 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-6c34b6e8-b733-4e5a-afb8-5a129ae73fe4 tempest-VolumesNegativeTest-803597981 tempest-VolumesNegativeTest-803597981-project] 10.222.0.36 "GET /compute/v2.1/servers/9de39d23-3a0f-466b-82ea-fe384248d2dd" status: 404 len: 111 microversion: 2.1 time: 0.104526 Oct 15 13:52:19.922612 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 202/394] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:52:19 2022] GET /compute/v2.1/servers/9de39d23-3a0f-466b-82ea-fe384248d2dd => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 15 13:52:21.278314 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-46b25828-b069-4d3c-8b84-1e59835ec9e5 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1756457516", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-492113451", "security_groups": [{"name": "tempest-secgroup-smoke-27776347"}], "networks": [{"uuid": "5e76fb37-a025-4bec-9983-1f8b302b3a11"}], "block_device_mapping_v2": [{"uuid": "f0f1738a-6461-4bfd-ac16-d69c2d5f29b3", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 13:52:21.463807 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.network.neutron [None req-46b25828-b069-4d3c-8b84-1e59835ec9e5 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] validate_networks() for [('5e76fb37-a025-4bec-9983-1f8b302b3a11', None, None, None, None, None)] {{(pid=125242) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 15 13:52:22.527117 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.virt.hardware [None req-46b25828-b069-4d3c-8b84-1e59835ec9e5 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Flavor limits 0:0:0 {{(pid=125242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 15 13:52:22.528516 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.virt.hardware [None req-46b25828-b069-4d3c-8b84-1e59835ec9e5 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Image limits 0:0:0 {{(pid=125242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 15 13:52:22.528516 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.virt.hardware [None req-46b25828-b069-4d3c-8b84-1e59835ec9e5 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Flavor pref 0:0:0 {{(pid=125242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 15 13:52:22.528732 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.virt.hardware [None req-46b25828-b069-4d3c-8b84-1e59835ec9e5 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Image pref 0:0:0 {{(pid=125242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 15 13:52:22.529774 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.virt.hardware [None req-46b25828-b069-4d3c-8b84-1e59835ec9e5 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 15 13:52:22.543936 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-46b25828-b069-4d3c-8b84-1e59835ec9e5 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:22.544606 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-46b25828-b069-4d3c-8b84-1e59835ec9e5 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:22.545122 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-46b25828-b069-4d3c-8b84-1e59835ec9e5 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:22.546456 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-d3269d82-0fa7-4a5f-921e-3b9c45849f51 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 13:52:22.547189 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-46b25828-b069-4d3c-8b84-1e59835ec9e5 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:22.547684 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-46b25828-b069-4d3c-8b84-1e59835ec9e5 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:22.548210 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-d3269d82-0fa7-4a5f-921e-3b9c45849f51 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 5fc359cf-ff2c-4189-b058-31eb3c97568c] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:52:22.548448 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-46b25828-b069-4d3c-8b84-1e59835ec9e5 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:22.591324 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-d3269d82-0fa7-4a5f-921e-3b9c45849f51 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:22.595151 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-d3269d82-0fa7-4a5f-921e-3b9c45849f51 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:22.598065 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-d3269d82-0fa7-4a5f-921e-3b9c45849f51 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:22.599603 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-d3269d82-0fa7-4a5f-921e-3b9c45849f51 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:22.603060 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-d3269d82-0fa7-4a5f-921e-3b9c45849f51 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:22.604239 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-d3269d82-0fa7-4a5f-921e-3b9c45849f51 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:22.617650 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.quota [None req-46b25828-b069-4d3c-8b84-1e59835ec9e5 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Getting quotas for project 9a6be8e43c7742be84f4dc3c95a990e5. Resources: {'cores', 'ram', 'instances'} {{(pid=125242) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 15 13:52:22.631383 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.quota [None req-46b25828-b069-4d3c-8b84-1e59835ec9e5 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Getting quotas for user ed6e530c3f544748bd3ffc256b1630b6 and project 9a6be8e43c7742be84f4dc3c95a990e5. Resources: {'cores', 'ram', 'instances'} {{(pid=125242) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 15 13:52:22.667637 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.objects.instance [None req-d3269d82-0fa7-4a5f-921e-3b9c45849f51 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lazy-loading 'flavor' on Instance uuid 5fc359cf-ff2c-4189-b058-31eb3c97568c {{(pid=125243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 15 13:52:22.714929 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-46b25828-b069-4d3c-8b84-1e59835ec9e5 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Going to run 1 instances... {{(pid=125242) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 15 13:52:22.720992 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-46b25828-b069-4d3c-8b84-1e59835ec9e5 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] [instance: 1413aaed-46c7-4807-9d3b-957616dd4047] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f0f1738a-6461-4bfd-ac16-d69c2d5f29b3',volume_size=None,volume_type=None)] {{(pid=125242) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 15 13:52:23.034596 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-d3269d82-0fa7-4a5f-921e-3b9c45849f51 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "POST /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c/action" status: 202 len: 0 microversion: 2.20 time: 0.493622 Oct 15 13:52:23.036580 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 203/395] 10.222.0.36 () {62 vars in 1319 bytes} [Sat Oct 15 13:52:22 2022] POST /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c/action => generated 0 bytes in 497 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 15 13:52:23.049226 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-e2db0726-457a-463c-a170-c9e533046fc0 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:52:23.062665 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-e2db0726-457a-463c-a170-c9e533046fc0 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 5fc359cf-ff2c-4189-b058-31eb3c97568c] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:52:23.065870 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-46b25828-b069-4d3c-8b84-1e59835ec9e5 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.791626 Oct 15 13:52:23.075309 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 193/396] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 15 13:52:21 2022] POST /compute/v2.1/servers => generated 404 bytes in 1799 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 15 13:52:23.087744 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-b8d8e950-8fdd-4528-a1a1-1499462d563e tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:52:23.089899 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-e2db0726-457a-463c-a170-c9e533046fc0 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:23.095437 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-e2db0726-457a-463c-a170-c9e533046fc0 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:23.095757 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-b8d8e950-8fdd-4528-a1a1-1499462d563e tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] [instance: 1413aaed-46c7-4807-9d3b-957616dd4047] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:52:23.095952 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-e2db0726-457a-463c-a170-c9e533046fc0 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:23.096916 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-e2db0726-457a-463c-a170-c9e533046fc0 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:23.103117 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-e2db0726-457a-463c-a170-c9e533046fc0 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:23.106294 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-e2db0726-457a-463c-a170-c9e533046fc0 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:23.252388 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-b8d8e950-8fdd-4528-a1a1-1499462d563e tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e530c3f544748bd3ffc256b1630b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a6be8e43c7742be84f4dc3c95a990e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:52:23.261883 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-b8d8e950-8fdd-4528-a1a1-1499462d563e tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] 10.222.0.36 "GET /compute/v2.1/servers/1413aaed-46c7-4807-9d3b-957616dd4047" status: 200 len: 1088 microversion: 2.1 time: 0.182627 Oct 15 13:52:23.265835 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 194/397] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:52:23 2022] GET /compute/v2.1/servers/1413aaed-46c7-4807-9d3b-957616dd4047 => generated 1088 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:52:23.492944 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-e2db0726-457a-463c-a170-c9e533046fc0 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:52:23.508859 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-e2db0726-457a-463c-a170-c9e533046fc0 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:52:23.511824 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-e2db0726-457a-463c-a170-c9e533046fc0 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:52:23.513991 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-e2db0726-457a-463c-a170-c9e533046fc0 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c" status: 200 len: 1723 microversion: 2.20 time: 0.471394 Oct 15 13:52:23.515312 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 204/398] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:52:23 2022] GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c => generated 1723 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 13:52:24.296687 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-ff1db512-3741-4d81-b3c7-0d30adbc4b02 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:52:24.300040 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-ff1db512-3741-4d81-b3c7-0d30adbc4b02 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] [instance: 1413aaed-46c7-4807-9d3b-957616dd4047] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:52:24.327221 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-ff1db512-3741-4d81-b3c7-0d30adbc4b02 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:24.328267 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-ff1db512-3741-4d81-b3c7-0d30adbc4b02 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:24.329056 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-ff1db512-3741-4d81-b3c7-0d30adbc4b02 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:24.330341 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-ff1db512-3741-4d81-b3c7-0d30adbc4b02 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:24.331176 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-ff1db512-3741-4d81-b3c7-0d30adbc4b02 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:24.334364 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-ff1db512-3741-4d81-b3c7-0d30adbc4b02 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:24.489372 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-ff1db512-3741-4d81-b3c7-0d30adbc4b02 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e530c3f544748bd3ffc256b1630b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a6be8e43c7742be84f4dc3c95a990e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:52:24.513180 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-ff1db512-3741-4d81-b3c7-0d30adbc4b02 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] 10.222.0.36 "GET /compute/v2.1/servers/1413aaed-46c7-4807-9d3b-957616dd4047" status: 200 len: 1138 microversion: 2.1 time: 0.224242 Oct 15 13:52:24.518304 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 195/399] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:52:24 2022] GET /compute/v2.1/servers/1413aaed-46c7-4807-9d3b-957616dd4047 => generated 1138 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:52:24.547681 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-831769e3-4916-457b-bc1c-5d81d29784ee tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:52:24.548350 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-831769e3-4916-457b-bc1c-5d81d29784ee tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 5fc359cf-ff2c-4189-b058-31eb3c97568c] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:52:24.562318 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-831769e3-4916-457b-bc1c-5d81d29784ee tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:24.566091 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-831769e3-4916-457b-bc1c-5d81d29784ee tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:24.566545 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-831769e3-4916-457b-bc1c-5d81d29784ee tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:24.567297 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-831769e3-4916-457b-bc1c-5d81d29784ee tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:24.567771 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-831769e3-4916-457b-bc1c-5d81d29784ee tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:24.568221 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-831769e3-4916-457b-bc1c-5d81d29784ee tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:24.845119 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-831769e3-4916-457b-bc1c-5d81d29784ee tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:52:24.884755 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-831769e3-4916-457b-bc1c-5d81d29784ee tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:52:24.886416 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-831769e3-4916-457b-bc1c-5d81d29784ee tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:52:24.888373 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-831769e3-4916-457b-bc1c-5d81d29784ee tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c" status: 200 len: 1723 microversion: 2.20 time: 0.344941 Oct 15 13:52:24.910743 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 205/400] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:52:24 2022] GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c => generated 1723 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 13:52:25.570177 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-39d8cab4-f82e-4f4a-8cc6-f5d23762eed9 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:52:25.575953 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-39d8cab4-f82e-4f4a-8cc6-f5d23762eed9 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] [instance: 1413aaed-46c7-4807-9d3b-957616dd4047] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:52:25.591925 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-39d8cab4-f82e-4f4a-8cc6-f5d23762eed9 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:25.601528 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-39d8cab4-f82e-4f4a-8cc6-f5d23762eed9 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:25.601528 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-39d8cab4-f82e-4f4a-8cc6-f5d23762eed9 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:25.601528 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-39d8cab4-f82e-4f4a-8cc6-f5d23762eed9 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:25.601528 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-39d8cab4-f82e-4f4a-8cc6-f5d23762eed9 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:25.602291 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-39d8cab4-f82e-4f4a-8cc6-f5d23762eed9 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:25.737292 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-39d8cab4-f82e-4f4a-8cc6-f5d23762eed9 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e530c3f544748bd3ffc256b1630b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a6be8e43c7742be84f4dc3c95a990e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:52:25.751230 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-39d8cab4-f82e-4f4a-8cc6-f5d23762eed9 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] 10.222.0.36 "GET /compute/v2.1/servers/1413aaed-46c7-4807-9d3b-957616dd4047" status: 200 len: 1138 microversion: 2.1 time: 0.203998 Oct 15 13:52:25.754643 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 196/401] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:52:25 2022] GET /compute/v2.1/servers/1413aaed-46c7-4807-9d3b-957616dd4047 => generated 1138 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:52:25.929082 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-1a0b875f-ab4b-4d13-aba5-d6272f9658fc tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:52:25.930698 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-1a0b875f-ab4b-4d13-aba5-d6272f9658fc tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 5fc359cf-ff2c-4189-b058-31eb3c97568c] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:52:25.949724 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-1a0b875f-ab4b-4d13-aba5-d6272f9658fc tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:25.951844 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-1a0b875f-ab4b-4d13-aba5-d6272f9658fc tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:25.954171 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-1a0b875f-ab4b-4d13-aba5-d6272f9658fc tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:25.958471 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-1a0b875f-ab4b-4d13-aba5-d6272f9658fc tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:25.961040 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-1a0b875f-ab4b-4d13-aba5-d6272f9658fc tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:25.961667 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-1a0b875f-ab4b-4d13-aba5-d6272f9658fc tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:26.253903 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-1a0b875f-ab4b-4d13-aba5-d6272f9658fc tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:52:26.274129 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-1a0b875f-ab4b-4d13-aba5-d6272f9658fc tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:52:26.284246 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-1a0b875f-ab4b-4d13-aba5-d6272f9658fc tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:52:26.286967 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-1a0b875f-ab4b-4d13-aba5-d6272f9658fc tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c" status: 200 len: 1723 microversion: 2.20 time: 0.367783 Oct 15 13:52:26.303279 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 206/402] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:52:25 2022] GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c => generated 1723 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 13:52:26.780515 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-d536703b-45c9-4587-9d31-f2130c5793d3 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:52:26.784883 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-d536703b-45c9-4587-9d31-f2130c5793d3 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] [instance: 1413aaed-46c7-4807-9d3b-957616dd4047] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:52:26.809349 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-d536703b-45c9-4587-9d31-f2130c5793d3 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:26.813412 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-d536703b-45c9-4587-9d31-f2130c5793d3 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:26.814576 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-d536703b-45c9-4587-9d31-f2130c5793d3 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:26.818885 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-d536703b-45c9-4587-9d31-f2130c5793d3 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:26.822802 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-d536703b-45c9-4587-9d31-f2130c5793d3 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:26.824128 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-d536703b-45c9-4587-9d31-f2130c5793d3 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:26.958723 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-d536703b-45c9-4587-9d31-f2130c5793d3 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e530c3f544748bd3ffc256b1630b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a6be8e43c7742be84f4dc3c95a990e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:52:26.970738 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-d536703b-45c9-4587-9d31-f2130c5793d3 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] 10.222.0.36 "GET /compute/v2.1/servers/1413aaed-46c7-4807-9d3b-957616dd4047" status: 200 len: 1138 microversion: 2.1 time: 0.198632 Oct 15 13:52:26.971758 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 197/403] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:52:26 2022] GET /compute/v2.1/servers/1413aaed-46c7-4807-9d3b-957616dd4047 => generated 1138 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:52:27.335240 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-7bc80d5c-83c0-4493-b79f-79168608e5cf tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:52:27.336727 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-7bc80d5c-83c0-4493-b79f-79168608e5cf tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 5fc359cf-ff2c-4189-b058-31eb3c97568c] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:52:27.348132 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-7bc80d5c-83c0-4493-b79f-79168608e5cf tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:27.348844 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-7bc80d5c-83c0-4493-b79f-79168608e5cf tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:27.349524 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-7bc80d5c-83c0-4493-b79f-79168608e5cf tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:27.350430 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-7bc80d5c-83c0-4493-b79f-79168608e5cf tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:27.351045 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-7bc80d5c-83c0-4493-b79f-79168608e5cf tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:27.351623 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-7bc80d5c-83c0-4493-b79f-79168608e5cf tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:27.564813 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-7bc80d5c-83c0-4493-b79f-79168608e5cf tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:52:27.583710 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-7bc80d5c-83c0-4493-b79f-79168608e5cf tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:52:27.589116 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-7bc80d5c-83c0-4493-b79f-79168608e5cf tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:52:27.590390 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-7bc80d5c-83c0-4493-b79f-79168608e5cf tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c" status: 200 len: 1723 microversion: 2.20 time: 0.259389 Oct 15 13:52:27.590959 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 207/404] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:52:27 2022] GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c => generated 1723 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 13:52:28.003442 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-c3d26286-89a2-4935-9ede-95bb30a6b64e tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:52:28.004951 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-c3d26286-89a2-4935-9ede-95bb30a6b64e tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] [instance: 1413aaed-46c7-4807-9d3b-957616dd4047] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:52:28.018856 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-c3d26286-89a2-4935-9ede-95bb30a6b64e tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:28.019996 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-c3d26286-89a2-4935-9ede-95bb30a6b64e tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:28.023122 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-c3d26286-89a2-4935-9ede-95bb30a6b64e tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:28.025784 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-c3d26286-89a2-4935-9ede-95bb30a6b64e tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:28.028111 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-c3d26286-89a2-4935-9ede-95bb30a6b64e tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:28.031712 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-c3d26286-89a2-4935-9ede-95bb30a6b64e tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:28.132697 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-c3d26286-89a2-4935-9ede-95bb30a6b64e tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e530c3f544748bd3ffc256b1630b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a6be8e43c7742be84f4dc3c95a990e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:52:28.152710 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-c3d26286-89a2-4935-9ede-95bb30a6b64e tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] 10.222.0.36 "GET /compute/v2.1/servers/1413aaed-46c7-4807-9d3b-957616dd4047" status: 200 len: 1138 microversion: 2.1 time: 0.153675 Oct 15 13:52:28.156521 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 198/405] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:52:27 2022] GET /compute/v2.1/servers/1413aaed-46c7-4807-9d3b-957616dd4047 => generated 1138 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:52:28.639643 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-334cdf5b-9adc-47be-8c5a-41d3feefb377 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:52:28.650900 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-334cdf5b-9adc-47be-8c5a-41d3feefb377 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 5fc359cf-ff2c-4189-b058-31eb3c97568c] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:52:28.666346 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-334cdf5b-9adc-47be-8c5a-41d3feefb377 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:28.672646 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-334cdf5b-9adc-47be-8c5a-41d3feefb377 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:28.673736 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-334cdf5b-9adc-47be-8c5a-41d3feefb377 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:28.676528 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-334cdf5b-9adc-47be-8c5a-41d3feefb377 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:28.677616 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-334cdf5b-9adc-47be-8c5a-41d3feefb377 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:28.680663 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-334cdf5b-9adc-47be-8c5a-41d3feefb377 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:28.964359 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-334cdf5b-9adc-47be-8c5a-41d3feefb377 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:52:28.980779 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-334cdf5b-9adc-47be-8c5a-41d3feefb377 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:52:28.982567 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-334cdf5b-9adc-47be-8c5a-41d3feefb377 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:52:28.984150 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-334cdf5b-9adc-47be-8c5a-41d3feefb377 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c" status: 200 len: 1723 microversion: 2.20 time: 0.349027 Oct 15 13:52:28.985694 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 208/406] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:52:28 2022] GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c => generated 1723 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 15 13:52:29.183401 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-856cacc4-8f6e-4dbf-a040-6232276145d2 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:52:29.184693 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-856cacc4-8f6e-4dbf-a040-6232276145d2 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] [instance: 1413aaed-46c7-4807-9d3b-957616dd4047] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:52:29.194742 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-856cacc4-8f6e-4dbf-a040-6232276145d2 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:29.195562 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-856cacc4-8f6e-4dbf-a040-6232276145d2 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:29.196262 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-856cacc4-8f6e-4dbf-a040-6232276145d2 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:29.197193 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-856cacc4-8f6e-4dbf-a040-6232276145d2 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:29.197822 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-856cacc4-8f6e-4dbf-a040-6232276145d2 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:29.198430 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-856cacc4-8f6e-4dbf-a040-6232276145d2 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:29.331334 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-856cacc4-8f6e-4dbf-a040-6232276145d2 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e530c3f544748bd3ffc256b1630b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a6be8e43c7742be84f4dc3c95a990e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:52:29.344324 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-856cacc4-8f6e-4dbf-a040-6232276145d2 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] 10.222.0.36 "GET /compute/v2.1/servers/1413aaed-46c7-4807-9d3b-957616dd4047" status: 200 len: 1138 microversion: 2.1 time: 0.163978 Oct 15 13:52:29.345801 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 199/407] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:52:29 2022] GET /compute/v2.1/servers/1413aaed-46c7-4807-9d3b-957616dd4047 => generated 1138 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:52:30.019418 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-8ea27580-1f6b-48c9-90cc-941d27c17914 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:52:30.020066 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-8ea27580-1f6b-48c9-90cc-941d27c17914 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 5fc359cf-ff2c-4189-b058-31eb3c97568c] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:52:30.027602 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-8ea27580-1f6b-48c9-90cc-941d27c17914 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:30.028041 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-8ea27580-1f6b-48c9-90cc-941d27c17914 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:30.028482 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-8ea27580-1f6b-48c9-90cc-941d27c17914 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:30.029337 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-8ea27580-1f6b-48c9-90cc-941d27c17914 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:30.029964 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-8ea27580-1f6b-48c9-90cc-941d27c17914 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:30.030533 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-8ea27580-1f6b-48c9-90cc-941d27c17914 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:30.203301 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-8ea27580-1f6b-48c9-90cc-941d27c17914 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:52:30.213448 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-8ea27580-1f6b-48c9-90cc-941d27c17914 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:52:30.215558 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-8ea27580-1f6b-48c9-90cc-941d27c17914 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:52:30.217277 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-8ea27580-1f6b-48c9-90cc-941d27c17914 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c" status: 200 len: 1723 microversion: 2.20 time: 0.202220 Oct 15 13:52:30.217976 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 209/408] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:52:30 2022] GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c => generated 1723 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 13:52:30.372076 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-d1725ee2-28e4-4a8a-86c1-6506b4fb1a7d tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:52:30.374396 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-d1725ee2-28e4-4a8a-86c1-6506b4fb1a7d tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] [instance: 1413aaed-46c7-4807-9d3b-957616dd4047] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:52:30.385544 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-d1725ee2-28e4-4a8a-86c1-6506b4fb1a7d tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:30.387015 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-d1725ee2-28e4-4a8a-86c1-6506b4fb1a7d tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:30.388616 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-d1725ee2-28e4-4a8a-86c1-6506b4fb1a7d tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:30.390882 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-d1725ee2-28e4-4a8a-86c1-6506b4fb1a7d tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:30.392433 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-d1725ee2-28e4-4a8a-86c1-6506b4fb1a7d tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:30.393222 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-d1725ee2-28e4-4a8a-86c1-6506b4fb1a7d tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:30.472243 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-d1725ee2-28e4-4a8a-86c1-6506b4fb1a7d tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e530c3f544748bd3ffc256b1630b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a6be8e43c7742be84f4dc3c95a990e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:52:30.481960 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-d1725ee2-28e4-4a8a-86c1-6506b4fb1a7d tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] 10.222.0.36 "GET /compute/v2.1/servers/1413aaed-46c7-4807-9d3b-957616dd4047" status: 200 len: 1138 microversion: 2.1 time: 0.115795 Oct 15 13:52:30.482777 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 200/409] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:52:30 2022] GET /compute/v2.1/servers/1413aaed-46c7-4807-9d3b-957616dd4047 => generated 1138 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:52:31.242753 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-3d9641b6-a1d7-4fe0-be36-ba9ae88c8972 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:52:31.243378 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-3d9641b6-a1d7-4fe0-be36-ba9ae88c8972 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 5fc359cf-ff2c-4189-b058-31eb3c97568c] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:52:31.250552 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-3d9641b6-a1d7-4fe0-be36-ba9ae88c8972 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:31.251043 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-3d9641b6-a1d7-4fe0-be36-ba9ae88c8972 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:31.251478 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-3d9641b6-a1d7-4fe0-be36-ba9ae88c8972 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:31.253776 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-3d9641b6-a1d7-4fe0-be36-ba9ae88c8972 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:31.254226 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-3d9641b6-a1d7-4fe0-be36-ba9ae88c8972 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:31.254848 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-3d9641b6-a1d7-4fe0-be36-ba9ae88c8972 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:31.435954 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-3d9641b6-a1d7-4fe0-be36-ba9ae88c8972 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:52:31.451770 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-3d9641b6-a1d7-4fe0-be36-ba9ae88c8972 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:52:31.453720 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-3d9641b6-a1d7-4fe0-be36-ba9ae88c8972 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:52:31.455333 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-3d9641b6-a1d7-4fe0-be36-ba9ae88c8972 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c" status: 200 len: 1723 microversion: 2.20 time: 0.216564 Oct 15 13:52:31.456129 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 210/410] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:52:31 2022] GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c => generated 1723 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 13:52:31.504952 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-ad42e219-5c6d-4658-b4ea-7382ef92b2c8 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:52:31.505899 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-ad42e219-5c6d-4658-b4ea-7382ef92b2c8 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] [instance: 1413aaed-46c7-4807-9d3b-957616dd4047] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:52:31.517297 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-ad42e219-5c6d-4658-b4ea-7382ef92b2c8 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:31.527861 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-ad42e219-5c6d-4658-b4ea-7382ef92b2c8 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:31.528471 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-ad42e219-5c6d-4658-b4ea-7382ef92b2c8 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:31.535981 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-ad42e219-5c6d-4658-b4ea-7382ef92b2c8 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:31.536573 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-ad42e219-5c6d-4658-b4ea-7382ef92b2c8 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:31.537164 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-ad42e219-5c6d-4658-b4ea-7382ef92b2c8 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:31.653220 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-ad42e219-5c6d-4658-b4ea-7382ef92b2c8 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e530c3f544748bd3ffc256b1630b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a6be8e43c7742be84f4dc3c95a990e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:52:31.672835 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-ad42e219-5c6d-4658-b4ea-7382ef92b2c8 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] 10.222.0.36 "GET /compute/v2.1/servers/1413aaed-46c7-4807-9d3b-957616dd4047" status: 200 len: 1186 microversion: 2.1 time: 0.171634 Oct 15 13:52:31.684614 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 201/411] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:52:31 2022] GET /compute/v2.1/servers/1413aaed-46c7-4807-9d3b-957616dd4047 => generated 1186 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:52:32.122047 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-72c58207-7267-4338-8b71-f3f15608bd3d tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 13:52:32.128726 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-72c58207-7267-4338-8b71-f3f15608bd3d tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:32.129473 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-72c58207-7267-4338-8b71-f3f15608bd3d tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:32.130077 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-72c58207-7267-4338-8b71-f3f15608bd3d tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:32.199228 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-72c58207-7267-4338-8b71-f3f15608bd3d tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] [instance: 40d67d09-379e-4c12-b36c-21edf3b23e45] Going to try to stop instance {{(pid=125243) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 15 13:52:32.311013 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-72c58207-7267-4338-8b71-f3f15608bd3d tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] 10.222.0.36 "POST /compute/v2.1/servers/40d67d09-379e-4c12-b36c-21edf3b23e45/action" status: 202 len: 0 microversion: 2.1 time: 0.192633 Oct 15 13:52:32.322288 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 211/412] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 15 13:52:32 2022] POST /compute/v2.1/servers/40d67d09-379e-4c12-b36c-21edf3b23e45/action => generated 0 bytes in 202 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 15 13:52:32.328837 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-a75fbbd7-6f12-49ef-9f3b-8ef856aa8fcb tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:52:32.329614 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-a75fbbd7-6f12-49ef-9f3b-8ef856aa8fcb tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] [instance: 40d67d09-379e-4c12-b36c-21edf3b23e45] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:52:32.344878 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-a75fbbd7-6f12-49ef-9f3b-8ef856aa8fcb tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:32.345743 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-a75fbbd7-6f12-49ef-9f3b-8ef856aa8fcb tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:32.348016 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-a75fbbd7-6f12-49ef-9f3b-8ef856aa8fcb tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:32.350772 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-a75fbbd7-6f12-49ef-9f3b-8ef856aa8fcb tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:32.354026 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-a75fbbd7-6f12-49ef-9f3b-8ef856aa8fcb tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:32.356854 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-a75fbbd7-6f12-49ef-9f3b-8ef856aa8fcb tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:32.486208 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-e504b2fc-153b-48e3-be93-8e0c7927acf2 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:52:32.487306 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-e504b2fc-153b-48e3-be93-8e0c7927acf2 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 5fc359cf-ff2c-4189-b058-31eb3c97568c] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:52:32.497636 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-e504b2fc-153b-48e3-be93-8e0c7927acf2 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:32.499395 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-e504b2fc-153b-48e3-be93-8e0c7927acf2 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:32.500023 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-e504b2fc-153b-48e3-be93-8e0c7927acf2 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:32.504224 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-e504b2fc-153b-48e3-be93-8e0c7927acf2 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:32.504868 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-e504b2fc-153b-48e3-be93-8e0c7927acf2 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:32.505412 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-e504b2fc-153b-48e3-be93-8e0c7927acf2 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:32.580220 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG dbcounter [-] [125242] Writing DB stats nova_cell0:SELECT=2 {{(pid=125242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:52:32.957182 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-a75fbbd7-6f12-49ef-9f3b-8ef856aa8fcb tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583cce1547144e11978f20a3193ceba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f8b5024a194f70a9f7689ac44ab07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:52:32.965732 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG dbcounter [-] [125242] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:52:32.966865 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-e504b2fc-153b-48e3-be93-8e0c7927acf2 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:52:32.973311 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-a75fbbd7-6f12-49ef-9f3b-8ef856aa8fcb tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] 10.222.0.36 "GET /compute/v2.1/servers/40d67d09-379e-4c12-b36c-21edf3b23e45" status: 200 len: 1725 microversion: 2.1 time: 0.649439 Oct 15 13:52:32.974272 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 202/413] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:52:32 2022] GET /compute/v2.1/servers/40d67d09-379e-4c12-b36c-21edf3b23e45 => generated 1725 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:52:32.980312 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-7bf12ad7-06ba-48e4-9a07-f9623ea097d8 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:52:32.981146 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-7bf12ad7-06ba-48e4-9a07-f9623ea097d8 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] [instance: 1413aaed-46c7-4807-9d3b-957616dd4047] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:52:32.981807 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-e504b2fc-153b-48e3-be93-8e0c7927acf2 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:52:32.983249 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-e504b2fc-153b-48e3-be93-8e0c7927acf2 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:52:32.984911 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-e504b2fc-153b-48e3-be93-8e0c7927acf2 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c" status: 200 len: 1723 microversion: 2.20 time: 0.503624 Oct 15 13:52:32.988530 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 212/414] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:52:32 2022] GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c => generated 1723 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 15 13:52:33.002740 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-7bf12ad7-06ba-48e4-9a07-f9623ea097d8 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:33.003444 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-7bf12ad7-06ba-48e4-9a07-f9623ea097d8 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:33.004136 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-7bf12ad7-06ba-48e4-9a07-f9623ea097d8 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:33.005101 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-7bf12ad7-06ba-48e4-9a07-f9623ea097d8 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:33.005727 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-7bf12ad7-06ba-48e4-9a07-f9623ea097d8 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:33.006309 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-7bf12ad7-06ba-48e4-9a07-f9623ea097d8 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:33.096961 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-7bf12ad7-06ba-48e4-9a07-f9623ea097d8 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e530c3f544748bd3ffc256b1630b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a6be8e43c7742be84f4dc3c95a990e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:52:33.105480 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-7bf12ad7-06ba-48e4-9a07-f9623ea097d8 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] 10.222.0.36 "GET /compute/v2.1/servers/1413aaed-46c7-4807-9d3b-957616dd4047" status: 200 len: 1204 microversion: 2.1 time: 0.130024 Oct 15 13:52:33.106647 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 203/415] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:52:32 2022] GET /compute/v2.1/servers/1413aaed-46c7-4807-9d3b-957616dd4047 => generated 1204 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:52:33.999621 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-683a04c0-6d14-4298-a353-b5152b365389 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:52:34.001045 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-683a04c0-6d14-4298-a353-b5152b365389 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] [instance: 40d67d09-379e-4c12-b36c-21edf3b23e45] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:52:34.009307 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG dbcounter [-] [125242] Writing DB stats nova_cell0:SELECT=8 {{(pid=125242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:52:34.014031 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-683a04c0-6d14-4298-a353-b5152b365389 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:34.014285 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-46e18196-d7ee-4649-8ce8-235dd2cd94cf tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:52:34.014656 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-46e18196-d7ee-4649-8ce8-235dd2cd94cf tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 5fc359cf-ff2c-4189-b058-31eb3c97568c] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:52:34.014958 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-683a04c0-6d14-4298-a353-b5152b365389 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:34.018427 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-683a04c0-6d14-4298-a353-b5152b365389 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:34.021020 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-683a04c0-6d14-4298-a353-b5152b365389 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:34.022189 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-683a04c0-6d14-4298-a353-b5152b365389 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:34.022830 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-683a04c0-6d14-4298-a353-b5152b365389 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:34.030871 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-46e18196-d7ee-4649-8ce8-235dd2cd94cf tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:34.031371 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-46e18196-d7ee-4649-8ce8-235dd2cd94cf tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:34.037203 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-46e18196-d7ee-4649-8ce8-235dd2cd94cf tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:34.038383 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-46e18196-d7ee-4649-8ce8-235dd2cd94cf tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:34.038874 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-46e18196-d7ee-4649-8ce8-235dd2cd94cf tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:34.039319 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-46e18196-d7ee-4649-8ce8-235dd2cd94cf tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:34.372829 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-46e18196-d7ee-4649-8ce8-235dd2cd94cf tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:52:34.385718 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-46e18196-d7ee-4649-8ce8-235dd2cd94cf tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:52:34.388037 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-46e18196-d7ee-4649-8ce8-235dd2cd94cf tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:52:34.389537 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-46e18196-d7ee-4649-8ce8-235dd2cd94cf tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c" status: 200 len: 1723 microversion: 2.20 time: 0.380945 Oct 15 13:52:34.403960 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-683a04c0-6d14-4298-a353-b5152b365389 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583cce1547144e11978f20a3193ceba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f8b5024a194f70a9f7689ac44ab07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:52:34.404816 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 204/416] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:52:34 2022] GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c => generated 1723 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 15 13:52:34.411160 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-683a04c0-6d14-4298-a353-b5152b365389 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] 10.222.0.36 "GET /compute/v2.1/servers/40d67d09-379e-4c12-b36c-21edf3b23e45" status: 200 len: 1725 microversion: 2.1 time: 0.416209 Oct 15 13:52:34.412133 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 213/417] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:52:33 2022] GET /compute/v2.1/servers/40d67d09-379e-4c12-b36c-21edf3b23e45 => generated 1725 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:52:34.416034 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-02775136-0c7e-4457-8107-306d6224922d tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:52:34.417516 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-02775136-0c7e-4457-8107-306d6224922d tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] [instance: 1413aaed-46c7-4807-9d3b-957616dd4047] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:52:34.430343 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-02775136-0c7e-4457-8107-306d6224922d tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:34.430843 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-02775136-0c7e-4457-8107-306d6224922d tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:34.431283 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-02775136-0c7e-4457-8107-306d6224922d tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:34.432033 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-02775136-0c7e-4457-8107-306d6224922d tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:34.432665 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-02775136-0c7e-4457-8107-306d6224922d tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:34.433245 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-02775136-0c7e-4457-8107-306d6224922d tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:34.572046 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-f699b0c9-353f-42be-8d6b-a3d4aeb3b569 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Action: 'create', calling method: .version_select at 0x7f1b5e3c95e0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1750106181", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH3jCO42uiOTK66P+Aw9NAvOQJ5kx8Fy461/L4/aMonJzBiGs6tOeZLZCa4OINGKdEekZnGi4zONrWxGhbqAInmQdKu+ZaarOMTFGSJ7PDsQIn6MEJ0TL90DDoRdevmhtQ=="}} {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 13:52:34.590506 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.quota [None req-f699b0c9-353f-42be-8d6b-a3d4aeb3b569 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Getting quotas for project e752c3aef55649ea98ec1a2f3607c27f. Resources: {'key_pairs'} {{(pid=125243) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 15 13:52:34.595025 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.quota [None req-f699b0c9-353f-42be-8d6b-a3d4aeb3b569 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Getting quotas for user dc83c1c8fce04c57a685de883344b7e6 and project e752c3aef55649ea98ec1a2f3607c27f. Resources: {'key_pairs'} {{(pid=125243) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 15 13:52:34.621900 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-f699b0c9-353f-42be-8d6b-a3d4aeb3b569 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.058555 Oct 15 13:52:34.622669 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 214/418] 10.222.0.36 () {60 vars in 1159 bytes} [Sat Oct 15 13:52:34 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 15 13:52:34.692410 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-02775136-0c7e-4457-8107-306d6224922d tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e530c3f544748bd3ffc256b1630b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a6be8e43c7742be84f4dc3c95a990e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:52:34.704643 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-02775136-0c7e-4457-8107-306d6224922d tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] 10.222.0.36 "GET /compute/v2.1/servers/1413aaed-46c7-4807-9d3b-957616dd4047" status: 200 len: 1258 microversion: 2.1 time: 0.298369 Oct 15 13:52:34.705898 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 205/419] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:52:34 2022] GET /compute/v2.1/servers/1413aaed-46c7-4807-9d3b-957616dd4047 => generated 1258 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:52:34.746763 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-a158b6e6-27fa-4b0b-9a7a-f3ad55473cf3 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-956075691", "imageRef": "f6acce37-276e-458b-915a-fff2aac5bc7f", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1750106181", "networks": [{"uuid": "02894865-e41a-4eca-94c3-b634ad12d3f8"}]}} {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 13:52:34.809300 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.network.neutron [None req-a158b6e6-27fa-4b0b-9a7a-f3ad55473cf3 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] validate_networks() for [('02894865-e41a-4eca-94c3-b634ad12d3f8', None, None, None, None, None)] {{(pid=125243) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 15 13:52:35.035919 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [req-abccff74-7a82-4129-9ba7-49710d81b096 req-7f9e84b4-34b1-4a6e-bd1e-c036bad0d2c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1413aaed-46c7-4807-9d3b-957616dd4047", "tag": "4b0e8bf4-1aae-4e0a-be03-f2d19fe48439"}]} {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 13:52:35.062982 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [req-abccff74-7a82-4129-9ba7-49710d81b096 req-7f9e84b4-34b1-4a6e-bd1e-c036bad0d2c8 service nova] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:35.063192 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [req-abccff74-7a82-4129-9ba7-49710d81b096 req-7f9e84b4-34b1-4a6e-bd1e-c036bad0d2c8 service nova] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:35.063539 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [req-abccff74-7a82-4129-9ba7-49710d81b096 req-7f9e84b4-34b1-4a6e-bd1e-c036bad0d2c8 service nova] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:35.081194 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.compute.server_external_events [req-abccff74-7a82-4129-9ba7-49710d81b096 req-7f9e84b4-34b1-4a6e-bd1e-c036bad0d2c8 service nova] Creating event network-changed:4b0e8bf4-1aae-4e0a-be03-f2d19fe48439 for instance 1413aaed-46c7-4807-9d3b-957616dd4047 on hv-cinder-86149 Oct 15 13:52:35.086852 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [req-abccff74-7a82-4129-9ba7-49710d81b096 req-7f9e84b4-34b1-4a6e-bd1e-c036bad0d2c8 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054624 Oct 15 13:52:35.087859 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 206/420] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 15 13:52:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 15 13:52:35.419191 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-2c71ef70-e3a7-4b36-ac3a-fc9bacd820d0 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:52:35.419924 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-2c71ef70-e3a7-4b36-ac3a-fc9bacd820d0 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 5fc359cf-ff2c-4189-b058-31eb3c97568c] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:52:35.427212 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-2c71ef70-e3a7-4b36-ac3a-fc9bacd820d0 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:35.427715 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-2c71ef70-e3a7-4b36-ac3a-fc9bacd820d0 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:35.428176 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-2c71ef70-e3a7-4b36-ac3a-fc9bacd820d0 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:35.429712 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-2c71ef70-e3a7-4b36-ac3a-fc9bacd820d0 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:35.430200 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-2c71ef70-e3a7-4b36-ac3a-fc9bacd820d0 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:35.430954 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-2c71ef70-e3a7-4b36-ac3a-fc9bacd820d0 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:35.762232 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-2c71ef70-e3a7-4b36-ac3a-fc9bacd820d0 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:52:35.777959 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-2c71ef70-e3a7-4b36-ac3a-fc9bacd820d0 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:52:35.779955 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-2c71ef70-e3a7-4b36-ac3a-fc9bacd820d0 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:52:35.781481 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-2c71ef70-e3a7-4b36-ac3a-fc9bacd820d0 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c" status: 200 len: 1723 microversion: 2.20 time: 0.366765 Oct 15 13:52:35.782045 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 207/421] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:52:35 2022] GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c => generated 1723 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 13:52:35.787748 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-caebc565-48db-495a-b8c1-0f46b2d1d058 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:52:35.788629 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-caebc565-48db-495a-b8c1-0f46b2d1d058 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] [instance: 40d67d09-379e-4c12-b36c-21edf3b23e45] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:52:35.797854 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-caebc565-48db-495a-b8c1-0f46b2d1d058 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:35.798668 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-caebc565-48db-495a-b8c1-0f46b2d1d058 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:35.799620 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-caebc565-48db-495a-b8c1-0f46b2d1d058 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:35.802705 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-caebc565-48db-495a-b8c1-0f46b2d1d058 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:35.803450 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-caebc565-48db-495a-b8c1-0f46b2d1d058 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:35.804554 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-caebc565-48db-495a-b8c1-0f46b2d1d058 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:35.942847 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.virt.hardware [None req-a158b6e6-27fa-4b0b-9a7a-f3ad55473cf3 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Flavor limits 0:0:0 {{(pid=125243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 15 13:52:35.943302 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.virt.hardware [None req-a158b6e6-27fa-4b0b-9a7a-f3ad55473cf3 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Image limits 0:0:0 {{(pid=125243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 15 13:52:35.943781 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.virt.hardware [None req-a158b6e6-27fa-4b0b-9a7a-f3ad55473cf3 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Flavor pref 0:0:0 {{(pid=125243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 15 13:52:35.944416 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.virt.hardware [None req-a158b6e6-27fa-4b0b-9a7a-f3ad55473cf3 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Image pref 0:0:0 {{(pid=125243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 15 13:52:35.944816 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.virt.hardware [None req-a158b6e6-27fa-4b0b-9a7a-f3ad55473cf3 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 15 13:52:35.965637 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-a158b6e6-27fa-4b0b-9a7a-f3ad55473cf3 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:35.966265 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-a158b6e6-27fa-4b0b-9a7a-f3ad55473cf3 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:35.967210 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-a158b6e6-27fa-4b0b-9a7a-f3ad55473cf3 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:35.968214 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-a158b6e6-27fa-4b0b-9a7a-f3ad55473cf3 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:35.968817 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-a158b6e6-27fa-4b0b-9a7a-f3ad55473cf3 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:35.969424 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-a158b6e6-27fa-4b0b-9a7a-f3ad55473cf3 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:35.995308 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.quota [None req-a158b6e6-27fa-4b0b-9a7a-f3ad55473cf3 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Getting quotas for project e752c3aef55649ea98ec1a2f3607c27f. Resources: {'cores', 'ram', 'instances'} {{(pid=125243) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 15 13:52:36.005693 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.quota [None req-a158b6e6-27fa-4b0b-9a7a-f3ad55473cf3 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Getting quotas for user dc83c1c8fce04c57a685de883344b7e6 and project e752c3aef55649ea98ec1a2f3607c27f. Resources: {'cores', 'ram', 'instances'} {{(pid=125243) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 15 13:52:36.019477 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-a158b6e6-27fa-4b0b-9a7a-f3ad55473cf3 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Going to run 1 instances... {{(pid=125243) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 15 13:52:36.021809 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-a158b6e6-27fa-4b0b-9a7a-f3ad55473cf3 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] [instance: 6490290c-19e1-49db-9190-3b945ece5145] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f6acce37-276e-458b-915a-fff2aac5bc7f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125243) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 15 13:52:36.064477 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-caebc565-48db-495a-b8c1-0f46b2d1d058 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583cce1547144e11978f20a3193ceba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f8b5024a194f70a9f7689ac44ab07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:52:36.074866 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-caebc565-48db-495a-b8c1-0f46b2d1d058 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] 10.222.0.36 "GET /compute/v2.1/servers/40d67d09-379e-4c12-b36c-21edf3b23e45" status: 200 len: 1725 microversion: 2.1 time: 0.291503 Oct 15 13:52:36.075837 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 208/422] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:52:35 2022] GET /compute/v2.1/servers/40d67d09-379e-4c12-b36c-21edf3b23e45 => generated 1725 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:52:36.081052 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-2166f0e4-d44c-4511-9b4c-130048e8d41d tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:52:36.081759 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-2166f0e4-d44c-4511-9b4c-130048e8d41d tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] [instance: 1413aaed-46c7-4807-9d3b-957616dd4047] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:52:36.096015 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-a158b6e6-27fa-4b0b-9a7a-f3ad55473cf3 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.352634 Oct 15 13:52:36.103839 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 215/423] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 15 13:52:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 1362 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 15 13:52:36.110493 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-5376d213-bbfd-4d84-afd2-4484a0c386ec tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:52:36.111370 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-2166f0e4-d44c-4511-9b4c-130048e8d41d tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:36.111721 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-5376d213-bbfd-4d84-afd2-4484a0c386ec tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] [instance: 6490290c-19e1-49db-9190-3b945ece5145] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:52:36.111845 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-2166f0e4-d44c-4511-9b4c-130048e8d41d tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:36.124346 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-2166f0e4-d44c-4511-9b4c-130048e8d41d tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:36.127858 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-2166f0e4-d44c-4511-9b4c-130048e8d41d tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:36.128909 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-2166f0e4-d44c-4511-9b4c-130048e8d41d tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:36.129827 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-2166f0e4-d44c-4511-9b4c-130048e8d41d tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:36.191423 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-5376d213-bbfd-4d84-afd2-4484a0c386ec tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83c1c8fce04c57a685de883344b7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e752c3aef55649ea98ec1a2f3607c27f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:52:36.202199 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-5376d213-bbfd-4d84-afd2-4484a0c386ec tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] 10.222.0.36 "GET /compute/v2.1/servers/6490290c-19e1-49db-9190-3b945ece5145" status: 200 len: 1258 microversion: 2.1 time: 0.096504 Oct 15 13:52:36.203473 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 216/424] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:52:36 2022] GET /compute/v2.1/servers/6490290c-19e1-49db-9190-3b945ece5145 => generated 1258 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:52:36.322980 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-2166f0e4-d44c-4511-9b4c-130048e8d41d tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e530c3f544748bd3ffc256b1630b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a6be8e43c7742be84f4dc3c95a990e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:52:36.337578 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-2166f0e4-d44c-4511-9b4c-130048e8d41d tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] 10.222.0.36 "GET /compute/v2.1/servers/1413aaed-46c7-4807-9d3b-957616dd4047" status: 200 len: 1258 microversion: 2.1 time: 0.260004 Oct 15 13:52:36.338644 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 209/425] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:52:36 2022] GET /compute/v2.1/servers/1413aaed-46c7-4807-9d3b-957616dd4047 => generated 1258 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:52:36.823059 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-73cd0116-dac1-43c4-b029-d7ec1b0105c5 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:52:36.823677 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-73cd0116-dac1-43c4-b029-d7ec1b0105c5 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 5fc359cf-ff2c-4189-b058-31eb3c97568c] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:52:36.830242 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-73cd0116-dac1-43c4-b029-d7ec1b0105c5 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:36.830749 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-73cd0116-dac1-43c4-b029-d7ec1b0105c5 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:36.831186 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-73cd0116-dac1-43c4-b029-d7ec1b0105c5 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:36.831926 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-73cd0116-dac1-43c4-b029-d7ec1b0105c5 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:36.832382 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-73cd0116-dac1-43c4-b029-d7ec1b0105c5 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:36.832819 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-73cd0116-dac1-43c4-b029-d7ec1b0105c5 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:37.106151 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-edb6d26e-f703-4498-98fd-72ba516833f8 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:52:37.106776 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-edb6d26e-f703-4498-98fd-72ba516833f8 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] [instance: 40d67d09-379e-4c12-b36c-21edf3b23e45] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:52:37.117246 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-edb6d26e-f703-4498-98fd-72ba516833f8 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:37.118100 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-edb6d26e-f703-4498-98fd-72ba516833f8 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:37.118763 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-edb6d26e-f703-4498-98fd-72ba516833f8 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:37.119865 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-edb6d26e-f703-4498-98fd-72ba516833f8 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:37.120694 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-edb6d26e-f703-4498-98fd-72ba516833f8 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:37.121832 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-edb6d26e-f703-4498-98fd-72ba516833f8 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:37.123866 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-73cd0116-dac1-43c4-b029-d7ec1b0105c5 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:52:37.139332 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-73cd0116-dac1-43c4-b029-d7ec1b0105c5 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:52:37.149707 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-73cd0116-dac1-43c4-b029-d7ec1b0105c5 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:52:37.152734 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-73cd0116-dac1-43c4-b029-d7ec1b0105c5 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c" status: 200 len: 1723 microversion: 2.20 time: 0.333599 Oct 15 13:52:37.158817 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 217/426] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:52:36 2022] GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c => generated 1723 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 13:52:37.227903 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-ea917f7d-332c-4433-b709-9a25ac1185e8 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:52:37.229551 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-ea917f7d-332c-4433-b709-9a25ac1185e8 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] [instance: 6490290c-19e1-49db-9190-3b945ece5145] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:52:37.236979 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-ea917f7d-332c-4433-b709-9a25ac1185e8 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:37.238025 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-ea917f7d-332c-4433-b709-9a25ac1185e8 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:37.238484 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-ea917f7d-332c-4433-b709-9a25ac1185e8 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:37.239356 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-ea917f7d-332c-4433-b709-9a25ac1185e8 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:37.240186 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-ea917f7d-332c-4433-b709-9a25ac1185e8 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:37.240858 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-ea917f7d-332c-4433-b709-9a25ac1185e8 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:37.414456 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-ea917f7d-332c-4433-b709-9a25ac1185e8 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83c1c8fce04c57a685de883344b7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e752c3aef55649ea98ec1a2f3607c27f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:52:37.428209 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-ea917f7d-332c-4433-b709-9a25ac1185e8 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] 10.222.0.36 "GET /compute/v2.1/servers/6490290c-19e1-49db-9190-3b945ece5145" status: 200 len: 1254 microversion: 2.1 time: 0.205355 Oct 15 13:52:37.430867 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 218/427] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:52:37 2022] GET /compute/v2.1/servers/6490290c-19e1-49db-9190-3b945ece5145 => generated 1254 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 13:52:37.440958 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-cefded30-74ba-42ca-b81b-51a84ee2f9b7 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:52:37.442994 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-cefded30-74ba-42ca-b81b-51a84ee2f9b7 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] [instance: 1413aaed-46c7-4807-9d3b-957616dd4047] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:52:37.456873 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-cefded30-74ba-42ca-b81b-51a84ee2f9b7 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:37.457673 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-cefded30-74ba-42ca-b81b-51a84ee2f9b7 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:37.458265 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-cefded30-74ba-42ca-b81b-51a84ee2f9b7 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:37.459131 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-cefded30-74ba-42ca-b81b-51a84ee2f9b7 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:37.460185 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-cefded30-74ba-42ca-b81b-51a84ee2f9b7 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:37.460792 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-cefded30-74ba-42ca-b81b-51a84ee2f9b7 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:37.466037 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG dbcounter [-] [125243] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=125243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:52:37.553401 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-edb6d26e-f703-4498-98fd-72ba516833f8 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583cce1547144e11978f20a3193ceba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f8b5024a194f70a9f7689ac44ab07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:52:37.579926 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-edb6d26e-f703-4498-98fd-72ba516833f8 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] 10.222.0.36 "GET /compute/v2.1/servers/40d67d09-379e-4c12-b36c-21edf3b23e45" status: 200 len: 1725 microversion: 2.1 time: 0.477804 Oct 15 13:52:37.580760 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 210/428] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:52:37 2022] GET /compute/v2.1/servers/40d67d09-379e-4c12-b36c-21edf3b23e45 => generated 1725 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:52:37.755244 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-cefded30-74ba-42ca-b81b-51a84ee2f9b7 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e530c3f544748bd3ffc256b1630b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a6be8e43c7742be84f4dc3c95a990e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:52:37.766286 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-cefded30-74ba-42ca-b81b-51a84ee2f9b7 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] 10.222.0.36 "GET /compute/v2.1/servers/1413aaed-46c7-4807-9d3b-957616dd4047" status: 200 len: 1258 microversion: 2.1 time: 0.333151 Oct 15 13:52:37.766721 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 219/429] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:52:37 2022] GET /compute/v2.1/servers/1413aaed-46c7-4807-9d3b-957616dd4047 => generated 1258 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:52:38.179976 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-1bab7386-927a-470e-b729-a3d207319cc8 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:52:38.180569 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-1bab7386-927a-470e-b729-a3d207319cc8 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 5fc359cf-ff2c-4189-b058-31eb3c97568c] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:52:38.189768 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-1bab7386-927a-470e-b729-a3d207319cc8 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:38.195066 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-1bab7386-927a-470e-b729-a3d207319cc8 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:38.195603 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-1bab7386-927a-470e-b729-a3d207319cc8 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:38.196706 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-1bab7386-927a-470e-b729-a3d207319cc8 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:38.197207 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-1bab7386-927a-470e-b729-a3d207319cc8 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:38.197638 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-1bab7386-927a-470e-b729-a3d207319cc8 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:38.371671 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-1bab7386-927a-470e-b729-a3d207319cc8 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:52:38.385871 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-1bab7386-927a-470e-b729-a3d207319cc8 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:52:38.387974 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-1bab7386-927a-470e-b729-a3d207319cc8 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:52:38.391553 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-1bab7386-927a-470e-b729-a3d207319cc8 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c" status: 200 len: 1723 microversion: 2.20 time: 0.213480 Oct 15 13:52:38.403899 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 211/430] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:52:38 2022] GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c => generated 1723 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 13:52:38.455471 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-222a7296-d007-4759-8a8a-de8d770f7cd5 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:52:38.456111 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-222a7296-d007-4759-8a8a-de8d770f7cd5 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] [instance: 6490290c-19e1-49db-9190-3b945ece5145] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:52:38.465489 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-222a7296-d007-4759-8a8a-de8d770f7cd5 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:38.466728 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-222a7296-d007-4759-8a8a-de8d770f7cd5 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:38.467474 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-222a7296-d007-4759-8a8a-de8d770f7cd5 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:38.469292 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-222a7296-d007-4759-8a8a-de8d770f7cd5 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:38.469963 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-222a7296-d007-4759-8a8a-de8d770f7cd5 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:38.470561 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-222a7296-d007-4759-8a8a-de8d770f7cd5 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:38.559748 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-222a7296-d007-4759-8a8a-de8d770f7cd5 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83c1c8fce04c57a685de883344b7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e752c3aef55649ea98ec1a2f3607c27f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:52:38.569579 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-222a7296-d007-4759-8a8a-de8d770f7cd5 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] 10.222.0.36 "GET /compute/v2.1/servers/6490290c-19e1-49db-9190-3b945ece5145" status: 200 len: 1316 microversion: 2.1 time: 0.119706 Oct 15 13:52:38.570330 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 220/431] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:52:38 2022] GET /compute/v2.1/servers/6490290c-19e1-49db-9190-3b945ece5145 => generated 1316 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 13:52:38.624339 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-c4afe538-ee8b-4488-8b99-8ab7fd185620 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:52:38.625727 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-c4afe538-ee8b-4488-8b99-8ab7fd185620 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] [instance: 40d67d09-379e-4c12-b36c-21edf3b23e45] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:52:38.649197 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-c4afe538-ee8b-4488-8b99-8ab7fd185620 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:38.650027 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-c4afe538-ee8b-4488-8b99-8ab7fd185620 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:38.650828 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-c4afe538-ee8b-4488-8b99-8ab7fd185620 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:38.653582 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-c4afe538-ee8b-4488-8b99-8ab7fd185620 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:38.658559 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-c4afe538-ee8b-4488-8b99-8ab7fd185620 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:38.659308 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-c4afe538-ee8b-4488-8b99-8ab7fd185620 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:38.791053 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-5b1adaad-f314-4b15-b916-7ccf7dc21c1a tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:52:38.792256 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-5b1adaad-f314-4b15-b916-7ccf7dc21c1a tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] [instance: 1413aaed-46c7-4807-9d3b-957616dd4047] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:52:38.803611 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-5b1adaad-f314-4b15-b916-7ccf7dc21c1a tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:38.804687 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-5b1adaad-f314-4b15-b916-7ccf7dc21c1a tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:38.805341 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-5b1adaad-f314-4b15-b916-7ccf7dc21c1a tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:38.806367 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-5b1adaad-f314-4b15-b916-7ccf7dc21c1a tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:38.806985 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-5b1adaad-f314-4b15-b916-7ccf7dc21c1a tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:38.807718 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-5b1adaad-f314-4b15-b916-7ccf7dc21c1a tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:38.992552 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-c4afe538-ee8b-4488-8b99-8ab7fd185620 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583cce1547144e11978f20a3193ceba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f8b5024a194f70a9f7689ac44ab07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:52:39.007838 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-c4afe538-ee8b-4488-8b99-8ab7fd185620 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] 10.222.0.36 "GET /compute/v2.1/servers/40d67d09-379e-4c12-b36c-21edf3b23e45" status: 200 len: 1725 microversion: 2.1 time: 0.389427 Oct 15 13:52:39.028236 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 212/432] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:52:38 2022] GET /compute/v2.1/servers/40d67d09-379e-4c12-b36c-21edf3b23e45 => generated 1725 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:52:39.101396 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-5b1adaad-f314-4b15-b916-7ccf7dc21c1a tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e530c3f544748bd3ffc256b1630b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a6be8e43c7742be84f4dc3c95a990e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:52:39.112909 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-5b1adaad-f314-4b15-b916-7ccf7dc21c1a tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] 10.222.0.36 "GET /compute/v2.1/servers/1413aaed-46c7-4807-9d3b-957616dd4047" status: 200 len: 1258 microversion: 2.1 time: 0.326801 Oct 15 13:52:39.113517 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 221/433] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:52:38 2022] GET /compute/v2.1/servers/1413aaed-46c7-4807-9d3b-957616dd4047 => generated 1258 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 13:52:39.420829 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-ccadd79c-8065-47e7-86f5-532b41cc2a8e tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:52:39.422569 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-ccadd79c-8065-47e7-86f5-532b41cc2a8e tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 5fc359cf-ff2c-4189-b058-31eb3c97568c] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:52:39.445153 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-ccadd79c-8065-47e7-86f5-532b41cc2a8e tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:39.446660 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-ccadd79c-8065-47e7-86f5-532b41cc2a8e tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:39.455999 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-ccadd79c-8065-47e7-86f5-532b41cc2a8e tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:39.459950 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-ccadd79c-8065-47e7-86f5-532b41cc2a8e tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:39.461049 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-ccadd79c-8065-47e7-86f5-532b41cc2a8e tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:39.462579 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-ccadd79c-8065-47e7-86f5-532b41cc2a8e tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:39.599202 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-ee0b4f78-3278-44a7-8385-c7ad2db4f569 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:52:39.600308 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-ee0b4f78-3278-44a7-8385-c7ad2db4f569 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] [instance: 6490290c-19e1-49db-9190-3b945ece5145] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:52:39.625317 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-ee0b4f78-3278-44a7-8385-c7ad2db4f569 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:39.625808 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-ee0b4f78-3278-44a7-8385-c7ad2db4f569 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:39.629716 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-ee0b4f78-3278-44a7-8385-c7ad2db4f569 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:39.630782 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-ee0b4f78-3278-44a7-8385-c7ad2db4f569 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:39.631372 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-ee0b4f78-3278-44a7-8385-c7ad2db4f569 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:39.631832 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-ee0b4f78-3278-44a7-8385-c7ad2db4f569 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:39.823222 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-ccadd79c-8065-47e7-86f5-532b41cc2a8e tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:52:39.842151 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-ccadd79c-8065-47e7-86f5-532b41cc2a8e tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:52:39.848996 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-ccadd79c-8065-47e7-86f5-532b41cc2a8e tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:52:39.850479 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-ccadd79c-8065-47e7-86f5-532b41cc2a8e tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c" status: 200 len: 1723 microversion: 2.20 time: 0.434352 Oct 15 13:52:39.854065 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 213/434] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:52:39 2022] GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c => generated 1723 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 13:52:40.023431 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-ee0b4f78-3278-44a7-8385-c7ad2db4f569 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83c1c8fce04c57a685de883344b7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e752c3aef55649ea98ec1a2f3607c27f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:52:40.041427 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-d2602b19-af95-4d63-bf67-526f6dddd27c tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:52:40.046033 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-d2602b19-af95-4d63-bf67-526f6dddd27c tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] [instance: 40d67d09-379e-4c12-b36c-21edf3b23e45] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:52:40.060157 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-ee0b4f78-3278-44a7-8385-c7ad2db4f569 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] 10.222.0.36 "GET /compute/v2.1/servers/6490290c-19e1-49db-9190-3b945ece5145" status: 200 len: 1358 microversion: 2.1 time: 0.462501 Oct 15 13:52:40.064179 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 222/435] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:52:39 2022] GET /compute/v2.1/servers/6490290c-19e1-49db-9190-3b945ece5145 => generated 1358 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:52:40.082045 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-d2602b19-af95-4d63-bf67-526f6dddd27c tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:40.083097 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-d2602b19-af95-4d63-bf67-526f6dddd27c tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:40.084077 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-d2602b19-af95-4d63-bf67-526f6dddd27c tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:40.086566 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-d2602b19-af95-4d63-bf67-526f6dddd27c tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:40.087536 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-d2602b19-af95-4d63-bf67-526f6dddd27c tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:40.088217 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-d2602b19-af95-4d63-bf67-526f6dddd27c tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:40.144772 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-8e4f5e26-a391-4cfd-965c-c28d3bf6ef24 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:52:40.150297 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-8e4f5e26-a391-4cfd-965c-c28d3bf6ef24 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] [instance: 1413aaed-46c7-4807-9d3b-957616dd4047] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:52:40.176838 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-8e4f5e26-a391-4cfd-965c-c28d3bf6ef24 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:40.182278 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-8e4f5e26-a391-4cfd-965c-c28d3bf6ef24 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:40.183581 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-8e4f5e26-a391-4cfd-965c-c28d3bf6ef24 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:40.186876 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-8e4f5e26-a391-4cfd-965c-c28d3bf6ef24 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:40.196670 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-8e4f5e26-a391-4cfd-965c-c28d3bf6ef24 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:40.198591 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-8e4f5e26-a391-4cfd-965c-c28d3bf6ef24 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:40.395304 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-d2602b19-af95-4d63-bf67-526f6dddd27c tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583cce1547144e11978f20a3193ceba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f8b5024a194f70a9f7689ac44ab07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:52:40.404843 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-d2602b19-af95-4d63-bf67-526f6dddd27c tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] 10.222.0.36 "GET /compute/v2.1/servers/40d67d09-379e-4c12-b36c-21edf3b23e45" status: 200 len: 1725 microversion: 2.1 time: 0.371025 Oct 15 13:52:40.424445 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 214/436] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:52:40 2022] GET /compute/v2.1/servers/40d67d09-379e-4c12-b36c-21edf3b23e45 => generated 1725 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 13:52:40.525580 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-8e4f5e26-a391-4cfd-965c-c28d3bf6ef24 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e530c3f544748bd3ffc256b1630b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a6be8e43c7742be84f4dc3c95a990e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:52:40.538556 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-8e4f5e26-a391-4cfd-965c-c28d3bf6ef24 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] 10.222.0.36 "GET /compute/v2.1/servers/1413aaed-46c7-4807-9d3b-957616dd4047" status: 200 len: 1258 microversion: 2.1 time: 0.403520 Oct 15 13:52:40.540320 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 223/437] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:52:40 2022] GET /compute/v2.1/servers/1413aaed-46c7-4807-9d3b-957616dd4047 => generated 1258 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:52:40.877329 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [req-7d789bd4-e37c-4f73-9928-1ae801c57a0d req-3397a998-ea1b-40d9-89c9-fc4165a54eb7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6490290c-19e1-49db-9190-3b945ece5145", "tag": "3f885321-034d-42f2-a8c5-c0315db5a5eb"}]} {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 13:52:40.891827 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-a160ef84-d909-4ed5-ab2d-1b10f4177938 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:52:40.893342 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-a160ef84-d909-4ed5-ab2d-1b10f4177938 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 5fc359cf-ff2c-4189-b058-31eb3c97568c] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:52:40.898629 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG dbcounter [-] [125243] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=4 {{(pid=125243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:52:40.906093 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-a160ef84-d909-4ed5-ab2d-1b10f4177938 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:40.906719 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [req-7d789bd4-e37c-4f73-9928-1ae801c57a0d req-3397a998-ea1b-40d9-89c9-fc4165a54eb7 service nova] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:40.907106 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-a160ef84-d909-4ed5-ab2d-1b10f4177938 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:40.907709 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-a160ef84-d909-4ed5-ab2d-1b10f4177938 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:40.908780 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-a160ef84-d909-4ed5-ab2d-1b10f4177938 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:40.909433 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-a160ef84-d909-4ed5-ab2d-1b10f4177938 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:40.910068 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [req-7d789bd4-e37c-4f73-9928-1ae801c57a0d req-3397a998-ea1b-40d9-89c9-fc4165a54eb7 service nova] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:40.910263 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-a160ef84-d909-4ed5-ab2d-1b10f4177938 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:40.910556 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [req-7d789bd4-e37c-4f73-9928-1ae801c57a0d req-3397a998-ea1b-40d9-89c9-fc4165a54eb7 service nova] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:40.939867 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.compute.server_external_events [req-7d789bd4-e37c-4f73-9928-1ae801c57a0d req-3397a998-ea1b-40d9-89c9-fc4165a54eb7 service nova] Creating event network-changed:3f885321-034d-42f2-a8c5-c0315db5a5eb for instance 6490290c-19e1-49db-9190-3b945ece5145 on hv-cinder-86149 Oct 15 13:52:40.951828 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [req-7d789bd4-e37c-4f73-9928-1ae801c57a0d req-3397a998-ea1b-40d9-89c9-fc4165a54eb7 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080294 Oct 15 13:52:40.962882 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 215/438] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 15 13:52:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 13:52:41.095089 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-8a5f7f86-9c17-40db-abe7-8faae36e2c69 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:52:41.096079 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-8a5f7f86-9c17-40db-abe7-8faae36e2c69 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] [instance: 6490290c-19e1-49db-9190-3b945ece5145] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:52:41.104881 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-8a5f7f86-9c17-40db-abe7-8faae36e2c69 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:41.105594 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-8a5f7f86-9c17-40db-abe7-8faae36e2c69 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:41.106103 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-8a5f7f86-9c17-40db-abe7-8faae36e2c69 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:41.106907 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-8a5f7f86-9c17-40db-abe7-8faae36e2c69 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:41.107432 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-8a5f7f86-9c17-40db-abe7-8faae36e2c69 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:41.107954 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-8a5f7f86-9c17-40db-abe7-8faae36e2c69 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:41.131828 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-a160ef84-d909-4ed5-ab2d-1b10f4177938 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:52:41.143507 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-a160ef84-d909-4ed5-ab2d-1b10f4177938 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:52:41.148746 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-a160ef84-d909-4ed5-ab2d-1b10f4177938 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:52:41.161742 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-a160ef84-d909-4ed5-ab2d-1b10f4177938 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c" status: 200 len: 1723 microversion: 2.20 time: 0.280860 Oct 15 13:52:41.168919 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 224/439] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:52:40 2022] GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c => generated 1723 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 13:52:41.276309 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-8a5f7f86-9c17-40db-abe7-8faae36e2c69 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83c1c8fce04c57a685de883344b7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e752c3aef55649ea98ec1a2f3607c27f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:52:41.285603 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-8a5f7f86-9c17-40db-abe7-8faae36e2c69 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] 10.222.0.36 "GET /compute/v2.1/servers/6490290c-19e1-49db-9190-3b945ece5145" status: 200 len: 1358 microversion: 2.1 time: 0.196971 Oct 15 13:52:41.286512 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 216/440] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:52:41 2022] GET /compute/v2.1/servers/6490290c-19e1-49db-9190-3b945ece5145 => generated 1358 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 13:52:41.436557 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-af6b8010-1357-4786-98c6-672d52307951 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:52:41.437215 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-af6b8010-1357-4786-98c6-672d52307951 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] [instance: 40d67d09-379e-4c12-b36c-21edf3b23e45] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:52:41.443980 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-af6b8010-1357-4786-98c6-672d52307951 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:41.444486 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-af6b8010-1357-4786-98c6-672d52307951 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:41.444930 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-af6b8010-1357-4786-98c6-672d52307951 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:41.445638 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-af6b8010-1357-4786-98c6-672d52307951 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:41.446124 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-af6b8010-1357-4786-98c6-672d52307951 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:41.446549 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-af6b8010-1357-4786-98c6-672d52307951 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:41.562078 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-e8612fc9-7500-4b19-846a-2ad25b2e8fed tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:52:41.563484 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-e8612fc9-7500-4b19-846a-2ad25b2e8fed tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] [instance: 1413aaed-46c7-4807-9d3b-957616dd4047] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:52:41.575653 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-e8612fc9-7500-4b19-846a-2ad25b2e8fed tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:41.576598 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-e8612fc9-7500-4b19-846a-2ad25b2e8fed tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:41.577488 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-e8612fc9-7500-4b19-846a-2ad25b2e8fed tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:41.582106 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-e8612fc9-7500-4b19-846a-2ad25b2e8fed tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:41.582637 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-e8612fc9-7500-4b19-846a-2ad25b2e8fed tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:41.583080 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-e8612fc9-7500-4b19-846a-2ad25b2e8fed tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:41.617709 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-af6b8010-1357-4786-98c6-672d52307951 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583cce1547144e11978f20a3193ceba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f8b5024a194f70a9f7689ac44ab07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:52:41.626735 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-af6b8010-1357-4786-98c6-672d52307951 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] 10.222.0.36 "GET /compute/v2.1/servers/40d67d09-379e-4c12-b36c-21edf3b23e45" status: 200 len: 1725 microversion: 2.1 time: 0.194215 Oct 15 13:52:41.634880 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 225/441] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:52:41 2022] GET /compute/v2.1/servers/40d67d09-379e-4c12-b36c-21edf3b23e45 => generated 1725 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:52:41.794416 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-e8612fc9-7500-4b19-846a-2ad25b2e8fed tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e530c3f544748bd3ffc256b1630b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a6be8e43c7742be84f4dc3c95a990e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:52:41.804120 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-e8612fc9-7500-4b19-846a-2ad25b2e8fed tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] 10.222.0.36 "GET /compute/v2.1/servers/1413aaed-46c7-4807-9d3b-957616dd4047" status: 200 len: 1258 microversion: 2.1 time: 0.245883 Oct 15 13:52:41.805334 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 217/442] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:52:41 2022] GET /compute/v2.1/servers/1413aaed-46c7-4807-9d3b-957616dd4047 => generated 1258 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 13:52:42.190347 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-be7b025d-3456-4511-883d-8f53702e247b tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:52:42.191711 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-be7b025d-3456-4511-883d-8f53702e247b tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 5fc359cf-ff2c-4189-b058-31eb3c97568c] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:52:42.206900 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-be7b025d-3456-4511-883d-8f53702e247b tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:42.207526 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-be7b025d-3456-4511-883d-8f53702e247b tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:42.208159 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-be7b025d-3456-4511-883d-8f53702e247b tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:42.209186 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-be7b025d-3456-4511-883d-8f53702e247b tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:42.209772 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-be7b025d-3456-4511-883d-8f53702e247b tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:42.217917 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-be7b025d-3456-4511-883d-8f53702e247b tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:42.309942 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-5733af9b-c154-4a14-8e12-256d6384afe5 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:52:42.310550 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-5733af9b-c154-4a14-8e12-256d6384afe5 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] [instance: 6490290c-19e1-49db-9190-3b945ece5145] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:52:42.317984 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-5733af9b-c154-4a14-8e12-256d6384afe5 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:42.318413 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-5733af9b-c154-4a14-8e12-256d6384afe5 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:42.319749 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-5733af9b-c154-4a14-8e12-256d6384afe5 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:42.322391 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-5733af9b-c154-4a14-8e12-256d6384afe5 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:42.323275 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-5733af9b-c154-4a14-8e12-256d6384afe5 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:42.324193 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-5733af9b-c154-4a14-8e12-256d6384afe5 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:42.484475 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-be7b025d-3456-4511-883d-8f53702e247b tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:52:42.493799 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-be7b025d-3456-4511-883d-8f53702e247b tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:52:42.495421 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-be7b025d-3456-4511-883d-8f53702e247b tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:52:42.496727 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-be7b025d-3456-4511-883d-8f53702e247b tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c" status: 200 len: 1723 microversion: 2.20 time: 0.311635 Oct 15 13:52:42.497355 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 226/443] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:52:42 2022] GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c => generated 1723 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 13:52:42.542398 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-5733af9b-c154-4a14-8e12-256d6384afe5 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83c1c8fce04c57a685de883344b7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e752c3aef55649ea98ec1a2f3607c27f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:52:42.550580 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-5733af9b-c154-4a14-8e12-256d6384afe5 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] 10.222.0.36 "GET /compute/v2.1/servers/6490290c-19e1-49db-9190-3b945ece5145" status: 200 len: 1358 microversion: 2.1 time: 0.244477 Oct 15 13:52:42.551161 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 218/444] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:52:42 2022] GET /compute/v2.1/servers/6490290c-19e1-49db-9190-3b945ece5145 => generated 1358 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:52:42.652899 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-f84bea4d-776a-4b45-be5f-c37b92fba8b8 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:52:42.653508 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-f84bea4d-776a-4b45-be5f-c37b92fba8b8 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] [instance: 40d67d09-379e-4c12-b36c-21edf3b23e45] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:52:42.661348 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-f84bea4d-776a-4b45-be5f-c37b92fba8b8 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:42.662021 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-f84bea4d-776a-4b45-be5f-c37b92fba8b8 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:42.662633 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-f84bea4d-776a-4b45-be5f-c37b92fba8b8 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:42.663703 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-f84bea4d-776a-4b45-be5f-c37b92fba8b8 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:42.664286 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-f84bea4d-776a-4b45-be5f-c37b92fba8b8 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:42.664831 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-f84bea4d-776a-4b45-be5f-c37b92fba8b8 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:42.812470 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-f84bea4d-776a-4b45-be5f-c37b92fba8b8 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583cce1547144e11978f20a3193ceba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f8b5024a194f70a9f7689ac44ab07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:52:42.824847 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-f84bea4d-776a-4b45-be5f-c37b92fba8b8 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] 10.222.0.36 "GET /compute/v2.1/servers/40d67d09-379e-4c12-b36c-21edf3b23e45" status: 200 len: 1725 microversion: 2.1 time: 0.175864 Oct 15 13:52:42.826044 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 227/445] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:52:42 2022] GET /compute/v2.1/servers/40d67d09-379e-4c12-b36c-21edf3b23e45 => generated 1725 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:52:42.831715 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-8c5d2d01-5d2d-4401-b8b0-f469499215f5 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:52:42.832355 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-8c5d2d01-5d2d-4401-b8b0-f469499215f5 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] [instance: 1413aaed-46c7-4807-9d3b-957616dd4047] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:52:42.838948 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-8c5d2d01-5d2d-4401-b8b0-f469499215f5 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:42.839437 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-8c5d2d01-5d2d-4401-b8b0-f469499215f5 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:42.840047 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-8c5d2d01-5d2d-4401-b8b0-f469499215f5 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:42.840618 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-8c5d2d01-5d2d-4401-b8b0-f469499215f5 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:42.841076 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-8c5d2d01-5d2d-4401-b8b0-f469499215f5 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:42.841533 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-8c5d2d01-5d2d-4401-b8b0-f469499215f5 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:42.994505 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-8c5d2d01-5d2d-4401-b8b0-f469499215f5 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e530c3f544748bd3ffc256b1630b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a6be8e43c7742be84f4dc3c95a990e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:52:43.002689 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-8c5d2d01-5d2d-4401-b8b0-f469499215f5 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] 10.222.0.36 "GET /compute/v2.1/servers/1413aaed-46c7-4807-9d3b-957616dd4047" status: 200 len: 1258 microversion: 2.1 time: 0.175821 Oct 15 13:52:43.003252 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 219/446] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:52:42 2022] GET /compute/v2.1/servers/1413aaed-46c7-4807-9d3b-957616dd4047 => generated 1258 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:52:43.523115 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-17ceb36a-d517-473a-9170-e0d5d571377a tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:52:43.524101 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-17ceb36a-d517-473a-9170-e0d5d571377a tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 5fc359cf-ff2c-4189-b058-31eb3c97568c] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:52:43.532192 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-17ceb36a-d517-473a-9170-e0d5d571377a tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:43.532995 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-17ceb36a-d517-473a-9170-e0d5d571377a tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:43.533510 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-17ceb36a-d517-473a-9170-e0d5d571377a tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:43.534251 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-17ceb36a-d517-473a-9170-e0d5d571377a tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:43.535096 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-17ceb36a-d517-473a-9170-e0d5d571377a tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:43.535713 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-17ceb36a-d517-473a-9170-e0d5d571377a tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:43.575535 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-a0260dd8-9095-41d4-b63c-f970be9fac3a tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:52:43.576469 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-a0260dd8-9095-41d4-b63c-f970be9fac3a tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] [instance: 6490290c-19e1-49db-9190-3b945ece5145] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:52:43.583680 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-a0260dd8-9095-41d4-b63c-f970be9fac3a tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:43.584266 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-a0260dd8-9095-41d4-b63c-f970be9fac3a tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:43.584932 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-a0260dd8-9095-41d4-b63c-f970be9fac3a tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:43.585791 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-a0260dd8-9095-41d4-b63c-f970be9fac3a tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:43.586209 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-a0260dd8-9095-41d4-b63c-f970be9fac3a tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:43.586811 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-a0260dd8-9095-41d4-b63c-f970be9fac3a tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:43.769820 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-17ceb36a-d517-473a-9170-e0d5d571377a tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:52:43.773247 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-a0260dd8-9095-41d4-b63c-f970be9fac3a tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83c1c8fce04c57a685de883344b7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e752c3aef55649ea98ec1a2f3607c27f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:52:43.775608 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG dbcounter [-] [125242] Writing DB stats nova_cell1:SELECT=100 {{(pid=125242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:52:43.780215 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-17ceb36a-d517-473a-9170-e0d5d571377a tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:52:43.782245 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-17ceb36a-d517-473a-9170-e0d5d571377a tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:52:43.782392 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-a0260dd8-9095-41d4-b63c-f970be9fac3a tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] 10.222.0.36 "GET /compute/v2.1/servers/6490290c-19e1-49db-9190-3b945ece5145" status: 200 len: 1358 microversion: 2.1 time: 0.211070 Oct 15 13:52:43.784310 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 220/447] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:52:43 2022] GET /compute/v2.1/servers/6490290c-19e1-49db-9190-3b945ece5145 => generated 1358 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:52:43.784460 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-17ceb36a-d517-473a-9170-e0d5d571377a tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c" status: 200 len: 1723 microversion: 2.20 time: 0.265099 Oct 15 13:52:43.784460 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 228/448] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:52:43 2022] GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c => generated 1723 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 13:52:43.850406 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-7ab6ea97-316f-4ab4-9155-88ca16eadfb9 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:52:43.851106 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-7ab6ea97-316f-4ab4-9155-88ca16eadfb9 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] [instance: 40d67d09-379e-4c12-b36c-21edf3b23e45] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:52:43.858687 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-7ab6ea97-316f-4ab4-9155-88ca16eadfb9 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:43.859317 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-7ab6ea97-316f-4ab4-9155-88ca16eadfb9 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:43.859832 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-7ab6ea97-316f-4ab4-9155-88ca16eadfb9 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:43.860924 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-7ab6ea97-316f-4ab4-9155-88ca16eadfb9 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:43.861469 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-7ab6ea97-316f-4ab4-9155-88ca16eadfb9 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:43.862106 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-7ab6ea97-316f-4ab4-9155-88ca16eadfb9 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:44.010698 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-7ab6ea97-316f-4ab4-9155-88ca16eadfb9 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583cce1547144e11978f20a3193ceba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f8b5024a194f70a9f7689ac44ab07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:52:44.019551 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-7ab6ea97-316f-4ab4-9155-88ca16eadfb9 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] 10.222.0.36 "GET /compute/v2.1/servers/40d67d09-379e-4c12-b36c-21edf3b23e45" status: 200 len: 1725 microversion: 2.1 time: 0.173141 Oct 15 13:52:44.028049 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 221/449] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:52:43 2022] GET /compute/v2.1/servers/40d67d09-379e-4c12-b36c-21edf3b23e45 => generated 1725 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:52:44.028217 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-33f3336b-9ff9-479a-9c9f-f31d49b03f04 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:52:44.028217 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-33f3336b-9ff9-479a-9c9f-f31d49b03f04 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] [instance: 1413aaed-46c7-4807-9d3b-957616dd4047] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:52:44.032977 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-33f3336b-9ff9-479a-9c9f-f31d49b03f04 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:44.033434 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-33f3336b-9ff9-479a-9c9f-f31d49b03f04 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:44.033903 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-33f3336b-9ff9-479a-9c9f-f31d49b03f04 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:44.034610 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-33f3336b-9ff9-479a-9c9f-f31d49b03f04 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:44.035926 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-33f3336b-9ff9-479a-9c9f-f31d49b03f04 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:44.035926 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-33f3336b-9ff9-479a-9c9f-f31d49b03f04 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:44.180820 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-33f3336b-9ff9-479a-9c9f-f31d49b03f04 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e530c3f544748bd3ffc256b1630b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a6be8e43c7742be84f4dc3c95a990e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:52:44.189411 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-33f3336b-9ff9-479a-9c9f-f31d49b03f04 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] 10.222.0.36 "GET /compute/v2.1/servers/1413aaed-46c7-4807-9d3b-957616dd4047" status: 200 len: 1258 microversion: 2.1 time: 0.167237 Oct 15 13:52:44.190148 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 229/450] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:52:44 2022] GET /compute/v2.1/servers/1413aaed-46c7-4807-9d3b-957616dd4047 => generated 1258 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:52:44.805637 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-7e71c23b-567f-4b84-837f-ec3e52754b84 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:52:44.806258 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-7e71c23b-567f-4b84-837f-ec3e52754b84 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] [instance: 6490290c-19e1-49db-9190-3b945ece5145] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:52:44.813229 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-7e71c23b-567f-4b84-837f-ec3e52754b84 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:44.813736 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-7e71c23b-567f-4b84-837f-ec3e52754b84 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:44.814195 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-7e71c23b-567f-4b84-837f-ec3e52754b84 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:44.814904 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-7e71c23b-567f-4b84-837f-ec3e52754b84 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:44.815374 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-7e71c23b-567f-4b84-837f-ec3e52754b84 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:44.815822 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-7e71c23b-567f-4b84-837f-ec3e52754b84 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:44.817119 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-32f4e13c-be93-4455-9f01-5e08eacb8d64 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:52:44.817683 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-32f4e13c-be93-4455-9f01-5e08eacb8d64 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 5fc359cf-ff2c-4189-b058-31eb3c97568c] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:52:44.824425 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-32f4e13c-be93-4455-9f01-5e08eacb8d64 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:44.824910 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-32f4e13c-be93-4455-9f01-5e08eacb8d64 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:44.825361 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-32f4e13c-be93-4455-9f01-5e08eacb8d64 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:44.826025 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-32f4e13c-be93-4455-9f01-5e08eacb8d64 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:44.826475 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-32f4e13c-be93-4455-9f01-5e08eacb8d64 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:44.826895 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-32f4e13c-be93-4455-9f01-5e08eacb8d64 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:45.019740 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-7e71c23b-567f-4b84-837f-ec3e52754b84 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83c1c8fce04c57a685de883344b7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e752c3aef55649ea98ec1a2f3607c27f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:52:45.024479 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-32f4e13c-be93-4455-9f01-5e08eacb8d64 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:52:45.029205 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-7e71c23b-567f-4b84-837f-ec3e52754b84 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] 10.222.0.36 "GET /compute/v2.1/servers/6490290c-19e1-49db-9190-3b945ece5145" status: 200 len: 1358 microversion: 2.1 time: 0.227590 Oct 15 13:52:45.030054 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 222/451] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:52:44 2022] GET /compute/v2.1/servers/6490290c-19e1-49db-9190-3b945ece5145 => generated 1358 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:52:45.034450 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-32f4e13c-be93-4455-9f01-5e08eacb8d64 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:52:45.036327 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-32f4e13c-be93-4455-9f01-5e08eacb8d64 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:52:45.037524 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-32f4e13c-be93-4455-9f01-5e08eacb8d64 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c" status: 200 len: 1723 microversion: 2.20 time: 0.224531 Oct 15 13:52:45.047941 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-160f1e6a-97b0-4723-99c0-b37115ea2289 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:52:45.047941 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-160f1e6a-97b0-4723-99c0-b37115ea2289 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] [instance: 40d67d09-379e-4c12-b36c-21edf3b23e45] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:52:45.048251 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 230/452] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:52:44 2022] GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c => generated 1723 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 15 13:52:45.053586 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-160f1e6a-97b0-4723-99c0-b37115ea2289 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:45.054078 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-160f1e6a-97b0-4723-99c0-b37115ea2289 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:45.054517 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-160f1e6a-97b0-4723-99c0-b37115ea2289 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:45.055210 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-160f1e6a-97b0-4723-99c0-b37115ea2289 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:45.055727 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-160f1e6a-97b0-4723-99c0-b37115ea2289 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:45.056120 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-160f1e6a-97b0-4723-99c0-b37115ea2289 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:45.200746 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-160f1e6a-97b0-4723-99c0-b37115ea2289 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583cce1547144e11978f20a3193ceba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f8b5024a194f70a9f7689ac44ab07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:52:45.211279 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-160f1e6a-97b0-4723-99c0-b37115ea2289 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] 10.222.0.36 "GET /compute/v2.1/servers/40d67d09-379e-4c12-b36c-21edf3b23e45" status: 200 len: 1725 microversion: 2.1 time: 0.168211 Oct 15 13:52:45.212131 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 223/453] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:52:45 2022] GET /compute/v2.1/servers/40d67d09-379e-4c12-b36c-21edf3b23e45 => generated 1725 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 13:52:45.213288 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-f04aea63-ce8d-42cd-ad21-93d1a5a13b07 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:52:45.213904 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-f04aea63-ce8d-42cd-ad21-93d1a5a13b07 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] [instance: 1413aaed-46c7-4807-9d3b-957616dd4047] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:52:45.220656 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-f04aea63-ce8d-42cd-ad21-93d1a5a13b07 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:45.221144 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-f04aea63-ce8d-42cd-ad21-93d1a5a13b07 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:45.221581 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-f04aea63-ce8d-42cd-ad21-93d1a5a13b07 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:45.222267 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-f04aea63-ce8d-42cd-ad21-93d1a5a13b07 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:45.222716 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-f04aea63-ce8d-42cd-ad21-93d1a5a13b07 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:45.223133 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-f04aea63-ce8d-42cd-ad21-93d1a5a13b07 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:45.364957 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-f04aea63-ce8d-42cd-ad21-93d1a5a13b07 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e530c3f544748bd3ffc256b1630b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a6be8e43c7742be84f4dc3c95a990e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:52:45.373745 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-f04aea63-ce8d-42cd-ad21-93d1a5a13b07 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] 10.222.0.36 "GET /compute/v2.1/servers/1413aaed-46c7-4807-9d3b-957616dd4047" status: 200 len: 1258 microversion: 2.1 time: 0.164146 Oct 15 13:52:45.375334 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 231/454] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:52:45 2022] GET /compute/v2.1/servers/1413aaed-46c7-4807-9d3b-957616dd4047 => generated 1258 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:52:46.053510 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-bdd4a2f6-ee41-45d5-9b51-27d011f33e97 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:52:46.053958 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-bdd4a2f6-ee41-45d5-9b51-27d011f33e97 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] [instance: 6490290c-19e1-49db-9190-3b945ece5145] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:52:46.057584 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG dbcounter [-] [125242] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=3 {{(pid=125242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:52:46.069235 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-5df5ddcb-8ec8-46b7-b6fe-afa32a48f6d2 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:52:46.069980 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-5df5ddcb-8ec8-46b7-b6fe-afa32a48f6d2 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 5fc359cf-ff2c-4189-b058-31eb3c97568c] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:52:46.078504 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG dbcounter [-] [125243] Writing DB stats nova_cell0:SELECT=2 {{(pid=125243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:52:46.078941 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-bdd4a2f6-ee41-45d5-9b51-27d011f33e97 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:46.079543 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-bdd4a2f6-ee41-45d5-9b51-27d011f33e97 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:46.080378 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-bdd4a2f6-ee41-45d5-9b51-27d011f33e97 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:46.081831 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-5df5ddcb-8ec8-46b7-b6fe-afa32a48f6d2 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:46.082811 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-bdd4a2f6-ee41-45d5-9b51-27d011f33e97 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:46.083490 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-bdd4a2f6-ee41-45d5-9b51-27d011f33e97 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:46.084611 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-bdd4a2f6-ee41-45d5-9b51-27d011f33e97 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:46.085032 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-5df5ddcb-8ec8-46b7-b6fe-afa32a48f6d2 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:46.089027 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-5df5ddcb-8ec8-46b7-b6fe-afa32a48f6d2 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:46.090118 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-5df5ddcb-8ec8-46b7-b6fe-afa32a48f6d2 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:46.090687 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-5df5ddcb-8ec8-46b7-b6fe-afa32a48f6d2 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:46.091197 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-5df5ddcb-8ec8-46b7-b6fe-afa32a48f6d2 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:46.198173 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG dbcounter [-] [125243] Writing DB stats nova_cell0:SELECT=12 {{(pid=125243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:52:46.339687 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-5df5ddcb-8ec8-46b7-b6fe-afa32a48f6d2 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:52:46.342271 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-bdd4a2f6-ee41-45d5-9b51-27d011f33e97 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83c1c8fce04c57a685de883344b7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e752c3aef55649ea98ec1a2f3607c27f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:52:46.353020 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-5df5ddcb-8ec8-46b7-b6fe-afa32a48f6d2 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:52:46.354580 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-bdd4a2f6-ee41-45d5-9b51-27d011f33e97 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] 10.222.0.36 "GET /compute/v2.1/servers/6490290c-19e1-49db-9190-3b945ece5145" status: 200 len: 1358 microversion: 2.1 time: 0.305546 Oct 15 13:52:46.360564 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-5df5ddcb-8ec8-46b7-b6fe-afa32a48f6d2 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:52:46.368664 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 224/455] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:52:46 2022] GET /compute/v2.1/servers/6490290c-19e1-49db-9190-3b945ece5145 => generated 1358 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:52:46.369811 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-5df5ddcb-8ec8-46b7-b6fe-afa32a48f6d2 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c" status: 200 len: 1723 microversion: 2.20 time: 0.304045 Oct 15 13:52:46.370886 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 232/456] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:52:46 2022] GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c => generated 1723 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 13:52:46.377211 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-03076a5a-7c09-49cf-a843-026bdefe3297 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:52:46.377908 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-03076a5a-7c09-49cf-a843-026bdefe3297 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] [instance: 40d67d09-379e-4c12-b36c-21edf3b23e45] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:52:46.384542 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-03076a5a-7c09-49cf-a843-026bdefe3297 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:46.385381 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-03076a5a-7c09-49cf-a843-026bdefe3297 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:46.385888 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-03076a5a-7c09-49cf-a843-026bdefe3297 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:46.386659 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-03076a5a-7c09-49cf-a843-026bdefe3297 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:46.387183 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-03076a5a-7c09-49cf-a843-026bdefe3297 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:46.387676 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-03076a5a-7c09-49cf-a843-026bdefe3297 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:46.401864 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-0ba3549e-08e4-4746-9137-fe99f09fbe29 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:52:46.402471 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-0ba3549e-08e4-4746-9137-fe99f09fbe29 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] [instance: 1413aaed-46c7-4807-9d3b-957616dd4047] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:52:46.408607 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-0ba3549e-08e4-4746-9137-fe99f09fbe29 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:46.409096 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-0ba3549e-08e4-4746-9137-fe99f09fbe29 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:46.409526 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-0ba3549e-08e4-4746-9137-fe99f09fbe29 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:46.410300 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-0ba3549e-08e4-4746-9137-fe99f09fbe29 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:46.410670 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-0ba3549e-08e4-4746-9137-fe99f09fbe29 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:46.411090 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-0ba3549e-08e4-4746-9137-fe99f09fbe29 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:46.589111 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-03076a5a-7c09-49cf-a843-026bdefe3297 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583cce1547144e11978f20a3193ceba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f8b5024a194f70a9f7689ac44ab07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:52:46.597614 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-03076a5a-7c09-49cf-a843-026bdefe3297 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] 10.222.0.36 "GET /compute/v2.1/servers/40d67d09-379e-4c12-b36c-21edf3b23e45" status: 200 len: 1725 microversion: 2.1 time: 0.227793 Oct 15 13:52:46.598208 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 225/457] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:52:46 2022] GET /compute/v2.1/servers/40d67d09-379e-4c12-b36c-21edf3b23e45 => generated 1725 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:52:46.607019 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-0ba3549e-08e4-4746-9137-fe99f09fbe29 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e530c3f544748bd3ffc256b1630b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a6be8e43c7742be84f4dc3c95a990e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:52:46.616309 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-0ba3549e-08e4-4746-9137-fe99f09fbe29 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] 10.222.0.36 "GET /compute/v2.1/servers/1413aaed-46c7-4807-9d3b-957616dd4047" status: 200 len: 1258 microversion: 2.1 time: 0.218184 Oct 15 13:52:46.617066 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 233/458] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:52:46 2022] GET /compute/v2.1/servers/1413aaed-46c7-4807-9d3b-957616dd4047 => generated 1258 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 13:52:47.380824 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-b833386b-eaf6-47a1-bd89-6f4b5eb524e5 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:52:47.381487 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-b833386b-eaf6-47a1-bd89-6f4b5eb524e5 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] [instance: 6490290c-19e1-49db-9190-3b945ece5145] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:52:47.388286 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-b833386b-eaf6-47a1-bd89-6f4b5eb524e5 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:47.388778 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-b833386b-eaf6-47a1-bd89-6f4b5eb524e5 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:47.389231 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-b833386b-eaf6-47a1-bd89-6f4b5eb524e5 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:47.390017 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-b833386b-eaf6-47a1-bd89-6f4b5eb524e5 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:47.390495 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-b833386b-eaf6-47a1-bd89-6f4b5eb524e5 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:47.391408 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-b833386b-eaf6-47a1-bd89-6f4b5eb524e5 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:47.395469 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-7cba13bf-8b4f-49e1-b0eb-d736fae37118 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:52:47.396189 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-7cba13bf-8b4f-49e1-b0eb-d736fae37118 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 5fc359cf-ff2c-4189-b058-31eb3c97568c] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:52:47.402848 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-7cba13bf-8b4f-49e1-b0eb-d736fae37118 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:47.403327 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-7cba13bf-8b4f-49e1-b0eb-d736fae37118 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:47.403759 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-7cba13bf-8b4f-49e1-b0eb-d736fae37118 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:47.404485 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-7cba13bf-8b4f-49e1-b0eb-d736fae37118 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:47.404944 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-7cba13bf-8b4f-49e1-b0eb-d736fae37118 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:47.405347 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-7cba13bf-8b4f-49e1-b0eb-d736fae37118 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:47.601093 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-b833386b-eaf6-47a1-bd89-6f4b5eb524e5 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83c1c8fce04c57a685de883344b7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e752c3aef55649ea98ec1a2f3607c27f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:52:47.610489 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-b833386b-eaf6-47a1-bd89-6f4b5eb524e5 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] 10.222.0.36 "GET /compute/v2.1/servers/6490290c-19e1-49db-9190-3b945ece5145" status: 200 len: 1358 microversion: 2.1 time: 0.233567 Oct 15 13:52:47.611381 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 226/459] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:52:47 2022] GET /compute/v2.1/servers/6490290c-19e1-49db-9190-3b945ece5145 => generated 1358 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:52:47.613252 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-7cba13bf-8b4f-49e1-b0eb-d736fae37118 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:52:47.621887 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-7b648649-2b48-4c06-9e5b-e8a3ac31ca57 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:52:47.622642 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-7b648649-2b48-4c06-9e5b-e8a3ac31ca57 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] [instance: 40d67d09-379e-4c12-b36c-21edf3b23e45] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:52:47.622940 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-7cba13bf-8b4f-49e1-b0eb-d736fae37118 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:52:47.624494 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-7cba13bf-8b4f-49e1-b0eb-d736fae37118 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:52:47.625798 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-7cba13bf-8b4f-49e1-b0eb-d736fae37118 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c" status: 200 len: 1723 microversion: 2.20 time: 0.234774 Oct 15 13:52:47.626361 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 234/460] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:52:47 2022] GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c => generated 1723 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 13:52:47.629940 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-7b648649-2b48-4c06-9e5b-e8a3ac31ca57 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:47.630509 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-7b648649-2b48-4c06-9e5b-e8a3ac31ca57 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:47.631092 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-7b648649-2b48-4c06-9e5b-e8a3ac31ca57 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:47.631817 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-7b648649-2b48-4c06-9e5b-e8a3ac31ca57 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:47.632373 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-7b648649-2b48-4c06-9e5b-e8a3ac31ca57 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:47.632885 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-7b648649-2b48-4c06-9e5b-e8a3ac31ca57 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:47.642176 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-ecd9cec6-ce46-438c-a6d7-19008cefb705 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:52:47.642176 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-ecd9cec6-ce46-438c-a6d7-19008cefb705 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] [instance: 1413aaed-46c7-4807-9d3b-957616dd4047] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:52:47.648645 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-ecd9cec6-ce46-438c-a6d7-19008cefb705 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:47.649224 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-ecd9cec6-ce46-438c-a6d7-19008cefb705 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:47.649715 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-ecd9cec6-ce46-438c-a6d7-19008cefb705 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:47.650547 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-ecd9cec6-ce46-438c-a6d7-19008cefb705 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:47.651091 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-ecd9cec6-ce46-438c-a6d7-19008cefb705 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:47.651577 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-ecd9cec6-ce46-438c-a6d7-19008cefb705 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:47.863695 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-7b648649-2b48-4c06-9e5b-e8a3ac31ca57 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583cce1547144e11978f20a3193ceba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f8b5024a194f70a9f7689ac44ab07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:52:47.873411 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-ecd9cec6-ce46-438c-a6d7-19008cefb705 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e530c3f544748bd3ffc256b1630b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a6be8e43c7742be84f4dc3c95a990e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:52:47.873819 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-7b648649-2b48-4c06-9e5b-e8a3ac31ca57 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] 10.222.0.36 "GET /compute/v2.1/servers/40d67d09-379e-4c12-b36c-21edf3b23e45" status: 200 len: 1725 microversion: 2.1 time: 0.255701 Oct 15 13:52:47.874394 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 227/461] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:52:47 2022] GET /compute/v2.1/servers/40d67d09-379e-4c12-b36c-21edf3b23e45 => generated 1725 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:52:47.877169 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG dbcounter [-] [125243] Writing DB stats nova_cell1:SELECT=100 {{(pid=125243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:52:47.888675 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-ecd9cec6-ce46-438c-a6d7-19008cefb705 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] 10.222.0.36 "GET /compute/v2.1/servers/1413aaed-46c7-4807-9d3b-957616dd4047" status: 200 len: 1258 microversion: 2.1 time: 0.252151 Oct 15 13:52:47.889555 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 235/462] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:52:47 2022] GET /compute/v2.1/servers/1413aaed-46c7-4807-9d3b-957616dd4047 => generated 1258 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 13:52:48.633357 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-881bb2e7-e969-4cae-bc0f-cdc3cfe5121f tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:52:48.634009 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-881bb2e7-e969-4cae-bc0f-cdc3cfe5121f tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] [instance: 6490290c-19e1-49db-9190-3b945ece5145] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:52:48.641115 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-881bb2e7-e969-4cae-bc0f-cdc3cfe5121f tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:48.641744 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-881bb2e7-e969-4cae-bc0f-cdc3cfe5121f tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:48.642274 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-881bb2e7-e969-4cae-bc0f-cdc3cfe5121f tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:48.643005 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-881bb2e7-e969-4cae-bc0f-cdc3cfe5121f tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:48.643452 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-881bb2e7-e969-4cae-bc0f-cdc3cfe5121f tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:48.643907 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-881bb2e7-e969-4cae-bc0f-cdc3cfe5121f tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:48.651144 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-957ccb68-dfbb-4b24-a891-36d3ebeacdce tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:52:48.651794 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-957ccb68-dfbb-4b24-a891-36d3ebeacdce tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 5fc359cf-ff2c-4189-b058-31eb3c97568c] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:52:48.659810 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-957ccb68-dfbb-4b24-a891-36d3ebeacdce tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:48.660416 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-957ccb68-dfbb-4b24-a891-36d3ebeacdce tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:48.661272 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-957ccb68-dfbb-4b24-a891-36d3ebeacdce tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:48.662017 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-957ccb68-dfbb-4b24-a891-36d3ebeacdce tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:48.662472 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-957ccb68-dfbb-4b24-a891-36d3ebeacdce tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:48.662894 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-957ccb68-dfbb-4b24-a891-36d3ebeacdce tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:48.879411 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-881bb2e7-e969-4cae-bc0f-cdc3cfe5121f tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83c1c8fce04c57a685de883344b7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e752c3aef55649ea98ec1a2f3607c27f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:52:48.884409 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-957ccb68-dfbb-4b24-a891-36d3ebeacdce tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:52:48.897236 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-957ccb68-dfbb-4b24-a891-36d3ebeacdce tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:52:48.898716 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-957ccb68-dfbb-4b24-a891-36d3ebeacdce tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:52:48.899910 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-957ccb68-dfbb-4b24-a891-36d3ebeacdce tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c" status: 200 len: 1723 microversion: 2.20 time: 0.253003 Oct 15 13:52:48.900407 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-881bb2e7-e969-4cae-bc0f-cdc3cfe5121f tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] 10.222.0.36 "GET /compute/v2.1/servers/6490290c-19e1-49db-9190-3b945ece5145" status: 200 len: 1358 microversion: 2.1 time: 0.270569 Oct 15 13:52:48.900525 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 236/463] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:52:48 2022] GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c => generated 1723 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 13:52:48.907122 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-42fa7733-e08f-4b89-90b0-a305850c8d86 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:52:48.908453 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-42fa7733-e08f-4b89-90b0-a305850c8d86 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] [instance: 40d67d09-379e-4c12-b36c-21edf3b23e45] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:52:48.916007 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 228/464] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:52:48 2022] GET /compute/v2.1/servers/6490290c-19e1-49db-9190-3b945ece5145 => generated 1358 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:52:48.917132 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-dd1fce67-d0a1-4ee9-8d8a-f6188efe2b6e tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:52:48.917815 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-dd1fce67-d0a1-4ee9-8d8a-f6188efe2b6e tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] [instance: 1413aaed-46c7-4807-9d3b-957616dd4047] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:52:48.922644 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-42fa7733-e08f-4b89-90b0-a305850c8d86 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:48.923261 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-42fa7733-e08f-4b89-90b0-a305850c8d86 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:48.924058 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-42fa7733-e08f-4b89-90b0-a305850c8d86 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:48.924787 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-42fa7733-e08f-4b89-90b0-a305850c8d86 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:48.925288 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-42fa7733-e08f-4b89-90b0-a305850c8d86 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:48.925424 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-dd1fce67-d0a1-4ee9-8d8a-f6188efe2b6e tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:48.925759 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-42fa7733-e08f-4b89-90b0-a305850c8d86 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:48.925880 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-dd1fce67-d0a1-4ee9-8d8a-f6188efe2b6e tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:48.926205 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-dd1fce67-d0a1-4ee9-8d8a-f6188efe2b6e tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:48.926906 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-dd1fce67-d0a1-4ee9-8d8a-f6188efe2b6e tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:48.927997 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-dd1fce67-d0a1-4ee9-8d8a-f6188efe2b6e tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:48.927997 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-dd1fce67-d0a1-4ee9-8d8a-f6188efe2b6e tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:49.148848 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-42fa7733-e08f-4b89-90b0-a305850c8d86 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583cce1547144e11978f20a3193ceba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f8b5024a194f70a9f7689ac44ab07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:52:49.158894 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-dd1fce67-d0a1-4ee9-8d8a-f6188efe2b6e tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e530c3f544748bd3ffc256b1630b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a6be8e43c7742be84f4dc3c95a990e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:52:49.159135 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-42fa7733-e08f-4b89-90b0-a305850c8d86 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] 10.222.0.36 "GET /compute/v2.1/servers/40d67d09-379e-4c12-b36c-21edf3b23e45" status: 200 len: 1725 microversion: 2.1 time: 0.257414 Oct 15 13:52:49.159736 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 237/465] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:52:48 2022] GET /compute/v2.1/servers/40d67d09-379e-4c12-b36c-21edf3b23e45 => generated 1725 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:52:49.177983 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-dd1fce67-d0a1-4ee9-8d8a-f6188efe2b6e tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] 10.222.0.36 "GET /compute/v2.1/servers/1413aaed-46c7-4807-9d3b-957616dd4047" status: 200 len: 1258 microversion: 2.1 time: 0.265749 Oct 15 13:52:49.178924 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 229/466] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:52:48 2022] GET /compute/v2.1/servers/1413aaed-46c7-4807-9d3b-957616dd4047 => generated 1258 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:52:49.931408 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-b201dbd0-2715-4a1e-ba61-b9014b8f4f81 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:52:49.931408 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-b201dbd0-2715-4a1e-ba61-b9014b8f4f81 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 5fc359cf-ff2c-4189-b058-31eb3c97568c] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:52:49.940772 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-b201dbd0-2715-4a1e-ba61-b9014b8f4f81 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:49.941600 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-b201dbd0-2715-4a1e-ba61-b9014b8f4f81 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:49.942197 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-b201dbd0-2715-4a1e-ba61-b9014b8f4f81 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:49.945748 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-b6e5924c-6a28-4056-a7ce-9aa1186a7897 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:52:49.947232 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-b201dbd0-2715-4a1e-ba61-b9014b8f4f81 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:49.947817 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-b201dbd0-2715-4a1e-ba61-b9014b8f4f81 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:49.948359 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-b6e5924c-6a28-4056-a7ce-9aa1186a7897 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] [instance: 6490290c-19e1-49db-9190-3b945ece5145] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:52:49.948641 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-b201dbd0-2715-4a1e-ba61-b9014b8f4f81 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:49.964500 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-b6e5924c-6a28-4056-a7ce-9aa1186a7897 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:49.965966 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-b6e5924c-6a28-4056-a7ce-9aa1186a7897 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:49.967026 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-b6e5924c-6a28-4056-a7ce-9aa1186a7897 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:49.969134 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-b6e5924c-6a28-4056-a7ce-9aa1186a7897 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:49.970404 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-b6e5924c-6a28-4056-a7ce-9aa1186a7897 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:49.971399 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-b6e5924c-6a28-4056-a7ce-9aa1186a7897 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:50.241423 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-b201dbd0-2715-4a1e-ba61-b9014b8f4f81 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:52:50.252815 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-b201dbd0-2715-4a1e-ba61-b9014b8f4f81 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:52:50.256035 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-b201dbd0-2715-4a1e-ba61-b9014b8f4f81 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:52:50.257564 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-b201dbd0-2715-4a1e-ba61-b9014b8f4f81 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c" status: 200 len: 1723 microversion: 2.20 time: 0.332216 Oct 15 13:52:50.258819 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 238/467] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:52:49 2022] GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c => generated 1723 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 13:52:50.269037 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-34e24c78-0864-4722-9f09-8db8837e07c4 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:52:50.280156 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-34e24c78-0864-4722-9f09-8db8837e07c4 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] [instance: 40d67d09-379e-4c12-b36c-21edf3b23e45] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:52:50.289718 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-34e24c78-0864-4722-9f09-8db8837e07c4 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:50.290772 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-34e24c78-0864-4722-9f09-8db8837e07c4 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:50.291249 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-34e24c78-0864-4722-9f09-8db8837e07c4 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:50.292158 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-34e24c78-0864-4722-9f09-8db8837e07c4 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:50.292898 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-34e24c78-0864-4722-9f09-8db8837e07c4 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:50.293322 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-34e24c78-0864-4722-9f09-8db8837e07c4 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:50.306457 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-b6e5924c-6a28-4056-a7ce-9aa1186a7897 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83c1c8fce04c57a685de883344b7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e752c3aef55649ea98ec1a2f3607c27f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:52:50.318196 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-b6e5924c-6a28-4056-a7ce-9aa1186a7897 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] 10.222.0.36 "GET /compute/v2.1/servers/6490290c-19e1-49db-9190-3b945ece5145" status: 200 len: 1358 microversion: 2.1 time: 0.383537 Oct 15 13:52:50.318858 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 230/468] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:52:49 2022] GET /compute/v2.1/servers/6490290c-19e1-49db-9190-3b945ece5145 => generated 1358 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:52:50.323928 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-db6e45bb-9d77-470e-83b0-81f0e8ddb7fd tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:52:50.324811 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-db6e45bb-9d77-470e-83b0-81f0e8ddb7fd tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] [instance: 1413aaed-46c7-4807-9d3b-957616dd4047] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:52:50.332566 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-db6e45bb-9d77-470e-83b0-81f0e8ddb7fd tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:50.333348 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-db6e45bb-9d77-470e-83b0-81f0e8ddb7fd tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:50.334025 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-db6e45bb-9d77-470e-83b0-81f0e8ddb7fd tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:50.334948 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-db6e45bb-9d77-470e-83b0-81f0e8ddb7fd tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:50.335939 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-db6e45bb-9d77-470e-83b0-81f0e8ddb7fd tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:50.336620 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-db6e45bb-9d77-470e-83b0-81f0e8ddb7fd tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:50.563855 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-34e24c78-0864-4722-9f09-8db8837e07c4 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583cce1547144e11978f20a3193ceba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f8b5024a194f70a9f7689ac44ab07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:52:50.588015 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-34e24c78-0864-4722-9f09-8db8837e07c4 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] 10.222.0.36 "GET /compute/v2.1/servers/40d67d09-379e-4c12-b36c-21edf3b23e45" status: 200 len: 1725 microversion: 2.1 time: 0.327540 Oct 15 13:52:50.604863 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 239/469] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:52:50 2022] GET /compute/v2.1/servers/40d67d09-379e-4c12-b36c-21edf3b23e45 => generated 1725 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:52:50.680093 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-db6e45bb-9d77-470e-83b0-81f0e8ddb7fd tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e530c3f544748bd3ffc256b1630b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a6be8e43c7742be84f4dc3c95a990e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:52:50.691034 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-db6e45bb-9d77-470e-83b0-81f0e8ddb7fd tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] 10.222.0.36 "GET /compute/v2.1/servers/1413aaed-46c7-4807-9d3b-957616dd4047" status: 200 len: 1258 microversion: 2.1 time: 0.368996 Oct 15 13:52:50.691034 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 231/470] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:52:50 2022] GET /compute/v2.1/servers/1413aaed-46c7-4807-9d3b-957616dd4047 => generated 1258 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:52:51.284399 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-63c5e7a8-f7fa-44a0-8770-79ddd13269bc tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:52:51.285641 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-63c5e7a8-f7fa-44a0-8770-79ddd13269bc tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 5fc359cf-ff2c-4189-b058-31eb3c97568c] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:52:51.296885 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-63c5e7a8-f7fa-44a0-8770-79ddd13269bc tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:51.297858 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-63c5e7a8-f7fa-44a0-8770-79ddd13269bc tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:51.299373 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-63c5e7a8-f7fa-44a0-8770-79ddd13269bc tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:51.300601 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-63c5e7a8-f7fa-44a0-8770-79ddd13269bc tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:51.301499 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-63c5e7a8-f7fa-44a0-8770-79ddd13269bc tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:51.302080 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-63c5e7a8-f7fa-44a0-8770-79ddd13269bc tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:51.348951 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-104b99f1-7412-4b11-a50d-ebd0baa14c4a tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:52:51.353194 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-104b99f1-7412-4b11-a50d-ebd0baa14c4a tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] [instance: 6490290c-19e1-49db-9190-3b945ece5145] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:52:51.371768 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-104b99f1-7412-4b11-a50d-ebd0baa14c4a tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:51.376352 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-104b99f1-7412-4b11-a50d-ebd0baa14c4a tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:51.378425 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-104b99f1-7412-4b11-a50d-ebd0baa14c4a tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:51.379308 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-104b99f1-7412-4b11-a50d-ebd0baa14c4a tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:51.381732 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-104b99f1-7412-4b11-a50d-ebd0baa14c4a tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:51.383274 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-104b99f1-7412-4b11-a50d-ebd0baa14c4a tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:51.654615 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-63c5e7a8-f7fa-44a0-8770-79ddd13269bc tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:52:51.664116 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-63c5e7a8-f7fa-44a0-8770-79ddd13269bc tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:52:51.666341 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-63c5e7a8-f7fa-44a0-8770-79ddd13269bc tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:52:51.668259 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-63c5e7a8-f7fa-44a0-8770-79ddd13269bc tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c" status: 200 len: 1723 microversion: 2.20 time: 0.389242 Oct 15 13:52:51.670951 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 240/471] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:52:51 2022] GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c => generated 1723 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 13:52:51.677211 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-eeff8169-3796-4b0d-af08-3b540b224b87 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:52:51.678381 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-eeff8169-3796-4b0d-af08-3b540b224b87 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] [instance: 40d67d09-379e-4c12-b36c-21edf3b23e45] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:52:51.703810 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-eeff8169-3796-4b0d-af08-3b540b224b87 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:51.704345 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-eeff8169-3796-4b0d-af08-3b540b224b87 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:51.704784 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-eeff8169-3796-4b0d-af08-3b540b224b87 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:51.708619 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-eeff8169-3796-4b0d-af08-3b540b224b87 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:51.709154 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-eeff8169-3796-4b0d-af08-3b540b224b87 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:51.709615 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-eeff8169-3796-4b0d-af08-3b540b224b87 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:51.747859 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-104b99f1-7412-4b11-a50d-ebd0baa14c4a tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83c1c8fce04c57a685de883344b7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e752c3aef55649ea98ec1a2f3607c27f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:52:51.757128 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-104b99f1-7412-4b11-a50d-ebd0baa14c4a tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] 10.222.0.36 "GET /compute/v2.1/servers/6490290c-19e1-49db-9190-3b945ece5145" status: 200 len: 1358 microversion: 2.1 time: 0.418475 Oct 15 13:52:51.757715 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 232/472] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:52:51 2022] GET /compute/v2.1/servers/6490290c-19e1-49db-9190-3b945ece5145 => generated 1358 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 13:52:51.763253 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-13ba223b-3fe1-45ff-b2ac-e5c52e546426 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:52:51.763998 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-13ba223b-3fe1-45ff-b2ac-e5c52e546426 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] [instance: 1413aaed-46c7-4807-9d3b-957616dd4047] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:52:51.775196 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-13ba223b-3fe1-45ff-b2ac-e5c52e546426 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:51.775196 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-13ba223b-3fe1-45ff-b2ac-e5c52e546426 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:51.775196 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-13ba223b-3fe1-45ff-b2ac-e5c52e546426 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:51.775196 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-13ba223b-3fe1-45ff-b2ac-e5c52e546426 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:51.775795 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-13ba223b-3fe1-45ff-b2ac-e5c52e546426 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:51.775795 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-13ba223b-3fe1-45ff-b2ac-e5c52e546426 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:51.969559 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-eeff8169-3796-4b0d-af08-3b540b224b87 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583cce1547144e11978f20a3193ceba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f8b5024a194f70a9f7689ac44ab07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:52:51.979273 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-eeff8169-3796-4b0d-af08-3b540b224b87 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] 10.222.0.36 "GET /compute/v2.1/servers/40d67d09-379e-4c12-b36c-21edf3b23e45" status: 200 len: 1725 microversion: 2.1 time: 0.306884 Oct 15 13:52:51.980055 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 241/473] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:52:51 2022] GET /compute/v2.1/servers/40d67d09-379e-4c12-b36c-21edf3b23e45 => generated 1725 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:52:51.985576 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-13ba223b-3fe1-45ff-b2ac-e5c52e546426 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e530c3f544748bd3ffc256b1630b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a6be8e43c7742be84f4dc3c95a990e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:52:51.993844 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-13ba223b-3fe1-45ff-b2ac-e5c52e546426 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] 10.222.0.36 "GET /compute/v2.1/servers/1413aaed-46c7-4807-9d3b-957616dd4047" status: 200 len: 1258 microversion: 2.1 time: 0.234186 Oct 15 13:52:51.994953 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 233/474] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:52:51 2022] GET /compute/v2.1/servers/1413aaed-46c7-4807-9d3b-957616dd4047 => generated 1258 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:52:52.696963 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-a0375bc6-07e8-4e3f-8f4a-9eb80a9eda42 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:52:52.697612 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-a0375bc6-07e8-4e3f-8f4a-9eb80a9eda42 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 5fc359cf-ff2c-4189-b058-31eb3c97568c] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:52:52.706017 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-a0375bc6-07e8-4e3f-8f4a-9eb80a9eda42 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:52.706517 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-a0375bc6-07e8-4e3f-8f4a-9eb80a9eda42 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:52.706951 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-a0375bc6-07e8-4e3f-8f4a-9eb80a9eda42 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:52.707724 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-a0375bc6-07e8-4e3f-8f4a-9eb80a9eda42 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:52.708145 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-a0375bc6-07e8-4e3f-8f4a-9eb80a9eda42 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:52.708731 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-a0375bc6-07e8-4e3f-8f4a-9eb80a9eda42 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:52.781464 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-098e4f7f-2811-4995-a2ce-d7898294e25e tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:52:52.783125 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-098e4f7f-2811-4995-a2ce-d7898294e25e tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] [instance: 6490290c-19e1-49db-9190-3b945ece5145] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:52:52.790267 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-098e4f7f-2811-4995-a2ce-d7898294e25e tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:52.790753 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-098e4f7f-2811-4995-a2ce-d7898294e25e tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:52.791407 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-098e4f7f-2811-4995-a2ce-d7898294e25e tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:52.792155 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-098e4f7f-2811-4995-a2ce-d7898294e25e tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:52.793701 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-098e4f7f-2811-4995-a2ce-d7898294e25e tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:52.793701 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-098e4f7f-2811-4995-a2ce-d7898294e25e tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:53.294888 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-a0375bc6-07e8-4e3f-8f4a-9eb80a9eda42 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:52:53.311848 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-a0375bc6-07e8-4e3f-8f4a-9eb80a9eda42 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:52:53.315341 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-a0375bc6-07e8-4e3f-8f4a-9eb80a9eda42 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:52:53.317724 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-a0375bc6-07e8-4e3f-8f4a-9eb80a9eda42 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c" status: 200 len: 1723 microversion: 2.20 time: 0.625214 Oct 15 13:52:53.336028 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-098e4f7f-2811-4995-a2ce-d7898294e25e tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83c1c8fce04c57a685de883344b7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e752c3aef55649ea98ec1a2f3607c27f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:52:53.343971 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 242/475] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:52:52 2022] GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c => generated 1723 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 13:52:53.349155 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-7730ed77-9c2f-4bcb-911e-0a6ed0369852 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:52:53.352849 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-098e4f7f-2811-4995-a2ce-d7898294e25e tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] 10.222.0.36 "GET /compute/v2.1/servers/6490290c-19e1-49db-9190-3b945ece5145" status: 200 len: 1358 microversion: 2.1 time: 0.574263 Oct 15 13:52:53.353288 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 234/476] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:52:52 2022] GET /compute/v2.1/servers/6490290c-19e1-49db-9190-3b945ece5145 => generated 1358 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:52:53.357823 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-7730ed77-9c2f-4bcb-911e-0a6ed0369852 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] [instance: 40d67d09-379e-4c12-b36c-21edf3b23e45] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:52:53.358571 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-2faa214a-5c10-48cb-a16f-97c2d77b9924 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:52:53.359277 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-2faa214a-5c10-48cb-a16f-97c2d77b9924 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] [instance: 1413aaed-46c7-4807-9d3b-957616dd4047] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:52:53.366370 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-2faa214a-5c10-48cb-a16f-97c2d77b9924 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:53.367163 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-2faa214a-5c10-48cb-a16f-97c2d77b9924 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:53.367624 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-2faa214a-5c10-48cb-a16f-97c2d77b9924 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:53.368529 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-2faa214a-5c10-48cb-a16f-97c2d77b9924 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:53.369159 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-2faa214a-5c10-48cb-a16f-97c2d77b9924 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:53.369593 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-7730ed77-9c2f-4bcb-911e-0a6ed0369852 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:53.369726 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-2faa214a-5c10-48cb-a16f-97c2d77b9924 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:53.370087 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-7730ed77-9c2f-4bcb-911e-0a6ed0369852 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:53.370517 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-7730ed77-9c2f-4bcb-911e-0a6ed0369852 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:53.371768 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-7730ed77-9c2f-4bcb-911e-0a6ed0369852 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:53.371768 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-7730ed77-9c2f-4bcb-911e-0a6ed0369852 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:53.375910 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-7730ed77-9c2f-4bcb-911e-0a6ed0369852 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:53.592495 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-2faa214a-5c10-48cb-a16f-97c2d77b9924 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e530c3f544748bd3ffc256b1630b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a6be8e43c7742be84f4dc3c95a990e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:52:53.600496 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-7730ed77-9c2f-4bcb-911e-0a6ed0369852 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583cce1547144e11978f20a3193ceba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f8b5024a194f70a9f7689ac44ab07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:52:53.608151 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-2faa214a-5c10-48cb-a16f-97c2d77b9924 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] 10.222.0.36 "GET /compute/v2.1/servers/1413aaed-46c7-4807-9d3b-957616dd4047" status: 200 len: 1258 microversion: 2.1 time: 0.253122 Oct 15 13:52:53.608922 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 235/477] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:52:53 2022] GET /compute/v2.1/servers/1413aaed-46c7-4807-9d3b-957616dd4047 => generated 1258 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:52:53.633189 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-7730ed77-9c2f-4bcb-911e-0a6ed0369852 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] 10.222.0.36 "GET /compute/v2.1/servers/40d67d09-379e-4c12-b36c-21edf3b23e45" status: 200 len: 1725 microversion: 2.1 time: 0.282427 Oct 15 13:52:53.634728 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 243/478] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:52:53 2022] GET /compute/v2.1/servers/40d67d09-379e-4c12-b36c-21edf3b23e45 => generated 1725 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:52:54.345428 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-e7177fcb-6137-4d8c-87f5-7613b517077b tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:52:54.346414 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-e7177fcb-6137-4d8c-87f5-7613b517077b tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 5fc359cf-ff2c-4189-b058-31eb3c97568c] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:52:54.355568 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-e7177fcb-6137-4d8c-87f5-7613b517077b tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:54.357399 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-e7177fcb-6137-4d8c-87f5-7613b517077b tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:54.358086 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-e7177fcb-6137-4d8c-87f5-7613b517077b tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:54.362316 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-e7177fcb-6137-4d8c-87f5-7613b517077b tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:54.364677 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-e7177fcb-6137-4d8c-87f5-7613b517077b tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:54.365792 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-e7177fcb-6137-4d8c-87f5-7613b517077b tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:54.378916 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-3214ae35-a862-4758-b682-6246add7c083 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:52:54.379530 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-3214ae35-a862-4758-b682-6246add7c083 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] [instance: 6490290c-19e1-49db-9190-3b945ece5145] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:52:54.389839 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-3214ae35-a862-4758-b682-6246add7c083 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:54.390338 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-3214ae35-a862-4758-b682-6246add7c083 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:54.390769 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-3214ae35-a862-4758-b682-6246add7c083 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:54.391583 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-3214ae35-a862-4758-b682-6246add7c083 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:54.394574 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-3214ae35-a862-4758-b682-6246add7c083 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:54.395120 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-3214ae35-a862-4758-b682-6246add7c083 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:54.629905 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-e7177fcb-6137-4d8c-87f5-7613b517077b tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:52:54.656604 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-e7177fcb-6137-4d8c-87f5-7613b517077b tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:52:54.658213 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-e7177fcb-6137-4d8c-87f5-7613b517077b tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:52:54.659451 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-e7177fcb-6137-4d8c-87f5-7613b517077b tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c" status: 200 len: 1723 microversion: 2.20 time: 0.318556 Oct 15 13:52:54.667017 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 236/479] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:52:54 2022] GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c => generated 1723 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 13:52:54.672806 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-1a841d13-883e-4060-aee2-cef984c4d92d tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:52:54.673676 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-1a841d13-883e-4060-aee2-cef984c4d92d tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] [instance: 1413aaed-46c7-4807-9d3b-957616dd4047] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:52:54.680175 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-1a841d13-883e-4060-aee2-cef984c4d92d tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:54.680660 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-1a841d13-883e-4060-aee2-cef984c4d92d tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:54.681089 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-1a841d13-883e-4060-aee2-cef984c4d92d tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:54.681789 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-1a841d13-883e-4060-aee2-cef984c4d92d tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:54.682230 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-1a841d13-883e-4060-aee2-cef984c4d92d tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:54.682638 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-1a841d13-883e-4060-aee2-cef984c4d92d tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:54.704424 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-3214ae35-a862-4758-b682-6246add7c083 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83c1c8fce04c57a685de883344b7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e752c3aef55649ea98ec1a2f3607c27f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:52:54.708395 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG dbcounter [-] [125242] Writing DB stats nova_cell1:SELECT=100 {{(pid=125242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:52:54.717318 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-3214ae35-a862-4758-b682-6246add7c083 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] 10.222.0.36 "GET /compute/v2.1/servers/6490290c-19e1-49db-9190-3b945ece5145" status: 200 len: 1358 microversion: 2.1 time: 0.342891 Oct 15 13:52:54.724710 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 244/480] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:52:54 2022] GET /compute/v2.1/servers/6490290c-19e1-49db-9190-3b945ece5145 => generated 1358 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:52:54.742646 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-77211ccd-63ac-4542-81de-9ea619146df1 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:52:54.743725 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-77211ccd-63ac-4542-81de-9ea619146df1 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] [instance: 40d67d09-379e-4c12-b36c-21edf3b23e45] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:52:54.752379 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-77211ccd-63ac-4542-81de-9ea619146df1 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:54.753130 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-77211ccd-63ac-4542-81de-9ea619146df1 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:54.753547 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-77211ccd-63ac-4542-81de-9ea619146df1 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:54.754264 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-77211ccd-63ac-4542-81de-9ea619146df1 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:54.754876 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-77211ccd-63ac-4542-81de-9ea619146df1 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:54.755300 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-77211ccd-63ac-4542-81de-9ea619146df1 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:54.923333 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-1a841d13-883e-4060-aee2-cef984c4d92d tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e530c3f544748bd3ffc256b1630b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a6be8e43c7742be84f4dc3c95a990e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:52:54.932023 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-1a841d13-883e-4060-aee2-cef984c4d92d tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] 10.222.0.36 "GET /compute/v2.1/servers/1413aaed-46c7-4807-9d3b-957616dd4047" status: 200 len: 1258 microversion: 2.1 time: 0.263431 Oct 15 13:52:54.932729 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 237/481] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:52:54 2022] GET /compute/v2.1/servers/1413aaed-46c7-4807-9d3b-957616dd4047 => generated 1258 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:52:54.959439 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-77211ccd-63ac-4542-81de-9ea619146df1 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583cce1547144e11978f20a3193ceba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f8b5024a194f70a9f7689ac44ab07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:52:54.968607 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-77211ccd-63ac-4542-81de-9ea619146df1 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] 10.222.0.36 "GET /compute/v2.1/servers/40d67d09-379e-4c12-b36c-21edf3b23e45" status: 200 len: 1702 microversion: 2.1 time: 0.242650 Oct 15 13:52:54.969332 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 245/482] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:52:54 2022] GET /compute/v2.1/servers/40d67d09-379e-4c12-b36c-21edf3b23e45 => generated 1702 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:52:54.992671 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-bb9148af-21bf-48ca-b266-71e38c9a9d9c tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 13:52:55.000033 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-bb9148af-21bf-48ca-b266-71e38c9a9d9c tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:55.000676 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-bb9148af-21bf-48ca-b266-71e38c9a9d9c tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:55.001489 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-bb9148af-21bf-48ca-b266-71e38c9a9d9c tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:55.064068 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-bb9148af-21bf-48ca-b266-71e38c9a9d9c tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] [instance: 40d67d09-379e-4c12-b36c-21edf3b23e45] Going to try to start instance {{(pid=125242) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 15 13:52:55.110821 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-bb9148af-21bf-48ca-b266-71e38c9a9d9c tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] 10.222.0.36 "POST /compute/v2.1/servers/40d67d09-379e-4c12-b36c-21edf3b23e45/action" status: 202 len: 0 microversion: 2.1 time: 0.122164 Oct 15 13:52:55.111488 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 238/483] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 15 13:52:54 2022] POST /compute/v2.1/servers/40d67d09-379e-4c12-b36c-21edf3b23e45/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 15 13:52:55.119794 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-a4345f8f-e9e0-4ff3-bdbf-3cfa41660692 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:52:55.120445 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-a4345f8f-e9e0-4ff3-bdbf-3cfa41660692 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] [instance: 40d67d09-379e-4c12-b36c-21edf3b23e45] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:52:55.126746 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-a4345f8f-e9e0-4ff3-bdbf-3cfa41660692 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:55.127227 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-a4345f8f-e9e0-4ff3-bdbf-3cfa41660692 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:55.127651 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-a4345f8f-e9e0-4ff3-bdbf-3cfa41660692 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:55.128388 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-a4345f8f-e9e0-4ff3-bdbf-3cfa41660692 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:55.128832 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-a4345f8f-e9e0-4ff3-bdbf-3cfa41660692 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:55.129247 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-a4345f8f-e9e0-4ff3-bdbf-3cfa41660692 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:55.272839 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-a4345f8f-e9e0-4ff3-bdbf-3cfa41660692 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583cce1547144e11978f20a3193ceba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f8b5024a194f70a9f7689ac44ab07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:52:55.285800 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-a4345f8f-e9e0-4ff3-bdbf-3cfa41660692 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] 10.222.0.36 "GET /compute/v2.1/servers/40d67d09-379e-4c12-b36c-21edf3b23e45" status: 200 len: 1711 microversion: 2.1 time: 0.169862 Oct 15 13:52:55.286638 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 246/484] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:52:55 2022] GET /compute/v2.1/servers/40d67d09-379e-4c12-b36c-21edf3b23e45 => generated 1711 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:52:55.690140 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-534afefe-956f-4174-8d8c-6e6be197510b tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:52:55.691511 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-534afefe-956f-4174-8d8c-6e6be197510b tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 5fc359cf-ff2c-4189-b058-31eb3c97568c] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:52:55.699034 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-534afefe-956f-4174-8d8c-6e6be197510b tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:55.701722 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-534afefe-956f-4174-8d8c-6e6be197510b tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:55.701996 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-534afefe-956f-4174-8d8c-6e6be197510b tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:55.702730 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-534afefe-956f-4174-8d8c-6e6be197510b tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:55.703184 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-534afefe-956f-4174-8d8c-6e6be197510b tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:55.705841 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-534afefe-956f-4174-8d8c-6e6be197510b tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:55.744478 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-307a1f1c-39dc-40b5-9882-39b34b508046 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:52:55.746176 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-307a1f1c-39dc-40b5-9882-39b34b508046 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] [instance: 6490290c-19e1-49db-9190-3b945ece5145] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:52:55.769497 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-307a1f1c-39dc-40b5-9882-39b34b508046 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:55.774315 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-307a1f1c-39dc-40b5-9882-39b34b508046 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:55.775618 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-307a1f1c-39dc-40b5-9882-39b34b508046 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:55.776636 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-307a1f1c-39dc-40b5-9882-39b34b508046 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:55.777933 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-307a1f1c-39dc-40b5-9882-39b34b508046 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:55.779202 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-307a1f1c-39dc-40b5-9882-39b34b508046 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:56.058362 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-534afefe-956f-4174-8d8c-6e6be197510b tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:52:56.068264 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-534afefe-956f-4174-8d8c-6e6be197510b tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:52:56.079804 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-534afefe-956f-4174-8d8c-6e6be197510b tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:52:56.080831 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-534afefe-956f-4174-8d8c-6e6be197510b tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c" status: 200 len: 1723 microversion: 2.20 time: 0.398345 Oct 15 13:52:56.081812 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 239/485] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:52:55 2022] GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c => generated 1723 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 13:52:56.095372 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-283b024a-1d4f-4530-8841-73979bd8dff7 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:52:56.096466 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-283b024a-1d4f-4530-8841-73979bd8dff7 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] [instance: 1413aaed-46c7-4807-9d3b-957616dd4047] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:52:56.105959 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-283b024a-1d4f-4530-8841-73979bd8dff7 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:56.112596 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-283b024a-1d4f-4530-8841-73979bd8dff7 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:56.113212 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-283b024a-1d4f-4530-8841-73979bd8dff7 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:56.114092 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-283b024a-1d4f-4530-8841-73979bd8dff7 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:56.114692 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-283b024a-1d4f-4530-8841-73979bd8dff7 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:56.115220 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-283b024a-1d4f-4530-8841-73979bd8dff7 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:56.262339 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-307a1f1c-39dc-40b5-9882-39b34b508046 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83c1c8fce04c57a685de883344b7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e752c3aef55649ea98ec1a2f3607c27f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:52:56.274384 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-307a1f1c-39dc-40b5-9882-39b34b508046 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] 10.222.0.36 "GET /compute/v2.1/servers/6490290c-19e1-49db-9190-3b945ece5145" status: 200 len: 1358 microversion: 2.1 time: 0.533852 Oct 15 13:52:56.275143 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 247/486] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:52:55 2022] GET /compute/v2.1/servers/6490290c-19e1-49db-9190-3b945ece5145 => generated 1358 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:52:56.309999 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-20ce2a2b-7f25-4d3c-a769-d9369aed8843 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:52:56.310761 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-20ce2a2b-7f25-4d3c-a769-d9369aed8843 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] [instance: 40d67d09-379e-4c12-b36c-21edf3b23e45] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:52:56.321323 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-20ce2a2b-7f25-4d3c-a769-d9369aed8843 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:56.322086 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-20ce2a2b-7f25-4d3c-a769-d9369aed8843 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:56.324721 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-20ce2a2b-7f25-4d3c-a769-d9369aed8843 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:56.325728 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-20ce2a2b-7f25-4d3c-a769-d9369aed8843 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:56.326213 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-20ce2a2b-7f25-4d3c-a769-d9369aed8843 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:56.326724 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-20ce2a2b-7f25-4d3c-a769-d9369aed8843 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:56.545857 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-283b024a-1d4f-4530-8841-73979bd8dff7 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e530c3f544748bd3ffc256b1630b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a6be8e43c7742be84f4dc3c95a990e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:52:56.554420 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-283b024a-1d4f-4530-8841-73979bd8dff7 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] 10.222.0.36 "GET /compute/v2.1/servers/1413aaed-46c7-4807-9d3b-957616dd4047" status: 200 len: 1258 microversion: 2.1 time: 0.471051 Oct 15 13:52:56.570815 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 240/487] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:52:56 2022] GET /compute/v2.1/servers/1413aaed-46c7-4807-9d3b-957616dd4047 => generated 1258 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:52:56.725483 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-20ce2a2b-7f25-4d3c-a769-d9369aed8843 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583cce1547144e11978f20a3193ceba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f8b5024a194f70a9f7689ac44ab07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:52:56.738010 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-20ce2a2b-7f25-4d3c-a769-d9369aed8843 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] 10.222.0.36 "GET /compute/v2.1/servers/40d67d09-379e-4c12-b36c-21edf3b23e45" status: 200 len: 1711 microversion: 2.1 time: 0.431853 Oct 15 13:52:56.741802 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 248/488] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:52:56 2022] GET /compute/v2.1/servers/40d67d09-379e-4c12-b36c-21edf3b23e45 => generated 1711 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 13:52:57.109712 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-de3ca155-f023-47dd-9141-4433cc1a20d8 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:52:57.111510 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-de3ca155-f023-47dd-9141-4433cc1a20d8 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 5fc359cf-ff2c-4189-b058-31eb3c97568c] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:52:57.119100 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-de3ca155-f023-47dd-9141-4433cc1a20d8 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:57.119911 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-de3ca155-f023-47dd-9141-4433cc1a20d8 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:57.120609 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-de3ca155-f023-47dd-9141-4433cc1a20d8 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:57.121492 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-de3ca155-f023-47dd-9141-4433cc1a20d8 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:57.122201 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-de3ca155-f023-47dd-9141-4433cc1a20d8 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:57.122858 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-de3ca155-f023-47dd-9141-4433cc1a20d8 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:57.300351 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-deab417b-1761-4663-901e-8111bcba04b5 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:52:57.300986 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-deab417b-1761-4663-901e-8111bcba04b5 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] [instance: 6490290c-19e1-49db-9190-3b945ece5145] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:52:57.315854 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-deab417b-1761-4663-901e-8111bcba04b5 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:57.316664 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-deab417b-1761-4663-901e-8111bcba04b5 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:57.317262 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-deab417b-1761-4663-901e-8111bcba04b5 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:57.318184 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-deab417b-1761-4663-901e-8111bcba04b5 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:57.319055 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-deab417b-1761-4663-901e-8111bcba04b5 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:57.320012 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-deab417b-1761-4663-901e-8111bcba04b5 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:57.527982 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-de3ca155-f023-47dd-9141-4433cc1a20d8 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:52:57.539868 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-de3ca155-f023-47dd-9141-4433cc1a20d8 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:52:57.541447 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-de3ca155-f023-47dd-9141-4433cc1a20d8 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:52:57.542610 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-de3ca155-f023-47dd-9141-4433cc1a20d8 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c" status: 200 len: 1744 microversion: 2.20 time: 0.437238 Oct 15 13:52:57.559232 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 241/489] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:52:57 2022] GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c => generated 1744 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 13:52:57.600853 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-3691d138-8b2e-484a-ad67-de2b21341d72 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:52:57.604570 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-3691d138-8b2e-484a-ad67-de2b21341d72 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] [instance: 1413aaed-46c7-4807-9d3b-957616dd4047] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:52:57.626384 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-3691d138-8b2e-484a-ad67-de2b21341d72 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:57.632151 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-3691d138-8b2e-484a-ad67-de2b21341d72 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:57.633162 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-3691d138-8b2e-484a-ad67-de2b21341d72 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:57.634280 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-3691d138-8b2e-484a-ad67-de2b21341d72 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:57.635121 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-3691d138-8b2e-484a-ad67-de2b21341d72 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:57.635912 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-3691d138-8b2e-484a-ad67-de2b21341d72 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:57.637100 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-deab417b-1761-4663-901e-8111bcba04b5 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83c1c8fce04c57a685de883344b7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e752c3aef55649ea98ec1a2f3607c27f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:52:57.646331 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-deab417b-1761-4663-901e-8111bcba04b5 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] 10.222.0.36 "GET /compute/v2.1/servers/6490290c-19e1-49db-9190-3b945ece5145" status: 200 len: 1358 microversion: 2.1 time: 0.350763 Oct 15 13:52:57.646929 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 249/490] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:52:57 2022] GET /compute/v2.1/servers/6490290c-19e1-49db-9190-3b945ece5145 => generated 1358 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:52:57.768542 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-e58acd9a-a203-4651-b9b9-b60890c9f8fa tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:52:57.769363 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-e58acd9a-a203-4651-b9b9-b60890c9f8fa tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] [instance: 40d67d09-379e-4c12-b36c-21edf3b23e45] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:52:57.790867 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-e58acd9a-a203-4651-b9b9-b60890c9f8fa tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:57.791759 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-e58acd9a-a203-4651-b9b9-b60890c9f8fa tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:57.795217 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-e58acd9a-a203-4651-b9b9-b60890c9f8fa tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:57.800604 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-e58acd9a-a203-4651-b9b9-b60890c9f8fa tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:57.802234 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-e58acd9a-a203-4651-b9b9-b60890c9f8fa tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:57.803658 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-e58acd9a-a203-4651-b9b9-b60890c9f8fa tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:58.083500 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-3691d138-8b2e-484a-ad67-de2b21341d72 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e530c3f544748bd3ffc256b1630b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a6be8e43c7742be84f4dc3c95a990e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:52:58.105967 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-3691d138-8b2e-484a-ad67-de2b21341d72 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] 10.222.0.36 "GET /compute/v2.1/servers/1413aaed-46c7-4807-9d3b-957616dd4047" status: 200 len: 1258 microversion: 2.1 time: 0.527286 Oct 15 13:52:58.107838 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 242/491] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:52:57 2022] GET /compute/v2.1/servers/1413aaed-46c7-4807-9d3b-957616dd4047 => generated 1258 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:52:58.186481 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-e58acd9a-a203-4651-b9b9-b60890c9f8fa tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583cce1547144e11978f20a3193ceba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f8b5024a194f70a9f7689ac44ab07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:52:58.196931 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-e58acd9a-a203-4651-b9b9-b60890c9f8fa tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] 10.222.0.36 "GET /compute/v2.1/servers/40d67d09-379e-4c12-b36c-21edf3b23e45" status: 200 len: 1711 microversion: 2.1 time: 0.433733 Oct 15 13:52:58.198071 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 250/492] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:52:57 2022] GET /compute/v2.1/servers/40d67d09-379e-4c12-b36c-21edf3b23e45 => generated 1711 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:52:58.573335 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-16df44b3-c6c3-431b-a88f-a1119ecbf306 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:52:58.575422 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-16df44b3-c6c3-431b-a88f-a1119ecbf306 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 5fc359cf-ff2c-4189-b058-31eb3c97568c] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:52:58.584302 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-16df44b3-c6c3-431b-a88f-a1119ecbf306 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:58.585855 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-16df44b3-c6c3-431b-a88f-a1119ecbf306 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:58.586497 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-16df44b3-c6c3-431b-a88f-a1119ecbf306 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:58.588919 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-16df44b3-c6c3-431b-a88f-a1119ecbf306 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:58.591824 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-16df44b3-c6c3-431b-a88f-a1119ecbf306 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:58.593083 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-16df44b3-c6c3-431b-a88f-a1119ecbf306 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:58.671560 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-8c69a957-1a88-4417-8ff6-489dff8285ef tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:52:58.674380 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-8c69a957-1a88-4417-8ff6-489dff8285ef tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] [instance: 6490290c-19e1-49db-9190-3b945ece5145] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:52:58.708099 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-8c69a957-1a88-4417-8ff6-489dff8285ef tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:58.710501 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-8c69a957-1a88-4417-8ff6-489dff8285ef tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:58.711668 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-8c69a957-1a88-4417-8ff6-489dff8285ef tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:58.713508 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-8c69a957-1a88-4417-8ff6-489dff8285ef tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:58.717207 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-8c69a957-1a88-4417-8ff6-489dff8285ef tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:58.718592 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-8c69a957-1a88-4417-8ff6-489dff8285ef tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:58.999645 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-16df44b3-c6c3-431b-a88f-a1119ecbf306 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:52:59.013903 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-16df44b3-c6c3-431b-a88f-a1119ecbf306 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:52:59.021406 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-16df44b3-c6c3-431b-a88f-a1119ecbf306 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:52:59.022950 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-16df44b3-c6c3-431b-a88f-a1119ecbf306 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c" status: 200 len: 1744 microversion: 2.20 time: 0.454015 Oct 15 13:52:59.036786 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 243/493] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:52:58 2022] GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c => generated 1744 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 13:52:59.146125 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-6145b148-ad23-4f52-932e-cd53b84727bb tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:52:59.146974 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-6145b148-ad23-4f52-932e-cd53b84727bb tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] [instance: 1413aaed-46c7-4807-9d3b-957616dd4047] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:52:59.154601 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-6145b148-ad23-4f52-932e-cd53b84727bb tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:59.155104 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-6145b148-ad23-4f52-932e-cd53b84727bb tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:59.155550 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-6145b148-ad23-4f52-932e-cd53b84727bb tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:59.156340 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-6145b148-ad23-4f52-932e-cd53b84727bb tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:59.170639 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-6145b148-ad23-4f52-932e-cd53b84727bb tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:59.172565 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-6145b148-ad23-4f52-932e-cd53b84727bb tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:59.201808 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-8c69a957-1a88-4417-8ff6-489dff8285ef tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83c1c8fce04c57a685de883344b7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e752c3aef55649ea98ec1a2f3607c27f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:52:59.220039 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-8c69a957-1a88-4417-8ff6-489dff8285ef tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] 10.222.0.36 "GET /compute/v2.1/servers/6490290c-19e1-49db-9190-3b945ece5145" status: 200 len: 1358 microversion: 2.1 time: 0.552521 Oct 15 13:52:59.221036 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 251/494] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:52:58 2022] GET /compute/v2.1/servers/6490290c-19e1-49db-9190-3b945ece5145 => generated 1358 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 13:52:59.233292 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-f120aab6-9060-470c-aa84-af6c87bf2f47 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:52:59.234357 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-f120aab6-9060-470c-aa84-af6c87bf2f47 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] [instance: 40d67d09-379e-4c12-b36c-21edf3b23e45] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:52:59.245753 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-f120aab6-9060-470c-aa84-af6c87bf2f47 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:59.249833 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-f120aab6-9060-470c-aa84-af6c87bf2f47 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:59.250292 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-f120aab6-9060-470c-aa84-af6c87bf2f47 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:59.251379 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-f120aab6-9060-470c-aa84-af6c87bf2f47 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:52:59.251705 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-f120aab6-9060-470c-aa84-af6c87bf2f47 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:52:59.256395 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-f120aab6-9060-470c-aa84-af6c87bf2f47 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:52:59.291789 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG dbcounter [-] [125243] Writing DB stats nova_cell1:SELECT=100 {{(pid=125243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:52:59.533309 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-6145b148-ad23-4f52-932e-cd53b84727bb tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e530c3f544748bd3ffc256b1630b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a6be8e43c7742be84f4dc3c95a990e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:52:59.566084 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-6145b148-ad23-4f52-932e-cd53b84727bb tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] 10.222.0.36 "GET /compute/v2.1/servers/1413aaed-46c7-4807-9d3b-957616dd4047" status: 200 len: 1258 microversion: 2.1 time: 0.423537 Oct 15 13:52:59.585962 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 244/495] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:52:59 2022] GET /compute/v2.1/servers/1413aaed-46c7-4807-9d3b-957616dd4047 => generated 1258 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:52:59.607399 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-f120aab6-9060-470c-aa84-af6c87bf2f47 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583cce1547144e11978f20a3193ceba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f8b5024a194f70a9f7689ac44ab07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:52:59.618007 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-f120aab6-9060-470c-aa84-af6c87bf2f47 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] 10.222.0.36 "GET /compute/v2.1/servers/40d67d09-379e-4c12-b36c-21edf3b23e45" status: 200 len: 1711 microversion: 2.1 time: 0.395581 Oct 15 13:52:59.625243 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 252/496] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:52:59 2022] GET /compute/v2.1/servers/40d67d09-379e-4c12-b36c-21edf3b23e45 => generated 1711 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:53:00.069802 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-88fea835-ea43-4208-8911-3a99e6b3f6f5 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:53:00.074742 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-88fea835-ea43-4208-8911-3a99e6b3f6f5 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 5fc359cf-ff2c-4189-b058-31eb3c97568c] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:53:00.093646 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-88fea835-ea43-4208-8911-3a99e6b3f6f5 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:00.099451 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-88fea835-ea43-4208-8911-3a99e6b3f6f5 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:00.104298 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-88fea835-ea43-4208-8911-3a99e6b3f6f5 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:00.105739 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-88fea835-ea43-4208-8911-3a99e6b3f6f5 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:00.108348 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-88fea835-ea43-4208-8911-3a99e6b3f6f5 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:00.109333 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-88fea835-ea43-4208-8911-3a99e6b3f6f5 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:00.248854 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-15d3d7a4-b362-4572-a02f-a04ba4acddb0 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:53:00.254443 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-15d3d7a4-b362-4572-a02f-a04ba4acddb0 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] [instance: 6490290c-19e1-49db-9190-3b945ece5145] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:53:00.288287 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-15d3d7a4-b362-4572-a02f-a04ba4acddb0 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:00.289220 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-15d3d7a4-b362-4572-a02f-a04ba4acddb0 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:00.290539 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-15d3d7a4-b362-4572-a02f-a04ba4acddb0 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:00.293091 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-15d3d7a4-b362-4572-a02f-a04ba4acddb0 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:00.297148 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-15d3d7a4-b362-4572-a02f-a04ba4acddb0 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:00.298932 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-15d3d7a4-b362-4572-a02f-a04ba4acddb0 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:00.330558 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-88fea835-ea43-4208-8911-3a99e6b3f6f5 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:53:00.342698 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-88fea835-ea43-4208-8911-3a99e6b3f6f5 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:53:00.345830 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-88fea835-ea43-4208-8911-3a99e6b3f6f5 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:53:00.347685 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-88fea835-ea43-4208-8911-3a99e6b3f6f5 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c" status: 200 len: 1744 microversion: 2.20 time: 0.286068 Oct 15 13:53:00.349000 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 245/497] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:53:00 2022] GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c => generated 1744 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 13:53:00.603342 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-d78257b3-d71b-4b76-8ac2-3b4f825ee028 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:53:00.620241 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-d78257b3-d71b-4b76-8ac2-3b4f825ee028 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] [instance: 1413aaed-46c7-4807-9d3b-957616dd4047] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:53:00.635032 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-d78257b3-d71b-4b76-8ac2-3b4f825ee028 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:00.635853 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-d78257b3-d71b-4b76-8ac2-3b4f825ee028 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:00.636629 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-d78257b3-d71b-4b76-8ac2-3b4f825ee028 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:00.659138 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-d78257b3-d71b-4b76-8ac2-3b4f825ee028 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:00.667610 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-d78257b3-d71b-4b76-8ac2-3b4f825ee028 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:00.668963 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-d78257b3-d71b-4b76-8ac2-3b4f825ee028 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:00.851010 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-15d3d7a4-b362-4572-a02f-a04ba4acddb0 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83c1c8fce04c57a685de883344b7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e752c3aef55649ea98ec1a2f3607c27f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:53:00.862974 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-15d3d7a4-b362-4572-a02f-a04ba4acddb0 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] 10.222.0.36 "GET /compute/v2.1/servers/6490290c-19e1-49db-9190-3b945ece5145" status: 200 len: 1358 microversion: 2.1 time: 0.618860 Oct 15 13:53:00.864075 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 253/498] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:53:00 2022] GET /compute/v2.1/servers/6490290c-19e1-49db-9190-3b945ece5145 => generated 1358 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:53:00.869717 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-cce29e0c-6b54-4b39-9769-eead655a54d2 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:53:00.871130 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-cce29e0c-6b54-4b39-9769-eead655a54d2 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] [instance: 40d67d09-379e-4c12-b36c-21edf3b23e45] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:53:00.882328 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-cce29e0c-6b54-4b39-9769-eead655a54d2 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:00.883288 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-cce29e0c-6b54-4b39-9769-eead655a54d2 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:00.884096 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-cce29e0c-6b54-4b39-9769-eead655a54d2 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:00.885165 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-cce29e0c-6b54-4b39-9769-eead655a54d2 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:00.885875 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-cce29e0c-6b54-4b39-9769-eead655a54d2 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:00.886707 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-cce29e0c-6b54-4b39-9769-eead655a54d2 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:01.199789 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-d78257b3-d71b-4b76-8ac2-3b4f825ee028 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e530c3f544748bd3ffc256b1630b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a6be8e43c7742be84f4dc3c95a990e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:53:01.221554 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-d78257b3-d71b-4b76-8ac2-3b4f825ee028 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] 10.222.0.36 "GET /compute/v2.1/servers/1413aaed-46c7-4807-9d3b-957616dd4047" status: 200 len: 1258 microversion: 2.1 time: 0.622638 Oct 15 13:53:01.222503 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-cce29e0c-6b54-4b39-9769-eead655a54d2 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583cce1547144e11978f20a3193ceba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f8b5024a194f70a9f7689ac44ab07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:53:01.230040 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 246/499] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:53:00 2022] GET /compute/v2.1/servers/1413aaed-46c7-4807-9d3b-957616dd4047 => generated 1258 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 13:53:01.235204 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-cce29e0c-6b54-4b39-9769-eead655a54d2 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] 10.222.0.36 "GET /compute/v2.1/servers/40d67d09-379e-4c12-b36c-21edf3b23e45" status: 200 len: 1715 microversion: 2.1 time: 0.369642 Oct 15 13:53:01.237177 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 254/500] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:53:00 2022] GET /compute/v2.1/servers/40d67d09-379e-4c12-b36c-21edf3b23e45 => generated 1715 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:53:01.384347 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-9ae56e8c-e8fa-479b-b0fd-cc27cdede6aa tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:53:01.385435 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-9ae56e8c-e8fa-479b-b0fd-cc27cdede6aa tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 5fc359cf-ff2c-4189-b058-31eb3c97568c] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:53:01.414640 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-9ae56e8c-e8fa-479b-b0fd-cc27cdede6aa tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:01.418577 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-9ae56e8c-e8fa-479b-b0fd-cc27cdede6aa tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:01.419465 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-9ae56e8c-e8fa-479b-b0fd-cc27cdede6aa tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:01.421250 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-9ae56e8c-e8fa-479b-b0fd-cc27cdede6aa tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:01.422037 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-9ae56e8c-e8fa-479b-b0fd-cc27cdede6aa tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:01.422836 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-9ae56e8c-e8fa-479b-b0fd-cc27cdede6aa tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:01.806059 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-9ae56e8c-e8fa-479b-b0fd-cc27cdede6aa tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:53:01.829010 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-9ae56e8c-e8fa-479b-b0fd-cc27cdede6aa tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:53:01.830912 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-9ae56e8c-e8fa-479b-b0fd-cc27cdede6aa tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:53:01.841619 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-9ae56e8c-e8fa-479b-b0fd-cc27cdede6aa tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c" status: 200 len: 1744 microversion: 2.20 time: 0.468424 Oct 15 13:53:01.845216 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 247/501] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:53:01 2022] GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c => generated 1744 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 13:53:01.887436 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-d611727f-5f47-46cb-8836-a472a0bc7697 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:53:01.889854 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-d611727f-5f47-46cb-8836-a472a0bc7697 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] [instance: 6490290c-19e1-49db-9190-3b945ece5145] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:53:01.898423 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-d611727f-5f47-46cb-8836-a472a0bc7697 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:01.899414 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-d611727f-5f47-46cb-8836-a472a0bc7697 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:01.900117 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-d611727f-5f47-46cb-8836-a472a0bc7697 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:01.901157 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-d611727f-5f47-46cb-8836-a472a0bc7697 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:01.901890 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-d611727f-5f47-46cb-8836-a472a0bc7697 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:01.902532 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-d611727f-5f47-46cb-8836-a472a0bc7697 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:02.214204 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-d611727f-5f47-46cb-8836-a472a0bc7697 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83c1c8fce04c57a685de883344b7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e752c3aef55649ea98ec1a2f3607c27f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:53:02.229279 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-d611727f-5f47-46cb-8836-a472a0bc7697 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] 10.222.0.36 "GET /compute/v2.1/servers/6490290c-19e1-49db-9190-3b945ece5145" status: 200 len: 1358 microversion: 2.1 time: 0.345153 Oct 15 13:53:02.231393 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 255/502] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:53:01 2022] GET /compute/v2.1/servers/6490290c-19e1-49db-9190-3b945ece5145 => generated 1358 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:53:02.251459 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-b1e2c3e0-d651-4616-9922-2f1ebfc1a6ec tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:53:02.252615 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-b1e2c3e0-d651-4616-9922-2f1ebfc1a6ec tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] [instance: 1413aaed-46c7-4807-9d3b-957616dd4047] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:53:02.268319 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-b1e2c3e0-d651-4616-9922-2f1ebfc1a6ec tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:02.269249 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-b1e2c3e0-d651-4616-9922-2f1ebfc1a6ec tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:02.270408 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-b1e2c3e0-d651-4616-9922-2f1ebfc1a6ec tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:02.273534 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-b1e2c3e0-d651-4616-9922-2f1ebfc1a6ec tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:02.274188 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-b1e2c3e0-d651-4616-9922-2f1ebfc1a6ec tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:02.274631 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-b1e2c3e0-d651-4616-9922-2f1ebfc1a6ec tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:02.518629 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-b1e2c3e0-d651-4616-9922-2f1ebfc1a6ec tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e530c3f544748bd3ffc256b1630b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a6be8e43c7742be84f4dc3c95a990e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:53:02.529704 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-b1e2c3e0-d651-4616-9922-2f1ebfc1a6ec tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] 10.222.0.36 "GET /compute/v2.1/servers/1413aaed-46c7-4807-9d3b-957616dd4047" status: 200 len: 1258 microversion: 2.1 time: 0.283971 Oct 15 13:53:02.530473 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 248/503] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:53:02 2022] GET /compute/v2.1/servers/1413aaed-46c7-4807-9d3b-957616dd4047 => generated 1258 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:53:02.874664 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-86376cae-030e-4ecd-b966-13fb072d5250 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:53:02.876188 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-86376cae-030e-4ecd-b966-13fb072d5250 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 5fc359cf-ff2c-4189-b058-31eb3c97568c] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:53:02.887746 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-86376cae-030e-4ecd-b966-13fb072d5250 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:02.890637 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-86376cae-030e-4ecd-b966-13fb072d5250 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:02.897898 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-86376cae-030e-4ecd-b966-13fb072d5250 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:02.902198 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-86376cae-030e-4ecd-b966-13fb072d5250 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:02.904936 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-86376cae-030e-4ecd-b966-13fb072d5250 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:02.912656 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-86376cae-030e-4ecd-b966-13fb072d5250 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:03.215420 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [req-527285d1-bc6d-4548-af29-f13225718f17 req-c43adf58-f4b6-4cbf-a46e-680615efbc51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5fc359cf-ff2c-4189-b058-31eb3c97568c", "name": "network-vif-plugged", "status": "completed", "tag": "5a131939-5800-4807-b2cc-42f66041598f"}]} {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 13:53:03.234292 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [req-527285d1-bc6d-4548-af29-f13225718f17 req-c43adf58-f4b6-4cbf-a46e-680615efbc51 service nova] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:03.238019 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [req-527285d1-bc6d-4548-af29-f13225718f17 req-c43adf58-f4b6-4cbf-a46e-680615efbc51 service nova] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:03.238744 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [req-527285d1-bc6d-4548-af29-f13225718f17 req-c43adf58-f4b6-4cbf-a46e-680615efbc51 service nova] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:03.275364 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.compute.server_external_events [req-527285d1-bc6d-4548-af29-f13225718f17 req-c43adf58-f4b6-4cbf-a46e-680615efbc51 service nova] Creating event network-vif-plugged:5a131939-5800-4807-b2cc-42f66041598f for instance 5fc359cf-ff2c-4189-b058-31eb3c97568c on hv-cinder-86149 Oct 15 13:53:03.294879 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [req-527285d1-bc6d-4548-af29-f13225718f17 req-c43adf58-f4b6-4cbf-a46e-680615efbc51 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083501 Oct 15 13:53:03.299621 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 249/504] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 15 13:53:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 13:53:03.304895 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-86376cae-030e-4ecd-b966-13fb072d5250 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:53:03.307683 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-7aaa683d-d127-4c53-9eb0-df346deac6ba tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:53:03.314097 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-7aaa683d-d127-4c53-9eb0-df346deac6ba tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] [instance: 6490290c-19e1-49db-9190-3b945ece5145] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:53:03.323911 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-86376cae-030e-4ecd-b966-13fb072d5250 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:53:03.324514 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-7aaa683d-d127-4c53-9eb0-df346deac6ba tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:03.325248 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-7aaa683d-d127-4c53-9eb0-df346deac6ba tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:03.325707 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-86376cae-030e-4ecd-b966-13fb072d5250 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:53:03.326163 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-7aaa683d-d127-4c53-9eb0-df346deac6ba tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:03.326956 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-86376cae-030e-4ecd-b966-13fb072d5250 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c" status: 200 len: 1744 microversion: 2.20 time: 0.458911 Oct 15 13:53:03.327375 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-7aaa683d-d127-4c53-9eb0-df346deac6ba tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:03.328113 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-7aaa683d-d127-4c53-9eb0-df346deac6ba tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:03.329281 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-7aaa683d-d127-4c53-9eb0-df346deac6ba tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:03.335327 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 256/505] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:53:02 2022] GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c => generated 1744 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 13:53:03.554181 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-a25c2810-1c67-4dff-8085-1fdba9b22d06 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:53:03.555050 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-a25c2810-1c67-4dff-8085-1fdba9b22d06 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] [instance: 1413aaed-46c7-4807-9d3b-957616dd4047] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:53:03.580889 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-a25c2810-1c67-4dff-8085-1fdba9b22d06 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:03.583062 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-a25c2810-1c67-4dff-8085-1fdba9b22d06 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:03.587692 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-a25c2810-1c67-4dff-8085-1fdba9b22d06 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:03.592661 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-a25c2810-1c67-4dff-8085-1fdba9b22d06 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:03.594158 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-a25c2810-1c67-4dff-8085-1fdba9b22d06 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:03.595011 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-a25c2810-1c67-4dff-8085-1fdba9b22d06 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:03.603053 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-7aaa683d-d127-4c53-9eb0-df346deac6ba tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83c1c8fce04c57a685de883344b7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e752c3aef55649ea98ec1a2f3607c27f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:53:03.618185 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-7aaa683d-d127-4c53-9eb0-df346deac6ba tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] 10.222.0.36 "GET /compute/v2.1/servers/6490290c-19e1-49db-9190-3b945ece5145" status: 200 len: 1358 microversion: 2.1 time: 0.316727 Oct 15 13:53:03.619086 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 250/506] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:53:03 2022] GET /compute/v2.1/servers/6490290c-19e1-49db-9190-3b945ece5145 => generated 1358 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:53:03.961570 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-a25c2810-1c67-4dff-8085-1fdba9b22d06 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e530c3f544748bd3ffc256b1630b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a6be8e43c7742be84f4dc3c95a990e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:53:03.972871 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-a25c2810-1c67-4dff-8085-1fdba9b22d06 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] 10.222.0.36 "GET /compute/v2.1/servers/1413aaed-46c7-4807-9d3b-957616dd4047" status: 200 len: 1258 microversion: 2.1 time: 0.423954 Oct 15 13:53:03.973817 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 257/507] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:53:03 2022] GET /compute/v2.1/servers/1413aaed-46c7-4807-9d3b-957616dd4047 => generated 1258 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 13:53:04.357674 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-bb03b396-55da-43b2-857e-27e231c0eb8c tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:53:04.359048 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-bb03b396-55da-43b2-857e-27e231c0eb8c tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 5fc359cf-ff2c-4189-b058-31eb3c97568c] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:53:04.377099 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-bb03b396-55da-43b2-857e-27e231c0eb8c tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:04.377612 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-bb03b396-55da-43b2-857e-27e231c0eb8c tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:04.378250 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-bb03b396-55da-43b2-857e-27e231c0eb8c tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:04.379164 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-bb03b396-55da-43b2-857e-27e231c0eb8c tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:04.379783 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-bb03b396-55da-43b2-857e-27e231c0eb8c tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:04.380392 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-bb03b396-55da-43b2-857e-27e231c0eb8c tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:04.648166 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-3f1cda68-4e9b-469d-a3d4-cb1569a6e789 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:53:04.648848 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-3f1cda68-4e9b-469d-a3d4-cb1569a6e789 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] [instance: 6490290c-19e1-49db-9190-3b945ece5145] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:53:04.664638 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-3f1cda68-4e9b-469d-a3d4-cb1569a6e789 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:04.665165 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-3f1cda68-4e9b-469d-a3d4-cb1569a6e789 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:04.667615 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-3f1cda68-4e9b-469d-a3d4-cb1569a6e789 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:04.669912 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-3f1cda68-4e9b-469d-a3d4-cb1569a6e789 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:04.673433 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-3f1cda68-4e9b-469d-a3d4-cb1569a6e789 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:04.677212 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-3f1cda68-4e9b-469d-a3d4-cb1569a6e789 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:04.682661 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-bb03b396-55da-43b2-857e-27e231c0eb8c tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:53:04.708559 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-bb03b396-55da-43b2-857e-27e231c0eb8c tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:53:04.711478 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-bb03b396-55da-43b2-857e-27e231c0eb8c tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:53:04.720896 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-bb03b396-55da-43b2-857e-27e231c0eb8c tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c" status: 200 len: 1739 microversion: 2.20 time: 0.367818 Oct 15 13:53:04.723049 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 251/508] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:53:04 2022] GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c => generated 1739 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 15 13:53:04.968519 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-3f1cda68-4e9b-469d-a3d4-cb1569a6e789 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83c1c8fce04c57a685de883344b7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e752c3aef55649ea98ec1a2f3607c27f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:53:04.982643 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-3f1cda68-4e9b-469d-a3d4-cb1569a6e789 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] 10.222.0.36 "GET /compute/v2.1/servers/6490290c-19e1-49db-9190-3b945ece5145" status: 200 len: 1358 microversion: 2.1 time: 0.341945 Oct 15 13:53:04.983488 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 258/509] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:53:04 2022] GET /compute/v2.1/servers/6490290c-19e1-49db-9190-3b945ece5145 => generated 1358 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:53:05.003331 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-f02a02ed-e42a-4002-aef7-8c1a462cd5f5 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:53:05.004765 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-f02a02ed-e42a-4002-aef7-8c1a462cd5f5 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] [instance: 1413aaed-46c7-4807-9d3b-957616dd4047] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:53:05.024700 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-f02a02ed-e42a-4002-aef7-8c1a462cd5f5 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:05.025666 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-f02a02ed-e42a-4002-aef7-8c1a462cd5f5 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:05.026423 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-f02a02ed-e42a-4002-aef7-8c1a462cd5f5 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:05.032312 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-f02a02ed-e42a-4002-aef7-8c1a462cd5f5 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:05.033514 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-f02a02ed-e42a-4002-aef7-8c1a462cd5f5 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:05.035515 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-f02a02ed-e42a-4002-aef7-8c1a462cd5f5 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:05.375047 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [req-a26c12cb-b906-49da-a9a4-f1dbc18ff2ee req-d61c32d5-9ad3-48ff-b815-7e6c1f5a62a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1413aaed-46c7-4807-9d3b-957616dd4047", "name": "network-vif-plugged", "status": "completed", "tag": "4b0e8bf4-1aae-4e0a-be03-f2d19fe48439"}]} {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 13:53:05.399947 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [req-a26c12cb-b906-49da-a9a4-f1dbc18ff2ee req-d61c32d5-9ad3-48ff-b815-7e6c1f5a62a9 service nova] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:05.404892 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [req-a26c12cb-b906-49da-a9a4-f1dbc18ff2ee req-d61c32d5-9ad3-48ff-b815-7e6c1f5a62a9 service nova] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:05.408812 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [req-a26c12cb-b906-49da-a9a4-f1dbc18ff2ee req-d61c32d5-9ad3-48ff-b815-7e6c1f5a62a9 service nova] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:05.455590 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.compute.server_external_events [req-a26c12cb-b906-49da-a9a4-f1dbc18ff2ee req-d61c32d5-9ad3-48ff-b815-7e6c1f5a62a9 service nova] Creating event network-vif-plugged:4b0e8bf4-1aae-4e0a-be03-f2d19fe48439 for instance 1413aaed-46c7-4807-9d3b-957616dd4047 on hv-cinder-86149 Oct 15 13:53:05.476067 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [req-a26c12cb-b906-49da-a9a4-f1dbc18ff2ee req-d61c32d5-9ad3-48ff-b815-7e6c1f5a62a9 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099285 Oct 15 13:53:05.477289 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 259/510] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 15 13:53:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 13:53:05.537364 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-f02a02ed-e42a-4002-aef7-8c1a462cd5f5 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e530c3f544748bd3ffc256b1630b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a6be8e43c7742be84f4dc3c95a990e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:53:05.548130 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-f02a02ed-e42a-4002-aef7-8c1a462cd5f5 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] 10.222.0.36 "GET /compute/v2.1/servers/1413aaed-46c7-4807-9d3b-957616dd4047" status: 200 len: 1258 microversion: 2.1 time: 0.552886 Oct 15 13:53:05.551990 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 252/511] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:53:04 2022] GET /compute/v2.1/servers/1413aaed-46c7-4807-9d3b-957616dd4047 => generated 1258 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:53:05.768258 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-4700f7a7-fe0b-45d5-8f70-0293d7e4563c tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:53:05.771645 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-4700f7a7-fe0b-45d5-8f70-0293d7e4563c tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 5fc359cf-ff2c-4189-b058-31eb3c97568c] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:53:05.811515 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-4700f7a7-fe0b-45d5-8f70-0293d7e4563c tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:05.815133 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-4700f7a7-fe0b-45d5-8f70-0293d7e4563c tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:05.817872 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-4700f7a7-fe0b-45d5-8f70-0293d7e4563c tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:05.819169 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-4700f7a7-fe0b-45d5-8f70-0293d7e4563c tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:05.820660 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-4700f7a7-fe0b-45d5-8f70-0293d7e4563c tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:05.823786 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-4700f7a7-fe0b-45d5-8f70-0293d7e4563c tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:06.010097 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-9387e9e3-8ba2-430b-8583-e39fde3d2b66 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:53:06.010824 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-9387e9e3-8ba2-430b-8583-e39fde3d2b66 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] [instance: 6490290c-19e1-49db-9190-3b945ece5145] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:53:06.020772 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-9387e9e3-8ba2-430b-8583-e39fde3d2b66 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:06.022615 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-9387e9e3-8ba2-430b-8583-e39fde3d2b66 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:06.027178 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-9387e9e3-8ba2-430b-8583-e39fde3d2b66 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:06.028320 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-9387e9e3-8ba2-430b-8583-e39fde3d2b66 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:06.030043 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-9387e9e3-8ba2-430b-8583-e39fde3d2b66 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:06.033451 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-9387e9e3-8ba2-430b-8583-e39fde3d2b66 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:06.425567 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-4700f7a7-fe0b-45d5-8f70-0293d7e4563c tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:53:06.471896 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-4700f7a7-fe0b-45d5-8f70-0293d7e4563c tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:53:06.484331 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-4700f7a7-fe0b-45d5-8f70-0293d7e4563c tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:53:06.489107 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-4700f7a7-fe0b-45d5-8f70-0293d7e4563c tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c" status: 200 len: 1739 microversion: 2.20 time: 0.741473 Oct 15 13:53:06.500882 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 260/512] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:53:05 2022] GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c => generated 1739 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 13:53:06.560663 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-9387e9e3-8ba2-430b-8583-e39fde3d2b66 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83c1c8fce04c57a685de883344b7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e752c3aef55649ea98ec1a2f3607c27f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:53:06.568570 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG dbcounter [-] [125242] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:53:06.576136 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-9387e9e3-8ba2-430b-8583-e39fde3d2b66 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] 10.222.0.36 "GET /compute/v2.1/servers/6490290c-19e1-49db-9190-3b945ece5145" status: 200 len: 1358 microversion: 2.1 time: 0.570464 Oct 15 13:53:06.577710 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 253/513] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:53:06 2022] GET /compute/v2.1/servers/6490290c-19e1-49db-9190-3b945ece5145 => generated 1358 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:53:06.599280 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-c2603c63-7c0a-476c-9137-04b3dc9191b9 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:53:06.599965 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-c2603c63-7c0a-476c-9137-04b3dc9191b9 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] [instance: 1413aaed-46c7-4807-9d3b-957616dd4047] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:53:06.612978 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-c2603c63-7c0a-476c-9137-04b3dc9191b9 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:06.613481 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-c2603c63-7c0a-476c-9137-04b3dc9191b9 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:06.615484 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-c2603c63-7c0a-476c-9137-04b3dc9191b9 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:06.619178 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-c2603c63-7c0a-476c-9137-04b3dc9191b9 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:06.620557 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-c2603c63-7c0a-476c-9137-04b3dc9191b9 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:06.621650 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-c2603c63-7c0a-476c-9137-04b3dc9191b9 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:06.800400 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-16a15394-2dbb-4408-82e8-09b2beca24b1 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1119900843", "imageRef": "26e64909-1cae-49ca-af5e-adea40c062d7", "flavorRef": "452", "networks": [{"uuid": "fbb63af8-320e-494a-a4ee-414e6707c733"}]}} {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 13:53:06.944512 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.network.neutron [None req-16a15394-2dbb-4408-82e8-09b2beca24b1 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] validate_networks() for [('fbb63af8-320e-494a-a4ee-414e6707c733', None, None, None, None, None)] {{(pid=125242) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 15 13:53:07.021848 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-c2603c63-7c0a-476c-9137-04b3dc9191b9 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e530c3f544748bd3ffc256b1630b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a6be8e43c7742be84f4dc3c95a990e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:53:07.033794 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-c2603c63-7c0a-476c-9137-04b3dc9191b9 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] 10.222.0.36 "GET /compute/v2.1/servers/1413aaed-46c7-4807-9d3b-957616dd4047" status: 200 len: 1258 microversion: 2.1 time: 0.457722 Oct 15 13:53:07.036203 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 261/514] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:53:06 2022] GET /compute/v2.1/servers/1413aaed-46c7-4807-9d3b-957616dd4047 => generated 1258 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:53:07.528541 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-81ed737b-cc37-4df7-92cf-58bde29c05ae tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:53:07.529259 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-81ed737b-cc37-4df7-92cf-58bde29c05ae tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 5fc359cf-ff2c-4189-b058-31eb3c97568c] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:53:07.540387 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-81ed737b-cc37-4df7-92cf-58bde29c05ae tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:07.551336 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-81ed737b-cc37-4df7-92cf-58bde29c05ae tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:07.552020 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-81ed737b-cc37-4df7-92cf-58bde29c05ae tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:07.552798 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-81ed737b-cc37-4df7-92cf-58bde29c05ae tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:07.553279 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-81ed737b-cc37-4df7-92cf-58bde29c05ae tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:07.553711 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-81ed737b-cc37-4df7-92cf-58bde29c05ae tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:07.716731 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.virt.hardware [None req-16a15394-2dbb-4408-82e8-09b2beca24b1 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Flavor limits 0:0:0 {{(pid=125242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 15 13:53:07.718651 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.virt.hardware [None req-16a15394-2dbb-4408-82e8-09b2beca24b1 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Image limits 0:0:0 {{(pid=125242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 15 13:53:07.719952 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.virt.hardware [None req-16a15394-2dbb-4408-82e8-09b2beca24b1 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Flavor pref 0:0:0 {{(pid=125242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 15 13:53:07.721171 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.virt.hardware [None req-16a15394-2dbb-4408-82e8-09b2beca24b1 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Image pref 0:0:0 {{(pid=125242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 15 13:53:07.732029 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.virt.hardware [None req-16a15394-2dbb-4408-82e8-09b2beca24b1 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 15 13:53:07.763209 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-16a15394-2dbb-4408-82e8-09b2beca24b1 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:07.767011 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-16a15394-2dbb-4408-82e8-09b2beca24b1 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:07.770042 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-16a15394-2dbb-4408-82e8-09b2beca24b1 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:07.771602 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-16a15394-2dbb-4408-82e8-09b2beca24b1 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:07.773328 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-16a15394-2dbb-4408-82e8-09b2beca24b1 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:07.775020 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-16a15394-2dbb-4408-82e8-09b2beca24b1 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:07.831510 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.quota [None req-16a15394-2dbb-4408-82e8-09b2beca24b1 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Getting quotas for project 190914cc865b4003ab4b735d937e130d. Resources: {'cores', 'ram', 'instances'} {{(pid=125242) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 15 13:53:07.844044 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-81ed737b-cc37-4df7-92cf-58bde29c05ae tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:53:07.848340 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.quota [None req-16a15394-2dbb-4408-82e8-09b2beca24b1 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Getting quotas for user 707bd577eee14892990367f396270f7b and project 190914cc865b4003ab4b735d937e130d. Resources: {'cores', 'ram', 'instances'} {{(pid=125242) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 15 13:53:07.866562 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-81ed737b-cc37-4df7-92cf-58bde29c05ae tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:53:07.871336 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-81ed737b-cc37-4df7-92cf-58bde29c05ae tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:53:07.873494 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-81ed737b-cc37-4df7-92cf-58bde29c05ae tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c" status: 200 len: 1739 microversion: 2.20 time: 0.348914 Oct 15 13:53:07.905477 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-16a15394-2dbb-4408-82e8-09b2beca24b1 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Going to run 1 instances... {{(pid=125242) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 15 13:53:07.905477 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-16a15394-2dbb-4408-82e8-09b2beca24b1 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] [instance: d6ce134b-a723-453b-8847-b0725e969e89] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='26e64909-1cae-49ca-af5e-adea40c062d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125242) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 15 13:53:07.918332 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 262/515] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:53:07 2022] GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c => generated 1739 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 13:53:07.924791 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [req-15b72524-935c-4c47-9131-2c10653a80cc req-705272ca-91ce-4233-9c16-c7171bf3c131 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6490290c-19e1-49db-9190-3b945ece5145", "name": "network-vif-plugged", "status": "completed", "tag": "3f885321-034d-42f2-a8c5-c0315db5a5eb"}]} {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 13:53:07.939583 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [req-15b72524-935c-4c47-9131-2c10653a80cc req-705272ca-91ce-4233-9c16-c7171bf3c131 service nova] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:07.941379 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [req-15b72524-935c-4c47-9131-2c10653a80cc req-705272ca-91ce-4233-9c16-c7171bf3c131 service nova] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:07.942481 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [req-15b72524-935c-4c47-9131-2c10653a80cc req-705272ca-91ce-4233-9c16-c7171bf3c131 service nova] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:07.992749 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.compute.server_external_events [req-15b72524-935c-4c47-9131-2c10653a80cc req-705272ca-91ce-4233-9c16-c7171bf3c131 service nova] Creating event network-vif-plugged:3f885321-034d-42f2-a8c5-c0315db5a5eb for instance 6490290c-19e1-49db-9190-3b945ece5145 on hv-cinder-86149 Oct 15 13:53:08.014134 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [req-15b72524-935c-4c47-9131-2c10653a80cc req-705272ca-91ce-4233-9c16-c7171bf3c131 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093747 Oct 15 13:53:08.015273 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 263/516] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 15 13:53:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 13:53:08.028302 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-3820466d-d9d5-4026-a82c-841aa2c0ec19 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:53:08.036249 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-3820466d-d9d5-4026-a82c-841aa2c0ec19 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] [instance: 6490290c-19e1-49db-9190-3b945ece5145] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:53:08.051694 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-3820466d-d9d5-4026-a82c-841aa2c0ec19 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:08.052502 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-3820466d-d9d5-4026-a82c-841aa2c0ec19 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:08.053201 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-3820466d-d9d5-4026-a82c-841aa2c0ec19 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:08.053675 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-16a15394-2dbb-4408-82e8-09b2beca24b1 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.260216 Oct 15 13:53:08.054152 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-3820466d-d9d5-4026-a82c-841aa2c0ec19 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:08.054358 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 254/517] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 15 13:53:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 1262 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 15 13:53:08.061967 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-3820466d-d9d5-4026-a82c-841aa2c0ec19 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:08.063333 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-3820466d-d9d5-4026-a82c-841aa2c0ec19 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:08.073631 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-6c217408-3c53-49dd-be79-84f0bd8da42f tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:53:08.074254 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-6c217408-3c53-49dd-be79-84f0bd8da42f tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] [instance: 1413aaed-46c7-4807-9d3b-957616dd4047] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:53:08.135286 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-6c217408-3c53-49dd-be79-84f0bd8da42f tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:08.136297 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-6c217408-3c53-49dd-be79-84f0bd8da42f tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:08.136765 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-6c217408-3c53-49dd-be79-84f0bd8da42f tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:08.139243 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-6c217408-3c53-49dd-be79-84f0bd8da42f tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:08.139737 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-6c217408-3c53-49dd-be79-84f0bd8da42f tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:08.140220 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-6c217408-3c53-49dd-be79-84f0bd8da42f tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:08.831076 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-3820466d-d9d5-4026-a82c-841aa2c0ec19 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83c1c8fce04c57a685de883344b7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e752c3aef55649ea98ec1a2f3607c27f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:53:08.847903 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-3820466d-d9d5-4026-a82c-841aa2c0ec19 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] 10.222.0.36 "GET /compute/v2.1/servers/6490290c-19e1-49db-9190-3b945ece5145" status: 200 len: 1358 microversion: 2.1 time: 0.830115 Oct 15 13:53:08.848918 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 264/518] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:53:08 2022] GET /compute/v2.1/servers/6490290c-19e1-49db-9190-3b945ece5145 => generated 1358 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:53:08.868676 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-6c217408-3c53-49dd-be79-84f0bd8da42f tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e530c3f544748bd3ffc256b1630b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a6be8e43c7742be84f4dc3c95a990e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:53:08.873388 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-3f1d3130-6cf2-49fb-a7c5-d77a80099d9e tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:53:08.874572 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-3f1d3130-6cf2-49fb-a7c5-d77a80099d9e tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] [instance: d6ce134b-a723-453b-8847-b0725e969e89] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:53:08.883462 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-6c217408-3c53-49dd-be79-84f0bd8da42f tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] 10.222.0.36 "GET /compute/v2.1/servers/1413aaed-46c7-4807-9d3b-957616dd4047" status: 200 len: 1258 microversion: 2.1 time: 0.815979 Oct 15 13:53:08.900361 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 255/519] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:53:08 2022] GET /compute/v2.1/servers/1413aaed-46c7-4807-9d3b-957616dd4047 => generated 1258 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:53:08.914254 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-81a3e55b-26f5-489e-8a2f-9ae4b50e4eca tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:53:08.915166 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-81a3e55b-26f5-489e-8a2f-9ae4b50e4eca tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 5fc359cf-ff2c-4189-b058-31eb3c97568c] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:53:08.936564 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-81a3e55b-26f5-489e-8a2f-9ae4b50e4eca tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:08.937507 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-81a3e55b-26f5-489e-8a2f-9ae4b50e4eca tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:08.941112 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-81a3e55b-26f5-489e-8a2f-9ae4b50e4eca tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:08.942155 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-81a3e55b-26f5-489e-8a2f-9ae4b50e4eca tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:08.948540 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-81a3e55b-26f5-489e-8a2f-9ae4b50e4eca tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:08.949348 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-81a3e55b-26f5-489e-8a2f-9ae4b50e4eca tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:09.073004 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-3f1d3130-6cf2-49fb-a7c5-d77a80099d9e tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707bd577eee14892990367f396270f7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '190914cc865b4003ab4b735d937e130d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:53:09.092718 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-3f1d3130-6cf2-49fb-a7c5-d77a80099d9e tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] 10.222.0.36 "GET /compute/v2.1/servers/d6ce134b-a723-453b-8847-b0725e969e89" status: 200 len: 1219 microversion: 2.1 time: 0.240880 Oct 15 13:53:09.095206 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 265/520] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:53:08 2022] GET /compute/v2.1/servers/d6ce134b-a723-453b-8847-b0725e969e89 => generated 1219 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:53:09.530803 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-81a3e55b-26f5-489e-8a2f-9ae4b50e4eca tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:53:09.552397 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-81a3e55b-26f5-489e-8a2f-9ae4b50e4eca tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:53:09.554241 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-81a3e55b-26f5-489e-8a2f-9ae4b50e4eca tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:53:09.560863 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-81a3e55b-26f5-489e-8a2f-9ae4b50e4eca tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c" status: 200 len: 1739 microversion: 2.20 time: 0.645626 Oct 15 13:53:09.572443 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 256/521] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:53:08 2022] GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c => generated 1739 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 13:53:09.896536 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-9162f2d1-4d20-47f6-864b-c7f83c30b9ee tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:53:09.898393 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-9162f2d1-4d20-47f6-864b-c7f83c30b9ee tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] [instance: 6490290c-19e1-49db-9190-3b945ece5145] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:53:09.924095 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-9162f2d1-4d20-47f6-864b-c7f83c30b9ee tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:09.927748 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-9162f2d1-4d20-47f6-864b-c7f83c30b9ee tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:09.932490 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-9162f2d1-4d20-47f6-864b-c7f83c30b9ee tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:09.944111 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-9162f2d1-4d20-47f6-864b-c7f83c30b9ee tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:09.944881 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-504658a6-254b-4513-8502-9f9d5be278e1 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:53:09.946226 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-504658a6-254b-4513-8502-9f9d5be278e1 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] [instance: 1413aaed-46c7-4807-9d3b-957616dd4047] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:53:09.948317 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-9162f2d1-4d20-47f6-864b-c7f83c30b9ee tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:09.951144 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-9162f2d1-4d20-47f6-864b-c7f83c30b9ee tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:09.958361 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-504658a6-254b-4513-8502-9f9d5be278e1 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:09.961208 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-504658a6-254b-4513-8502-9f9d5be278e1 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:09.961627 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-504658a6-254b-4513-8502-9f9d5be278e1 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:09.963727 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-504658a6-254b-4513-8502-9f9d5be278e1 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:09.966330 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-504658a6-254b-4513-8502-9f9d5be278e1 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:09.969666 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-504658a6-254b-4513-8502-9f9d5be278e1 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:10.321493 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-504658a6-254b-4513-8502-9f9d5be278e1 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e530c3f544748bd3ffc256b1630b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a6be8e43c7742be84f4dc3c95a990e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:53:10.341423 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-504658a6-254b-4513-8502-9f9d5be278e1 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] 10.222.0.36 "GET /compute/v2.1/servers/1413aaed-46c7-4807-9d3b-957616dd4047" status: 200 len: 1443 microversion: 2.1 time: 0.401891 Oct 15 13:53:10.360557 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 257/522] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:53:09 2022] GET /compute/v2.1/servers/1413aaed-46c7-4807-9d3b-957616dd4047 => generated 1443 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 13:53:10.364240 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-85713a6f-345e-47de-b3c8-b3f1eded4a6a tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:53:10.368556 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-85713a6f-345e-47de-b3c8-b3f1eded4a6a tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] [instance: d6ce134b-a723-453b-8847-b0725e969e89] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:53:10.394711 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-85713a6f-345e-47de-b3c8-b3f1eded4a6a tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:10.395598 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-9162f2d1-4d20-47f6-864b-c7f83c30b9ee tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83c1c8fce04c57a685de883344b7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e752c3aef55649ea98ec1a2f3607c27f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:53:10.396605 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-85713a6f-345e-47de-b3c8-b3f1eded4a6a tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:10.403261 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-85713a6f-345e-47de-b3c8-b3f1eded4a6a tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:10.405594 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-85713a6f-345e-47de-b3c8-b3f1eded4a6a tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:10.407965 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-85713a6f-345e-47de-b3c8-b3f1eded4a6a tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:10.412278 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-85713a6f-345e-47de-b3c8-b3f1eded4a6a tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:10.414101 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-9162f2d1-4d20-47f6-864b-c7f83c30b9ee tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] 10.222.0.36 "GET /compute/v2.1/servers/6490290c-19e1-49db-9190-3b945ece5145" status: 200 len: 1358 microversion: 2.1 time: 0.525552 Oct 15 13:53:10.430070 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 266/523] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:53:09 2022] GET /compute/v2.1/servers/6490290c-19e1-49db-9190-3b945ece5145 => generated 1358 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:53:10.452031 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-1b64d08a-4f92-439d-b28c-99a5006746cc tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:53:10.454410 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-1b64d08a-4f92-439d-b28c-99a5006746cc tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] [instance: 1413aaed-46c7-4807-9d3b-957616dd4047] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:53:10.470056 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-1b64d08a-4f92-439d-b28c-99a5006746cc tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:10.470913 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-1b64d08a-4f92-439d-b28c-99a5006746cc tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:10.471945 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-1b64d08a-4f92-439d-b28c-99a5006746cc tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:10.473317 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-1b64d08a-4f92-439d-b28c-99a5006746cc tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:10.474499 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-1b64d08a-4f92-439d-b28c-99a5006746cc tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:10.475430 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-1b64d08a-4f92-439d-b28c-99a5006746cc tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:10.514214 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-85713a6f-345e-47de-b3c8-b3f1eded4a6a tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707bd577eee14892990367f396270f7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '190914cc865b4003ab4b735d937e130d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:53:10.526412 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-85713a6f-345e-47de-b3c8-b3f1eded4a6a tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] 10.222.0.36 "GET /compute/v2.1/servers/d6ce134b-a723-453b-8847-b0725e969e89" status: 200 len: 1215 microversion: 2.1 time: 0.179113 Oct 15 13:53:10.527435 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 258/524] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:53:10 2022] GET /compute/v2.1/servers/d6ce134b-a723-453b-8847-b0725e969e89 => generated 1215 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:53:10.788439 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-1b64d08a-4f92-439d-b28c-99a5006746cc tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e530c3f544748bd3ffc256b1630b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a6be8e43c7742be84f4dc3c95a990e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:53:10.802792 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-1b64d08a-4f92-439d-b28c-99a5006746cc tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] 10.222.0.36 "GET /compute/v2.1/servers/1413aaed-46c7-4807-9d3b-957616dd4047" status: 200 len: 1443 microversion: 2.1 time: 0.370907 Oct 15 13:53:10.804209 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 267/525] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:53:10 2022] GET /compute/v2.1/servers/1413aaed-46c7-4807-9d3b-957616dd4047 => generated 1443 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:53:10.808568 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-e51228d9-d208-4068-b258-226efa702d2b tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:53:10.809119 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-e51228d9-d208-4068-b258-226efa702d2b tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 5fc359cf-ff2c-4189-b058-31eb3c97568c] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:53:10.825010 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-e51228d9-d208-4068-b258-226efa702d2b tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:10.825578 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-e51228d9-d208-4068-b258-226efa702d2b tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:10.826196 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-e51228d9-d208-4068-b258-226efa702d2b tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:10.826976 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-e51228d9-d208-4068-b258-226efa702d2b tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:10.827418 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-e51228d9-d208-4068-b258-226efa702d2b tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:10.827846 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-e51228d9-d208-4068-b258-226efa702d2b tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:10.970917 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-0fcd2cd2-65ad-444e-ac0e-22f5ad0e1fa2 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Action: 'create', calling method: .version_select at 0x7f1b5e2c5790>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1731665434", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBML9L+egBPPbURbfUbQJhFnP8G4tZ007uX65vX2fP7LE/lo9El1nk+aS2FitAYm8ERdQzFHJUSBJFLVenLZ9U+tCcG9LEoBEMv890gkNfXxREshHiGhFF6jPc24/rwiKw=="}} {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 13:53:10.992509 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.quota [None req-0fcd2cd2-65ad-444e-ac0e-22f5ad0e1fa2 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Getting quotas for project 243c0b9b4bd742659061745c8dc4c696. Resources: {'key_pairs'} {{(pid=125242) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 15 13:53:10.998122 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.quota [None req-0fcd2cd2-65ad-444e-ac0e-22f5ad0e1fa2 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Getting quotas for user 193bf7a17f544770a27c07f6b8cc0988 and project 243c0b9b4bd742659061745c8dc4c696. Resources: {'key_pairs'} {{(pid=125242) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 15 13:53:11.093874 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-0fcd2cd2-65ad-444e-ac0e-22f5ad0e1fa2 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.564376 Oct 15 13:53:11.097065 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 259/526] 10.222.0.36 () {60 vars in 1159 bytes} [Sat Oct 15 13:53:10 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 13:53:11.457932 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-75bbfd02-021e-419f-af0a-3cd20d1488cf tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:53:11.459322 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-75bbfd02-021e-419f-af0a-3cd20d1488cf tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] [instance: 6490290c-19e1-49db-9190-3b945ece5145] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:53:11.499057 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-75bbfd02-021e-419f-af0a-3cd20d1488cf tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:11.506463 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-75bbfd02-021e-419f-af0a-3cd20d1488cf tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:11.510170 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-75bbfd02-021e-419f-af0a-3cd20d1488cf tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:11.516125 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-75bbfd02-021e-419f-af0a-3cd20d1488cf tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:11.517009 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-75bbfd02-021e-419f-af0a-3cd20d1488cf tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:11.518652 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-75bbfd02-021e-419f-af0a-3cd20d1488cf tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:11.534838 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-e51228d9-d208-4068-b258-226efa702d2b tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:53:11.551234 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-e51228d9-d208-4068-b258-226efa702d2b tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:53:11.560361 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-e51228d9-d208-4068-b258-226efa702d2b tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:53:11.561679 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-e51228d9-d208-4068-b258-226efa702d2b tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c" status: 200 len: 1739 microversion: 2.20 time: 0.757005 Oct 15 13:53:11.562506 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 268/527] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:53:10 2022] GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c => generated 1739 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 13:53:11.568380 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-aad01f5c-6dd3-40d3-94b6-de6d9e60c866 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:53:11.574945 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-aad01f5c-6dd3-40d3-94b6-de6d9e60c866 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] [instance: d6ce134b-a723-453b-8847-b0725e969e89] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:53:11.608237 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG dbcounter [-] [125243] Writing DB stats nova_api:SELECT=92 {{(pid=125243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:53:11.612093 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-aad01f5c-6dd3-40d3-94b6-de6d9e60c866 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:11.613157 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-aad01f5c-6dd3-40d3-94b6-de6d9e60c866 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:11.614013 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-aad01f5c-6dd3-40d3-94b6-de6d9e60c866 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:11.615031 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-aad01f5c-6dd3-40d3-94b6-de6d9e60c866 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:11.616003 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-aad01f5c-6dd3-40d3-94b6-de6d9e60c866 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:11.618285 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-aad01f5c-6dd3-40d3-94b6-de6d9e60c866 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:11.780367 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-aad01f5c-6dd3-40d3-94b6-de6d9e60c866 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707bd577eee14892990367f396270f7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '190914cc865b4003ab4b735d937e130d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:53:11.811373 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-aad01f5c-6dd3-40d3-94b6-de6d9e60c866 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] 10.222.0.36 "GET /compute/v2.1/servers/d6ce134b-a723-453b-8847-b0725e969e89" status: 200 len: 1271 microversion: 2.1 time: 0.247171 Oct 15 13:53:11.813890 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 269/528] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:53:11 2022] GET /compute/v2.1/servers/d6ce134b-a723-453b-8847-b0725e969e89 => generated 1271 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:53:11.938328 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-75bbfd02-021e-419f-af0a-3cd20d1488cf tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83c1c8fce04c57a685de883344b7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e752c3aef55649ea98ec1a2f3607c27f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:53:11.948836 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-75bbfd02-021e-419f-af0a-3cd20d1488cf tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] 10.222.0.36 "GET /compute/v2.1/servers/6490290c-19e1-49db-9190-3b945ece5145" status: 200 len: 1549 microversion: 2.1 time: 0.499123 Oct 15 13:53:11.950530 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 260/529] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:53:11 2022] GET /compute/v2.1/servers/6490290c-19e1-49db-9190-3b945ece5145 => generated 1549 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:53:11.976743 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-d5f03977-c660-4e85-bc9e-df0140f52d6d tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:53:11.977888 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-d5f03977-c660-4e85-bc9e-df0140f52d6d tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] [instance: 6490290c-19e1-49db-9190-3b945ece5145] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:53:11.986759 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-d5f03977-c660-4e85-bc9e-df0140f52d6d tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:11.987574 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-d5f03977-c660-4e85-bc9e-df0140f52d6d tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:11.988339 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-d5f03977-c660-4e85-bc9e-df0140f52d6d tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:11.989286 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-d5f03977-c660-4e85-bc9e-df0140f52d6d tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:11.989866 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-d5f03977-c660-4e85-bc9e-df0140f52d6d tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:11.990414 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-d5f03977-c660-4e85-bc9e-df0140f52d6d tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:12.321462 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-d5f03977-c660-4e85-bc9e-df0140f52d6d tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83c1c8fce04c57a685de883344b7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e752c3aef55649ea98ec1a2f3607c27f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:53:12.336636 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-d5f03977-c660-4e85-bc9e-df0140f52d6d tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] 10.222.0.36 "GET /compute/v2.1/servers/6490290c-19e1-49db-9190-3b945ece5145" status: 200 len: 1549 microversion: 2.1 time: 0.364192 Oct 15 13:53:12.338092 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 270/530] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:53:11 2022] GET /compute/v2.1/servers/6490290c-19e1-49db-9190-3b945ece5145 => generated 1549 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:53:12.362500 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-bc8cccce-544b-4980-8de7-58706537e11f tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:53:12.373716 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-bc8cccce-544b-4980-8de7-58706537e11f tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'dc83c1c8fce04c57a685de883344b7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e752c3aef55649ea98ec1a2f3607c27f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:53:12.405304 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-bc8cccce-544b-4980-8de7-58706537e11f tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Searching by: {'deleted': False, 'project_id': 'e752c3aef55649ea98ec1a2f3607c27f'} {{(pid=125242) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 15 13:53:12.437219 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-bc8cccce-544b-4980-8de7-58706537e11f tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:12.437693 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-bc8cccce-544b-4980-8de7-58706537e11f tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:12.438218 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-bc8cccce-544b-4980-8de7-58706537e11f tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:12.438940 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-bc8cccce-544b-4980-8de7-58706537e11f tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:12.439590 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-bc8cccce-544b-4980-8de7-58706537e11f tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:12.449703 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-bc8cccce-544b-4980-8de7-58706537e11f tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:12.591271 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-c35d43ef-6c15-4f7b-9878-d5caedc8b36f tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:53:12.593303 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-c35d43ef-6c15-4f7b-9878-d5caedc8b36f tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 5fc359cf-ff2c-4189-b058-31eb3c97568c] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:53:12.609552 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-c35d43ef-6c15-4f7b-9878-d5caedc8b36f tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:12.610350 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-c35d43ef-6c15-4f7b-9878-d5caedc8b36f tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:12.610849 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-c35d43ef-6c15-4f7b-9878-d5caedc8b36f tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:12.612004 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-c35d43ef-6c15-4f7b-9878-d5caedc8b36f tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:12.612604 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-c35d43ef-6c15-4f7b-9878-d5caedc8b36f tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:12.613121 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-c35d43ef-6c15-4f7b-9878-d5caedc8b36f tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:12.619091 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.multi_cell_list [None req-bc8cccce-544b-4980-8de7-58706537e11f tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=125242) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 15 13:53:12.659052 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG dbcounter [-] [125243] Writing DB stats nova_cell1:SELECT=100 {{(pid=125243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:53:12.869329 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-bc8cccce-544b-4980-8de7-58706537e11f tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] 10.222.0.36 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.511716 Oct 15 13:53:12.877980 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 261/531] 10.222.0.36 () {58 vars in 1125 bytes} [Sat Oct 15 13:53:12 2022] GET /compute/v2.1/servers => generated 342 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 13:53:12.883439 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-fc8e70c7-3846-4ef5-a3f8-8f11e6308b5c tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:53:12.885045 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-fc8e70c7-3846-4ef5-a3f8-8f11e6308b5c tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] [instance: d6ce134b-a723-453b-8847-b0725e969e89] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:53:12.891253 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG dbcounter [-] [125242] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=125242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:53:12.893329 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-fc8e70c7-3846-4ef5-a3f8-8f11e6308b5c tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:12.894479 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-fc8e70c7-3846-4ef5-a3f8-8f11e6308b5c tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:12.895160 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-fc8e70c7-3846-4ef5-a3f8-8f11e6308b5c tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:12.896149 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-fc8e70c7-3846-4ef5-a3f8-8f11e6308b5c tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:12.896809 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-fc8e70c7-3846-4ef5-a3f8-8f11e6308b5c tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:12.897425 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-fc8e70c7-3846-4ef5-a3f8-8f11e6308b5c tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:13.086364 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-c35d43ef-6c15-4f7b-9878-d5caedc8b36f tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:53:13.105224 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-fc8e70c7-3846-4ef5-a3f8-8f11e6308b5c tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707bd577eee14892990367f396270f7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '190914cc865b4003ab4b735d937e130d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:53:13.118712 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-fc8e70c7-3846-4ef5-a3f8-8f11e6308b5c tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] 10.222.0.36 "GET /compute/v2.1/servers/d6ce134b-a723-453b-8847-b0725e969e89" status: 200 len: 1277 microversion: 2.1 time: 0.239178 Oct 15 13:53:13.119608 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 262/532] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:53:12 2022] GET /compute/v2.1/servers/d6ce134b-a723-453b-8847-b0725e969e89 => generated 1277 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:53:13.137940 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-c35d43ef-6c15-4f7b-9878-d5caedc8b36f tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:53:13.137940 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-c35d43ef-6c15-4f7b-9878-d5caedc8b36f tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:53:13.144842 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-c35d43ef-6c15-4f7b-9878-d5caedc8b36f tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c" status: 200 len: 1739 microversion: 2.20 time: 0.560312 Oct 15 13:53:13.151587 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 271/533] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:53:12 2022] GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c => generated 1739 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 13:53:13.165788 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-32dfa7bb-4b1a-4bdd-b3c4-b1241f32e261 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:53:13.166409 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-32dfa7bb-4b1a-4bdd-b3c4-b1241f32e261 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] [instance: 6490290c-19e1-49db-9190-3b945ece5145] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:53:13.179426 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-32dfa7bb-4b1a-4bdd-b3c4-b1241f32e261 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:13.179996 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-32dfa7bb-4b1a-4bdd-b3c4-b1241f32e261 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:13.180561 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-32dfa7bb-4b1a-4bdd-b3c4-b1241f32e261 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:13.181534 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-32dfa7bb-4b1a-4bdd-b3c4-b1241f32e261 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:13.181981 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-32dfa7bb-4b1a-4bdd-b3c4-b1241f32e261 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:13.182575 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-32dfa7bb-4b1a-4bdd-b3c4-b1241f32e261 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:13.571604 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-32dfa7bb-4b1a-4bdd-b3c4-b1241f32e261 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83c1c8fce04c57a685de883344b7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e752c3aef55649ea98ec1a2f3607c27f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:53:13.584778 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-32dfa7bb-4b1a-4bdd-b3c4-b1241f32e261 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] 10.222.0.36 "GET /compute/v2.1/servers/6490290c-19e1-49db-9190-3b945ece5145" status: 200 len: 1549 microversion: 2.1 time: 0.443020 Oct 15 13:53:13.585550 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 263/534] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:53:13 2022] GET /compute/v2.1/servers/6490290c-19e1-49db-9190-3b945ece5145 => generated 1549 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:53:14.142691 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-2f96171a-964c-4e48-bd2b-01db1c7a2e19 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:53:14.143592 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-2f96171a-964c-4e48-bd2b-01db1c7a2e19 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] [instance: d6ce134b-a723-453b-8847-b0725e969e89] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:53:14.163586 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-2f96171a-964c-4e48-bd2b-01db1c7a2e19 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:14.165617 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-2f96171a-964c-4e48-bd2b-01db1c7a2e19 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:14.171553 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-2f96171a-964c-4e48-bd2b-01db1c7a2e19 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:14.179492 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-2f3a2539-b832-4d26-a511-810e1adc776d tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:53:14.180538 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-2f3a2539-b832-4d26-a511-810e1adc776d tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 5fc359cf-ff2c-4189-b058-31eb3c97568c] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:53:14.187303 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-2f96171a-964c-4e48-bd2b-01db1c7a2e19 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:14.188842 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-2f96171a-964c-4e48-bd2b-01db1c7a2e19 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:14.191563 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-2f96171a-964c-4e48-bd2b-01db1c7a2e19 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:14.193227 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-2f3a2539-b832-4d26-a511-810e1adc776d tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:14.205983 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-2f3a2539-b832-4d26-a511-810e1adc776d tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:14.205983 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-2f3a2539-b832-4d26-a511-810e1adc776d tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:14.209291 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-2f3a2539-b832-4d26-a511-810e1adc776d tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:14.211028 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-2f3a2539-b832-4d26-a511-810e1adc776d tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:14.215085 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-2f3a2539-b832-4d26-a511-810e1adc776d tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:14.696740 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-2f3a2539-b832-4d26-a511-810e1adc776d tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:53:14.716031 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-2f3a2539-b832-4d26-a511-810e1adc776d tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:53:14.720623 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-2f3a2539-b832-4d26-a511-810e1adc776d tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:53:14.725359 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-2f3a2539-b832-4d26-a511-810e1adc776d tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c" status: 200 len: 1739 microversion: 2.20 time: 0.549838 Oct 15 13:53:14.749232 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 264/535] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:53:14 2022] GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c => generated 1739 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 15 13:53:14.908807 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-2f96171a-964c-4e48-bd2b-01db1c7a2e19 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707bd577eee14892990367f396270f7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '190914cc865b4003ab4b735d937e130d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:53:14.922069 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-2f96171a-964c-4e48-bd2b-01db1c7a2e19 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] 10.222.0.36 "GET /compute/v2.1/servers/d6ce134b-a723-453b-8847-b0725e969e89" status: 200 len: 1319 microversion: 2.1 time: 0.783792 Oct 15 13:53:14.933100 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 272/536] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:53:14 2022] GET /compute/v2.1/servers/d6ce134b-a723-453b-8847-b0725e969e89 => generated 1319 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:53:15.742123 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-e33895c1-99f8-4afe-bbca-8f33a6ee12d4 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1290f442-4d94-4f2c-a099-95a6910dc895"}} {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 13:53:15.745003 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-e33895c1-99f8-4afe-bbca-8f33a6ee12d4 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] [instance: 6490290c-19e1-49db-9190-3b945ece5145] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:53:15.756981 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-5537065f-ae57-45bb-a5f3-ae40165320d7 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:53:15.757584 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-5537065f-ae57-45bb-a5f3-ae40165320d7 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 5fc359cf-ff2c-4189-b058-31eb3c97568c] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:53:15.772429 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-5537065f-ae57-45bb-a5f3-ae40165320d7 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:15.775085 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-e33895c1-99f8-4afe-bbca-8f33a6ee12d4 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:15.775931 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-5537065f-ae57-45bb-a5f3-ae40165320d7 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:15.776540 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-5537065f-ae57-45bb-a5f3-ae40165320d7 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:15.778969 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-5537065f-ae57-45bb-a5f3-ae40165320d7 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:15.779788 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-e33895c1-99f8-4afe-bbca-8f33a6ee12d4 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:15.781365 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-5537065f-ae57-45bb-a5f3-ae40165320d7 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:15.781952 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-5537065f-ae57-45bb-a5f3-ae40165320d7 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:15.792659 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-e33895c1-99f8-4afe-bbca-8f33a6ee12d4 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:15.793729 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-e33895c1-99f8-4afe-bbca-8f33a6ee12d4 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:15.796086 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-e33895c1-99f8-4afe-bbca-8f33a6ee12d4 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:15.796780 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-e33895c1-99f8-4afe-bbca-8f33a6ee12d4 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:16.409640 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-5537065f-ae57-45bb-a5f3-ae40165320d7 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:53:16.423355 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-5537065f-ae57-45bb-a5f3-ae40165320d7 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:53:16.429186 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-5537065f-ae57-45bb-a5f3-ae40165320d7 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:53:16.430695 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-5537065f-ae57-45bb-a5f3-ae40165320d7 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c" status: 200 len: 1739 microversion: 2.20 time: 0.678436 Oct 15 13:53:16.436509 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 273/537] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:53:15 2022] GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c => generated 1739 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 15 13:53:16.445998 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-87da89fb-443c-4a9c-a953-76c39e8021fb tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:53:16.448708 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-87da89fb-443c-4a9c-a953-76c39e8021fb tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] [instance: d6ce134b-a723-453b-8847-b0725e969e89] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:53:16.465769 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-87da89fb-443c-4a9c-a953-76c39e8021fb tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:16.466277 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-87da89fb-443c-4a9c-a953-76c39e8021fb tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:16.466730 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-87da89fb-443c-4a9c-a953-76c39e8021fb tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:16.467445 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-87da89fb-443c-4a9c-a953-76c39e8021fb tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:16.474357 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-87da89fb-443c-4a9c-a953-76c39e8021fb tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:16.475106 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-87da89fb-443c-4a9c-a953-76c39e8021fb tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:16.680563 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-e33895c1-99f8-4afe-bbca-8f33a6ee12d4 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] 10.222.0.36 "POST /compute/v2.1/servers/6490290c-19e1-49db-9190-3b945ece5145/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.942168 Oct 15 13:53:16.682119 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 265/538] 10.222.0.36 () {60 vars in 1323 bytes} [Sat Oct 15 13:53:15 2022] POST /compute/v2.1/servers/6490290c-19e1-49db-9190-3b945ece5145/os-volume_attachments => generated 194 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 13:53:16.741531 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [req-08ca0fb5-611c-45b7-bf7e-73a2cab8b314 req-8df59109-c184-40d5-9fae-5104d18c0902 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1413aaed-46c7-4807-9d3b-957616dd4047", "tag": "4b0e8bf4-1aae-4e0a-be03-f2d19fe48439"}]} {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 13:53:16.742405 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-87da89fb-443c-4a9c-a953-76c39e8021fb tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707bd577eee14892990367f396270f7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '190914cc865b4003ab4b735d937e130d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:53:16.756298 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-87da89fb-443c-4a9c-a953-76c39e8021fb tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] 10.222.0.36 "GET /compute/v2.1/servers/d6ce134b-a723-453b-8847-b0725e969e89" status: 200 len: 1319 microversion: 2.1 time: 0.318207 Oct 15 13:53:16.761584 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 274/539] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:53:16 2022] GET /compute/v2.1/servers/d6ce134b-a723-453b-8847-b0725e969e89 => generated 1319 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:53:16.773029 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [req-16224e70-9d22-4363-bc32-4b87adc7ba32 req-076668b6-82f8-4832-830d-7d8e5851b680 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6ce134b-a723-453b-8847-b0725e969e89", "tag": "f1f1b2d4-39b0-458c-8883-41eaa4cbab9e"}]} {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 13:53:16.823183 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [req-16224e70-9d22-4363-bc32-4b87adc7ba32 req-076668b6-82f8-4832-830d-7d8e5851b680 service nova] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:16.829922 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [req-16224e70-9d22-4363-bc32-4b87adc7ba32 req-076668b6-82f8-4832-830d-7d8e5851b680 service nova] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:16.830607 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [req-16224e70-9d22-4363-bc32-4b87adc7ba32 req-076668b6-82f8-4832-830d-7d8e5851b680 service nova] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:16.834264 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [req-08ca0fb5-611c-45b7-bf7e-73a2cab8b314 req-8df59109-c184-40d5-9fae-5104d18c0902 service nova] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:16.834868 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [req-08ca0fb5-611c-45b7-bf7e-73a2cab8b314 req-8df59109-c184-40d5-9fae-5104d18c0902 service nova] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:16.835165 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [req-08ca0fb5-611c-45b7-bf7e-73a2cab8b314 req-8df59109-c184-40d5-9fae-5104d18c0902 service nova] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:16.871112 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.compute.server_external_events [req-08ca0fb5-611c-45b7-bf7e-73a2cab8b314 req-8df59109-c184-40d5-9fae-5104d18c0902 service nova] Creating event network-changed:4b0e8bf4-1aae-4e0a-be03-f2d19fe48439 for instance 1413aaed-46c7-4807-9d3b-957616dd4047 on hv-cinder-86149 Oct 15 13:53:16.886176 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [req-08ca0fb5-611c-45b7-bf7e-73a2cab8b314 req-8df59109-c184-40d5-9fae-5104d18c0902 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.201952 Oct 15 13:53:16.889321 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 266/540] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 15 13:53:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 13:53:16.891748 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.compute.server_external_events [req-16224e70-9d22-4363-bc32-4b87adc7ba32 req-076668b6-82f8-4832-830d-7d8e5851b680 service nova] Creating event network-changed:f1f1b2d4-39b0-458c-8883-41eaa4cbab9e for instance d6ce134b-a723-453b-8847-b0725e969e89 on hv-cinder-86149 Oct 15 13:53:16.932000 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [req-16224e70-9d22-4363-bc32-4b87adc7ba32 req-076668b6-82f8-4832-830d-7d8e5851b680 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.161055 Oct 15 13:53:16.934035 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 275/541] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 15 13:53:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 13:53:17.482019 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-b8bc906b-6ddc-4b70-b43d-d6151788c9f1 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:53:17.482730 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-b8bc906b-6ddc-4b70-b43d-d6151788c9f1 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 5fc359cf-ff2c-4189-b058-31eb3c97568c] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:53:17.503318 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-b8bc906b-6ddc-4b70-b43d-d6151788c9f1 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:17.503843 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-b8bc906b-6ddc-4b70-b43d-d6151788c9f1 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:17.504323 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-b8bc906b-6ddc-4b70-b43d-d6151788c9f1 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:17.513614 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-b8bc906b-6ddc-4b70-b43d-d6151788c9f1 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:17.515662 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-b8bc906b-6ddc-4b70-b43d-d6151788c9f1 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:17.516440 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-b8bc906b-6ddc-4b70-b43d-d6151788c9f1 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:17.787300 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-a4fdead6-8e77-492e-8cae-05e66af4f2fb tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:53:17.791224 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-a4fdead6-8e77-492e-8cae-05e66af4f2fb tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] [instance: d6ce134b-a723-453b-8847-b0725e969e89] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:53:17.804144 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-a4fdead6-8e77-492e-8cae-05e66af4f2fb tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:17.804989 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-a4fdead6-8e77-492e-8cae-05e66af4f2fb tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:17.806255 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-a4fdead6-8e77-492e-8cae-05e66af4f2fb tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:17.807246 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-a4fdead6-8e77-492e-8cae-05e66af4f2fb tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:17.807900 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-a4fdead6-8e77-492e-8cae-05e66af4f2fb tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:17.808635 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-a4fdead6-8e77-492e-8cae-05e66af4f2fb tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:18.075830 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-b8bc906b-6ddc-4b70-b43d-d6151788c9f1 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:53:18.102822 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-b8bc906b-6ddc-4b70-b43d-d6151788c9f1 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:53:18.114590 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-b8bc906b-6ddc-4b70-b43d-d6151788c9f1 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:53:18.116935 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-b8bc906b-6ddc-4b70-b43d-d6151788c9f1 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c" status: 200 len: 1739 microversion: 2.20 time: 0.639354 Oct 15 13:53:18.117960 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 267/542] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:53:17 2022] GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c => generated 1739 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 13:53:18.476305 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-a4fdead6-8e77-492e-8cae-05e66af4f2fb tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707bd577eee14892990367f396270f7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '190914cc865b4003ab4b735d937e130d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:53:18.488429 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-a4fdead6-8e77-492e-8cae-05e66af4f2fb tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] 10.222.0.36 "GET /compute/v2.1/servers/d6ce134b-a723-453b-8847-b0725e969e89" status: 200 len: 1319 microversion: 2.1 time: 0.705962 Oct 15 13:53:18.493669 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 276/543] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:53:17 2022] GET /compute/v2.1/servers/d6ce134b-a723-453b-8847-b0725e969e89 => generated 1319 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 13:53:19.172848 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-cff12cdb-9738-4f53-96ae-64d9278c1c38 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:53:19.174445 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-cff12cdb-9738-4f53-96ae-64d9278c1c38 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 5fc359cf-ff2c-4189-b058-31eb3c97568c] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:53:19.185972 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-cff12cdb-9738-4f53-96ae-64d9278c1c38 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:19.192838 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-cff12cdb-9738-4f53-96ae-64d9278c1c38 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:19.194109 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-cff12cdb-9738-4f53-96ae-64d9278c1c38 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:19.195056 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-cff12cdb-9738-4f53-96ae-64d9278c1c38 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:19.197066 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-cff12cdb-9738-4f53-96ae-64d9278c1c38 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:19.198404 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-cff12cdb-9738-4f53-96ae-64d9278c1c38 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:19.506191 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-cff12cdb-9738-4f53-96ae-64d9278c1c38 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:53:19.522268 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-cff12cdb-9738-4f53-96ae-64d9278c1c38 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:53:19.528687 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-cff12cdb-9738-4f53-96ae-64d9278c1c38 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:53:19.531512 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-cff12cdb-9738-4f53-96ae-64d9278c1c38 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c" status: 200 len: 1739 microversion: 2.20 time: 0.363029 Oct 15 13:53:19.551436 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-ed04401d-7d44-4a40-bebe-422d98645f23 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:53:19.552508 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-ed04401d-7d44-4a40-bebe-422d98645f23 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] [instance: d6ce134b-a723-453b-8847-b0725e969e89] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:53:19.557595 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 268/544] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:53:19 2022] GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c => generated 1739 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 13:53:19.564621 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG dbcounter [-] [125243] Writing DB stats nova_cell0:SELECT=2 {{(pid=125243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:53:19.567833 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-ed04401d-7d44-4a40-bebe-422d98645f23 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:19.569128 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-ed04401d-7d44-4a40-bebe-422d98645f23 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:19.570189 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-ed04401d-7d44-4a40-bebe-422d98645f23 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:19.571684 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-ed04401d-7d44-4a40-bebe-422d98645f23 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:19.572733 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-ed04401d-7d44-4a40-bebe-422d98645f23 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:19.573716 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-ed04401d-7d44-4a40-bebe-422d98645f23 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:19.785681 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-ed04401d-7d44-4a40-bebe-422d98645f23 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707bd577eee14892990367f396270f7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '190914cc865b4003ab4b735d937e130d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:53:19.796133 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-ed04401d-7d44-4a40-bebe-422d98645f23 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] 10.222.0.36 "GET /compute/v2.1/servers/d6ce134b-a723-453b-8847-b0725e969e89" status: 200 len: 1319 microversion: 2.1 time: 0.259868 Oct 15 13:53:19.797723 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 277/545] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:53:19 2022] GET /compute/v2.1/servers/d6ce134b-a723-453b-8847-b0725e969e89 => generated 1319 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:53:20.609743 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-e50fb406-23bc-4421-80d9-66e90cc40e00 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:53:20.611947 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-e50fb406-23bc-4421-80d9-66e90cc40e00 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 5fc359cf-ff2c-4189-b058-31eb3c97568c] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:53:20.620083 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-e50fb406-23bc-4421-80d9-66e90cc40e00 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:20.621458 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-e50fb406-23bc-4421-80d9-66e90cc40e00 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:20.622232 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-e50fb406-23bc-4421-80d9-66e90cc40e00 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:20.623393 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-e50fb406-23bc-4421-80d9-66e90cc40e00 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:20.624141 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-e50fb406-23bc-4421-80d9-66e90cc40e00 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:20.624811 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-e50fb406-23bc-4421-80d9-66e90cc40e00 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:20.821830 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-5a8bf26a-4b8a-4020-912a-f859e0b6d29e tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:53:20.822452 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-5a8bf26a-4b8a-4020-912a-f859e0b6d29e tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] [instance: d6ce134b-a723-453b-8847-b0725e969e89] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:53:20.837981 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-5a8bf26a-4b8a-4020-912a-f859e0b6d29e tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:20.838985 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-5a8bf26a-4b8a-4020-912a-f859e0b6d29e tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:20.839604 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-5a8bf26a-4b8a-4020-912a-f859e0b6d29e tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:20.840568 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-5a8bf26a-4b8a-4020-912a-f859e0b6d29e tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:20.841442 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-5a8bf26a-4b8a-4020-912a-f859e0b6d29e tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:20.842045 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-5a8bf26a-4b8a-4020-912a-f859e0b6d29e tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:20.922303 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-e50fb406-23bc-4421-80d9-66e90cc40e00 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:53:20.936447 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-e50fb406-23bc-4421-80d9-66e90cc40e00 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:53:20.938084 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-e50fb406-23bc-4421-80d9-66e90cc40e00 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:53:20.939553 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-e50fb406-23bc-4421-80d9-66e90cc40e00 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c" status: 200 len: 1739 microversion: 2.20 time: 0.334169 Oct 15 13:53:20.940912 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 269/546] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:53:20 2022] GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c => generated 1739 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 13:53:21.111396 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-5a8bf26a-4b8a-4020-912a-f859e0b6d29e tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707bd577eee14892990367f396270f7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '190914cc865b4003ab4b735d937e130d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:53:21.121440 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-5a8bf26a-4b8a-4020-912a-f859e0b6d29e tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] 10.222.0.36 "GET /compute/v2.1/servers/d6ce134b-a723-453b-8847-b0725e969e89" status: 200 len: 1319 microversion: 2.1 time: 0.303714 Oct 15 13:53:21.136847 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 278/547] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:53:20 2022] GET /compute/v2.1/servers/d6ce134b-a723-453b-8847-b0725e969e89 => generated 1319 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 13:53:21.976139 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-337b4279-c09b-4758-b5ac-909a18681e3a tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:53:21.978316 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-337b4279-c09b-4758-b5ac-909a18681e3a tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 5fc359cf-ff2c-4189-b058-31eb3c97568c] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:53:21.990084 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG dbcounter [-] [125242] Writing DB stats nova_cell0:SELECT=10 {{(pid=125242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:53:21.997136 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-337b4279-c09b-4758-b5ac-909a18681e3a tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:21.999506 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-337b4279-c09b-4758-b5ac-909a18681e3a tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:22.000721 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-337b4279-c09b-4758-b5ac-909a18681e3a tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:22.003100 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-337b4279-c09b-4758-b5ac-909a18681e3a tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:22.003964 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-337b4279-c09b-4758-b5ac-909a18681e3a tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:22.005952 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-337b4279-c09b-4758-b5ac-909a18681e3a tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:22.150626 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-9cd0e4a8-3bb3-49ee-ae5c-b83e76bef5ca tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:53:22.151799 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-9cd0e4a8-3bb3-49ee-ae5c-b83e76bef5ca tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] [instance: d6ce134b-a723-453b-8847-b0725e969e89] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:53:22.183133 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-9cd0e4a8-3bb3-49ee-ae5c-b83e76bef5ca tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:22.184100 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-9cd0e4a8-3bb3-49ee-ae5c-b83e76bef5ca tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:22.184898 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-9cd0e4a8-3bb3-49ee-ae5c-b83e76bef5ca tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:22.186198 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-9cd0e4a8-3bb3-49ee-ae5c-b83e76bef5ca tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:22.187041 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-9cd0e4a8-3bb3-49ee-ae5c-b83e76bef5ca tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:22.187921 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-9cd0e4a8-3bb3-49ee-ae5c-b83e76bef5ca tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:22.292869 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-337b4279-c09b-4758-b5ac-909a18681e3a tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:53:22.305288 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-337b4279-c09b-4758-b5ac-909a18681e3a tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:53:22.316968 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-337b4279-c09b-4758-b5ac-909a18681e3a tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:53:22.318352 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-337b4279-c09b-4758-b5ac-909a18681e3a tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c" status: 200 len: 1739 microversion: 2.20 time: 0.355690 Oct 15 13:53:22.318973 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 270/548] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:53:21 2022] GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c => generated 1739 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 13:53:22.444306 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-9cd0e4a8-3bb3-49ee-ae5c-b83e76bef5ca tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707bd577eee14892990367f396270f7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '190914cc865b4003ab4b735d937e130d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:53:22.455413 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-9cd0e4a8-3bb3-49ee-ae5c-b83e76bef5ca tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] 10.222.0.36 "GET /compute/v2.1/servers/d6ce134b-a723-453b-8847-b0725e969e89" status: 200 len: 1319 microversion: 2.1 time: 0.312551 Oct 15 13:53:22.456385 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 279/549] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:53:22 2022] GET /compute/v2.1/servers/d6ce134b-a723-453b-8847-b0725e969e89 => generated 1319 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:53:23.363088 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-410652ae-aac6-4375-a079-4ff94aa89ed6 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:53:23.364142 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-410652ae-aac6-4375-a079-4ff94aa89ed6 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 5fc359cf-ff2c-4189-b058-31eb3c97568c] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:53:23.369210 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG dbcounter [-] [125242] Writing DB stats nova_cell0:SELECT=4 {{(pid=125242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:53:23.417068 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-410652ae-aac6-4375-a079-4ff94aa89ed6 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:23.418798 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-410652ae-aac6-4375-a079-4ff94aa89ed6 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:23.419915 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-410652ae-aac6-4375-a079-4ff94aa89ed6 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:23.423103 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-410652ae-aac6-4375-a079-4ff94aa89ed6 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:23.426829 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-410652ae-aac6-4375-a079-4ff94aa89ed6 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:23.428212 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-410652ae-aac6-4375-a079-4ff94aa89ed6 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:23.463498 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG dbcounter [-] [125242] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:53:23.483204 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-68e4db59-78f2-4e86-989d-135395c6c71f tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:53:23.484563 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-68e4db59-78f2-4e86-989d-135395c6c71f tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] [instance: d6ce134b-a723-453b-8847-b0725e969e89] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:53:23.502805 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-68e4db59-78f2-4e86-989d-135395c6c71f tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:23.503643 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-68e4db59-78f2-4e86-989d-135395c6c71f tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:23.504291 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-68e4db59-78f2-4e86-989d-135395c6c71f tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:23.505241 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-68e4db59-78f2-4e86-989d-135395c6c71f tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:23.505906 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-68e4db59-78f2-4e86-989d-135395c6c71f tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:23.506532 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-68e4db59-78f2-4e86-989d-135395c6c71f tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:23.772310 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-410652ae-aac6-4375-a079-4ff94aa89ed6 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:53:23.773677 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-68e4db59-78f2-4e86-989d-135395c6c71f tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707bd577eee14892990367f396270f7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '190914cc865b4003ab4b735d937e130d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:53:23.787343 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-68e4db59-78f2-4e86-989d-135395c6c71f tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] 10.222.0.36 "GET /compute/v2.1/servers/d6ce134b-a723-453b-8847-b0725e969e89" status: 200 len: 1319 microversion: 2.1 time: 0.310721 Oct 15 13:53:23.787835 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 280/550] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:53:23 2022] GET /compute/v2.1/servers/d6ce134b-a723-453b-8847-b0725e969e89 => generated 1319 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:53:23.789103 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-410652ae-aac6-4375-a079-4ff94aa89ed6 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:53:23.790681 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-410652ae-aac6-4375-a079-4ff94aa89ed6 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:53:23.792139 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-410652ae-aac6-4375-a079-4ff94aa89ed6 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c" status: 200 len: 1739 microversion: 2.20 time: 0.438545 Oct 15 13:53:23.792871 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 271/551] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:53:23 2022] GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c => generated 1739 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 15 13:53:24.815141 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-938127da-205d-4033-a3e4-65c8ca89d85b tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:53:24.815890 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-938127da-205d-4033-a3e4-65c8ca89d85b tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] [instance: d6ce134b-a723-453b-8847-b0725e969e89] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:53:24.818749 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-05e27896-5c92-48b0-b9fe-53e6755dcbd9 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:53:24.819783 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-05e27896-5c92-48b0-b9fe-53e6755dcbd9 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 5fc359cf-ff2c-4189-b058-31eb3c97568c] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:53:24.832129 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-938127da-205d-4033-a3e4-65c8ca89d85b tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:24.832129 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-938127da-205d-4033-a3e4-65c8ca89d85b tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:24.832129 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-938127da-205d-4033-a3e4-65c8ca89d85b tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:24.832129 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-938127da-205d-4033-a3e4-65c8ca89d85b tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:24.832514 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-938127da-205d-4033-a3e4-65c8ca89d85b tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:24.832607 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-05e27896-5c92-48b0-b9fe-53e6755dcbd9 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:24.832706 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-938127da-205d-4033-a3e4-65c8ca89d85b tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:24.832807 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-05e27896-5c92-48b0-b9fe-53e6755dcbd9 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:24.832807 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-05e27896-5c92-48b0-b9fe-53e6755dcbd9 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:24.832807 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-05e27896-5c92-48b0-b9fe-53e6755dcbd9 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:24.832807 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-05e27896-5c92-48b0-b9fe-53e6755dcbd9 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:24.833319 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-05e27896-5c92-48b0-b9fe-53e6755dcbd9 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:25.034620 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-938127da-205d-4033-a3e4-65c8ca89d85b tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707bd577eee14892990367f396270f7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '190914cc865b4003ab4b735d937e130d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:53:25.037336 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-05e27896-5c92-48b0-b9fe-53e6755dcbd9 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:53:25.042869 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-938127da-205d-4033-a3e4-65c8ca89d85b tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] 10.222.0.36 "GET /compute/v2.1/servers/d6ce134b-a723-453b-8847-b0725e969e89" status: 200 len: 1319 microversion: 2.1 time: 0.231895 Oct 15 13:53:25.045815 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-05e27896-5c92-48b0-b9fe-53e6755dcbd9 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:53:25.047954 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-05e27896-5c92-48b0-b9fe-53e6755dcbd9 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:53:25.049055 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-05e27896-5c92-48b0-b9fe-53e6755dcbd9 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c" status: 200 len: 1739 microversion: 2.20 time: 0.234207 Oct 15 13:53:25.049857 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 272/552] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:53:24 2022] GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c => generated 1739 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 13:53:25.054528 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-78c94fb5-48cc-4e7e-8953-d3ac99b1adf0 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:53:25.055223 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-78c94fb5-48cc-4e7e-8953-d3ac99b1adf0 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] [instance: 6490290c-19e1-49db-9190-3b945ece5145] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:53:25.055353 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 281/553] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:53:24 2022] GET /compute/v2.1/servers/d6ce134b-a723-453b-8847-b0725e969e89 => generated 1319 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:53:25.061536 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-78c94fb5-48cc-4e7e-8953-d3ac99b1adf0 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:25.062966 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-78c94fb5-48cc-4e7e-8953-d3ac99b1adf0 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:25.063788 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-78c94fb5-48cc-4e7e-8953-d3ac99b1adf0 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:25.064775 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-78c94fb5-48cc-4e7e-8953-d3ac99b1adf0 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:25.065944 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-78c94fb5-48cc-4e7e-8953-d3ac99b1adf0 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:25.066586 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-78c94fb5-48cc-4e7e-8953-d3ac99b1adf0 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:25.315226 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-78c94fb5-48cc-4e7e-8953-d3ac99b1adf0 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83c1c8fce04c57a685de883344b7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e752c3aef55649ea98ec1a2f3607c27f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:53:25.323694 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-78c94fb5-48cc-4e7e-8953-d3ac99b1adf0 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] 10.222.0.36 "GET /compute/v2.1/servers/6490290c-19e1-49db-9190-3b945ece5145" status: 200 len: 1595 microversion: 2.1 time: 0.272589 Oct 15 13:53:25.324390 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 273/554] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:53:25 2022] GET /compute/v2.1/servers/6490290c-19e1-49db-9190-3b945ece5145 => generated 1595 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:53:26.067044 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-1468c00f-b8e3-4f27-b30f-b46df9426f02 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:53:26.067592 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-1468c00f-b8e3-4f27-b30f-b46df9426f02 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] [instance: d6ce134b-a723-453b-8847-b0725e969e89] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:53:26.074326 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-1468c00f-b8e3-4f27-b30f-b46df9426f02 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:26.074813 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-1468c00f-b8e3-4f27-b30f-b46df9426f02 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:26.075301 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-1468c00f-b8e3-4f27-b30f-b46df9426f02 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:26.076283 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-1468c00f-b8e3-4f27-b30f-b46df9426f02 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:26.076713 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-1468c00f-b8e3-4f27-b30f-b46df9426f02 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:26.077157 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-1468c00f-b8e3-4f27-b30f-b46df9426f02 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:26.081011 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-786a8e1e-950a-4767-94b4-1b6e48c874fb tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:53:26.083309 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-786a8e1e-950a-4767-94b4-1b6e48c874fb tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 5fc359cf-ff2c-4189-b058-31eb3c97568c] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:53:26.090375 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-786a8e1e-950a-4767-94b4-1b6e48c874fb tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:26.091151 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-786a8e1e-950a-4767-94b4-1b6e48c874fb tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:26.091581 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-786a8e1e-950a-4767-94b4-1b6e48c874fb tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:26.092332 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-786a8e1e-950a-4767-94b4-1b6e48c874fb tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:26.092796 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-786a8e1e-950a-4767-94b4-1b6e48c874fb tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:26.093369 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-786a8e1e-950a-4767-94b4-1b6e48c874fb tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:26.302288 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-786a8e1e-950a-4767-94b4-1b6e48c874fb tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:53:26.305743 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-1468c00f-b8e3-4f27-b30f-b46df9426f02 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707bd577eee14892990367f396270f7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '190914cc865b4003ab4b735d937e130d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:53:26.311669 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-786a8e1e-950a-4767-94b4-1b6e48c874fb tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:53:26.314012 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-786a8e1e-950a-4767-94b4-1b6e48c874fb tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:53:26.314627 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-1468c00f-b8e3-4f27-b30f-b46df9426f02 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] 10.222.0.36 "GET /compute/v2.1/servers/d6ce134b-a723-453b-8847-b0725e969e89" status: 200 len: 1319 microversion: 2.1 time: 0.251585 Oct 15 13:53:26.315322 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 282/555] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:53:26 2022] GET /compute/v2.1/servers/d6ce134b-a723-453b-8847-b0725e969e89 => generated 1319 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:53:26.315577 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-786a8e1e-950a-4767-94b4-1b6e48c874fb tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c" status: 200 len: 1721 microversion: 2.20 time: 0.238880 Oct 15 13:53:26.316323 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 274/556] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:53:26 2022] GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c => generated 1721 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 13:53:26.928670 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [req-c214be6d-b6df-4feb-a369-056e3fee0442 req-67fa217f-6217-4125-ab72-70452dd676aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6ce134b-a723-453b-8847-b0725e969e89", "name": "network-vif-plugged", "status": "completed", "tag": "f1f1b2d4-39b0-458c-8883-41eaa4cbab9e"}]} {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 13:53:26.941524 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [req-c214be6d-b6df-4feb-a369-056e3fee0442 req-67fa217f-6217-4125-ab72-70452dd676aa service nova] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:26.942026 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [req-c214be6d-b6df-4feb-a369-056e3fee0442 req-67fa217f-6217-4125-ab72-70452dd676aa service nova] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:26.942430 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [req-c214be6d-b6df-4feb-a369-056e3fee0442 req-67fa217f-6217-4125-ab72-70452dd676aa service nova] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:26.955592 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.compute.server_external_events [req-c214be6d-b6df-4feb-a369-056e3fee0442 req-67fa217f-6217-4125-ab72-70452dd676aa service nova] Creating event network-vif-plugged:f1f1b2d4-39b0-458c-8883-41eaa4cbab9e for instance d6ce134b-a723-453b-8847-b0725e969e89 on hv-cinder-86149 Oct 15 13:53:26.961089 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [req-c214be6d-b6df-4feb-a369-056e3fee0442 req-67fa217f-6217-4125-ab72-70452dd676aa service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036602 Oct 15 13:53:26.962059 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 283/557] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 15 13:53:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 13:53:27.330200 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [req-df0626d2-799a-4561-883f-7e3b998b3bab req-fa63246d-9580-41aa-ace2-115116462140 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6490290c-19e1-49db-9190-3b945ece5145", "tag": "3f885321-034d-42f2-a8c5-c0315db5a5eb"}]} {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 13:53:27.344483 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-4d8fc6e3-ba4c-4e5c-bfae-bb5f4255434a tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:53:27.345808 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-4d8fc6e3-ba4c-4e5c-bfae-bb5f4255434a tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] [instance: d6ce134b-a723-453b-8847-b0725e969e89] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:53:27.368489 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-4d8fc6e3-ba4c-4e5c-bfae-bb5f4255434a tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:27.368984 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-4d8fc6e3-ba4c-4e5c-bfae-bb5f4255434a tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:27.372535 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-4d8fc6e3-ba4c-4e5c-bfae-bb5f4255434a tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:27.373573 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-4d8fc6e3-ba4c-4e5c-bfae-bb5f4255434a tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:27.374061 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-4d8fc6e3-ba4c-4e5c-bfae-bb5f4255434a tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:27.374811 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-4d8fc6e3-ba4c-4e5c-bfae-bb5f4255434a tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:27.378908 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [req-df0626d2-799a-4561-883f-7e3b998b3bab req-fa63246d-9580-41aa-ace2-115116462140 service nova] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:27.379926 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [req-df0626d2-799a-4561-883f-7e3b998b3bab req-fa63246d-9580-41aa-ace2-115116462140 service nova] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:27.380528 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [req-df0626d2-799a-4561-883f-7e3b998b3bab req-fa63246d-9580-41aa-ace2-115116462140 service nova] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:27.399719 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.compute.server_external_events [req-df0626d2-799a-4561-883f-7e3b998b3bab req-fa63246d-9580-41aa-ace2-115116462140 service nova] Creating event network-changed:3f885321-034d-42f2-a8c5-c0315db5a5eb for instance 6490290c-19e1-49db-9190-3b945ece5145 on hv-cinder-86149 Oct 15 13:53:27.414014 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [req-df0626d2-799a-4561-883f-7e3b998b3bab req-fa63246d-9580-41aa-ace2-115116462140 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091188 Oct 15 13:53:27.414934 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 275/558] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 15 13:53:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 13:53:27.429836 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-8bfcbf5c-df44-43a7-af09-9215bcedaba7 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:53:27.430556 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-8bfcbf5c-df44-43a7-af09-9215bcedaba7 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 5fc359cf-ff2c-4189-b058-31eb3c97568c] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:53:27.437523 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-8bfcbf5c-df44-43a7-af09-9215bcedaba7 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:27.438005 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-8bfcbf5c-df44-43a7-af09-9215bcedaba7 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:27.438989 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-8bfcbf5c-df44-43a7-af09-9215bcedaba7 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:27.443838 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-8bfcbf5c-df44-43a7-af09-9215bcedaba7 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:27.444692 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-8bfcbf5c-df44-43a7-af09-9215bcedaba7 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:27.445321 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-8bfcbf5c-df44-43a7-af09-9215bcedaba7 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:27.712926 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-4d8fc6e3-ba4c-4e5c-bfae-bb5f4255434a tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707bd577eee14892990367f396270f7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '190914cc865b4003ab4b735d937e130d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:53:27.728318 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-4d8fc6e3-ba4c-4e5c-bfae-bb5f4255434a tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] 10.222.0.36 "GET /compute/v2.1/servers/d6ce134b-a723-453b-8847-b0725e969e89" status: 200 len: 1319 microversion: 2.1 time: 0.393315 Oct 15 13:53:27.731205 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 284/559] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:53:27 2022] GET /compute/v2.1/servers/d6ce134b-a723-453b-8847-b0725e969e89 => generated 1319 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:53:27.798180 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-8bfcbf5c-df44-43a7-af09-9215bcedaba7 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:53:27.836255 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-8bfcbf5c-df44-43a7-af09-9215bcedaba7 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:53:27.841648 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-8bfcbf5c-df44-43a7-af09-9215bcedaba7 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:53:27.849864 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-8bfcbf5c-df44-43a7-af09-9215bcedaba7 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c" status: 200 len: 1721 microversion: 2.20 time: 0.433067 Oct 15 13:53:27.851752 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 276/560] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:53:27 2022] GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c => generated 1721 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 13:53:28.755974 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-f0d0e622-52d3-4d90-8b62-2d1dabea91cf tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:53:28.757418 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-f0d0e622-52d3-4d90-8b62-2d1dabea91cf tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] [instance: d6ce134b-a723-453b-8847-b0725e969e89] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:53:28.765978 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-f0d0e622-52d3-4d90-8b62-2d1dabea91cf tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:28.768626 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-f0d0e622-52d3-4d90-8b62-2d1dabea91cf tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:28.768879 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-f0d0e622-52d3-4d90-8b62-2d1dabea91cf tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:28.769615 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-f0d0e622-52d3-4d90-8b62-2d1dabea91cf tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:28.770681 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-f0d0e622-52d3-4d90-8b62-2d1dabea91cf tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:28.771117 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-f0d0e622-52d3-4d90-8b62-2d1dabea91cf tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:28.885074 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-e636a965-af30-4a7d-a66e-fa352eabc8d0 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:53:28.888823 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-e636a965-af30-4a7d-a66e-fa352eabc8d0 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 5fc359cf-ff2c-4189-b058-31eb3c97568c] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:53:28.900248 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-e636a965-af30-4a7d-a66e-fa352eabc8d0 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:28.901372 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-e636a965-af30-4a7d-a66e-fa352eabc8d0 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:28.902440 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-e636a965-af30-4a7d-a66e-fa352eabc8d0 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:28.908688 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-e636a965-af30-4a7d-a66e-fa352eabc8d0 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:28.910085 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-e636a965-af30-4a7d-a66e-fa352eabc8d0 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:28.910686 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-e636a965-af30-4a7d-a66e-fa352eabc8d0 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:29.013583 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-f0d0e622-52d3-4d90-8b62-2d1dabea91cf tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707bd577eee14892990367f396270f7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '190914cc865b4003ab4b735d937e130d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:53:29.021863 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-f0d0e622-52d3-4d90-8b62-2d1dabea91cf tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] 10.222.0.36 "GET /compute/v2.1/servers/d6ce134b-a723-453b-8847-b0725e969e89" status: 200 len: 1319 microversion: 2.1 time: 0.269646 Oct 15 13:53:29.022451 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 285/561] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:53:28 2022] GET /compute/v2.1/servers/d6ce134b-a723-453b-8847-b0725e969e89 => generated 1319 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:53:29.038373 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [req-c19fa63e-2ea8-4b0c-9d83-8fead8aab694 req-3ca14a33-76b5-4b18-89b4-6f16d3d0e039 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5fc359cf-ff2c-4189-b058-31eb3c97568c", "name": "network-vif-unplugged", "status": "completed", "tag": "5a131939-5800-4807-b2cc-42f66041598f"}]} {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 13:53:29.048808 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [req-c19fa63e-2ea8-4b0c-9d83-8fead8aab694 req-3ca14a33-76b5-4b18-89b4-6f16d3d0e039 service nova] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:29.049501 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [req-c19fa63e-2ea8-4b0c-9d83-8fead8aab694 req-3ca14a33-76b5-4b18-89b4-6f16d3d0e039 service nova] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:29.049948 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [req-c19fa63e-2ea8-4b0c-9d83-8fead8aab694 req-3ca14a33-76b5-4b18-89b4-6f16d3d0e039 service nova] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:29.064958 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.compute.server_external_events [req-c19fa63e-2ea8-4b0c-9d83-8fead8aab694 req-3ca14a33-76b5-4b18-89b4-6f16d3d0e039 service nova] Creating event network-vif-unplugged:5a131939-5800-4807-b2cc-42f66041598f for instance 5fc359cf-ff2c-4189-b058-31eb3c97568c on hv-cinder-86149 Oct 15 13:53:29.070610 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [req-c19fa63e-2ea8-4b0c-9d83-8fead8aab694 req-3ca14a33-76b5-4b18-89b4-6f16d3d0e039 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037252 Oct 15 13:53:29.071451 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 286/562] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 15 13:53:29 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 13:53:29.077098 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-c553d7d8-2914-4aad-afa7-73eb90ac4e50 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1662270376"}} {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 13:53:29.077780 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-c553d7d8-2914-4aad-afa7-73eb90ac4e50 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] [instance: 6490290c-19e1-49db-9190-3b945ece5145] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:53:29.088078 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-c553d7d8-2914-4aad-afa7-73eb90ac4e50 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:29.088574 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-c553d7d8-2914-4aad-afa7-73eb90ac4e50 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:29.089006 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-c553d7d8-2914-4aad-afa7-73eb90ac4e50 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:29.089707 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-c553d7d8-2914-4aad-afa7-73eb90ac4e50 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:29.090179 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-c553d7d8-2914-4aad-afa7-73eb90ac4e50 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:29.090602 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-c553d7d8-2914-4aad-afa7-73eb90ac4e50 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:29.103372 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-e636a965-af30-4a7d-a66e-fa352eabc8d0 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:53:29.112567 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-e636a965-af30-4a7d-a66e-fa352eabc8d0 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:53:29.113987 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-e636a965-af30-4a7d-a66e-fa352eabc8d0 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:53:29.115143 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-e636a965-af30-4a7d-a66e-fa352eabc8d0 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c" status: 200 len: 1724 microversion: 2.20 time: 0.238161 Oct 15 13:53:29.115703 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 277/563] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:53:28 2022] GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c => generated 1724 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 13:53:29.141244 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-7327c8e2-400e-47c0-b3d3-013dd710dd9e tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "466e41c7-9eb5-4c51-92bf-2cfacefaa5dd"}} {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 13:53:29.143829 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-7327c8e2-400e-47c0-b3d3-013dd710dd9e tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 5fc359cf-ff2c-4189-b058-31eb3c97568c] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:53:29.150177 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-7327c8e2-400e-47c0-b3d3-013dd710dd9e tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:29.150665 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-7327c8e2-400e-47c0-b3d3-013dd710dd9e tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:29.151085 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-7327c8e2-400e-47c0-b3d3-013dd710dd9e tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:29.151774 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-7327c8e2-400e-47c0-b3d3-013dd710dd9e tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:29.152249 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-7327c8e2-400e-47c0-b3d3-013dd710dd9e tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:29.152667 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-7327c8e2-400e-47c0-b3d3-013dd710dd9e tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:29.231207 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.network.security_group_api [None req-c553d7d8-2914-4aad-afa7-73eb90ac4e50 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Adding security group dfe7e769-8b2f-4486-b4ba-b22b15514c14 to port 3f885321-034d-42f2-a8c5-c0315db5a5eb Oct 15 13:53:29.480120 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-7327c8e2-400e-47c0-b3d3-013dd710dd9e tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "POST /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.341863 Oct 15 13:53:29.480874 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 278/564] 10.222.0.36 () {62 vars in 1364 bytes} [Sat Oct 15 13:53:29 2022] POST /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c/os-volume_attachments => generated 188 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 15 13:53:29.615594 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-d3879355-1f87-45b7-821a-e3ccfc94537a tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 13:53:29.616339 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-d3879355-1f87-45b7-821a-e3ccfc94537a tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 5fc359cf-ff2c-4189-b058-31eb3c97568c] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:53:29.619696 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-c553d7d8-2914-4aad-afa7-73eb90ac4e50 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] 10.222.0.36 "POST /compute/v2.1/servers/6490290c-19e1-49db-9190-3b945ece5145/action" status: 202 len: 0 microversion: 2.1 time: 0.546534 Oct 15 13:53:29.620507 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 287/565] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 15 13:53:29 2022] POST /compute/v2.1/servers/6490290c-19e1-49db-9190-3b945ece5145/action => generated 0 bytes in 549 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 15 13:53:29.627563 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-d3879355-1f87-45b7-821a-e3ccfc94537a tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:29.628120 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-d3879355-1f87-45b7-821a-e3ccfc94537a tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:29.628739 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-d3879355-1f87-45b7-821a-e3ccfc94537a tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:29.629451 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-d3879355-1f87-45b7-821a-e3ccfc94537a tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:29.630062 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-d3879355-1f87-45b7-821a-e3ccfc94537a tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:29.630733 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-d3879355-1f87-45b7-821a-e3ccfc94537a tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:29.633775 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-bcb162e0-fb1e-41e4-9568-e547384ecff3 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:53:29.637364 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-bcb162e0-fb1e-41e4-9568-e547384ecff3 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] [instance: 6490290c-19e1-49db-9190-3b945ece5145] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:53:29.652109 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-bcb162e0-fb1e-41e4-9568-e547384ecff3 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:29.652612 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-bcb162e0-fb1e-41e4-9568-e547384ecff3 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:29.653047 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-bcb162e0-fb1e-41e4-9568-e547384ecff3 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:29.653759 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-bcb162e0-fb1e-41e4-9568-e547384ecff3 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:29.654212 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-bcb162e0-fb1e-41e4-9568-e547384ecff3 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:29.654634 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-bcb162e0-fb1e-41e4-9568-e547384ecff3 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:29.687679 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-d3879355-1f87-45b7-821a-e3ccfc94537a tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 5fc359cf-ff2c-4189-b058-31eb3c97568c] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=125242) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 15 13:53:29.778546 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-d3879355-1f87-45b7-821a-e3ccfc94537a tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "POST /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c/action" status: 202 len: 0 microversion: 2.20 time: 0.166779 Oct 15 13:53:29.780117 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 279/566] 10.222.0.36 () {62 vars in 1319 bytes} [Sat Oct 15 13:53:29 2022] POST /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c/action => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 15 13:53:29.785846 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [req-dd99c792-a717-4d1f-8ce4-591d32037340 req-1075f838-34d6-4cce-927a-e9a35d8da501 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6490290c-19e1-49db-9190-3b945ece5145", "tag": "3f885321-034d-42f2-a8c5-c0315db5a5eb"}]} {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 13:53:29.800804 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [req-dd99c792-a717-4d1f-8ce4-591d32037340 req-1075f838-34d6-4cce-927a-e9a35d8da501 service nova] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:29.805357 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [req-dd99c792-a717-4d1f-8ce4-591d32037340 req-1075f838-34d6-4cce-927a-e9a35d8da501 service nova] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:29.808590 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [req-dd99c792-a717-4d1f-8ce4-591d32037340 req-1075f838-34d6-4cce-927a-e9a35d8da501 service nova] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:29.824653 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.compute.server_external_events [req-dd99c792-a717-4d1f-8ce4-591d32037340 req-1075f838-34d6-4cce-927a-e9a35d8da501 service nova] Creating event network-changed:3f885321-034d-42f2-a8c5-c0315db5a5eb for instance 6490290c-19e1-49db-9190-3b945ece5145 on hv-cinder-86149 Oct 15 13:53:29.833230 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [req-dd99c792-a717-4d1f-8ce4-591d32037340 req-1075f838-34d6-4cce-927a-e9a35d8da501 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051493 Oct 15 13:53:29.834508 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 280/567] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 15 13:53:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 13:53:29.840220 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-dfb08342-9ec9-4d36-a3b6-bd3bd454d8d4 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:53:29.841239 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-dfb08342-9ec9-4d36-a3b6-bd3bd454d8d4 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 5fc359cf-ff2c-4189-b058-31eb3c97568c] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:53:29.848548 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-dfb08342-9ec9-4d36-a3b6-bd3bd454d8d4 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:29.848954 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-dfb08342-9ec9-4d36-a3b6-bd3bd454d8d4 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:29.849398 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-dfb08342-9ec9-4d36-a3b6-bd3bd454d8d4 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:29.850118 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-dfb08342-9ec9-4d36-a3b6-bd3bd454d8d4 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:29.850573 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-dfb08342-9ec9-4d36-a3b6-bd3bd454d8d4 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:29.851498 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-dfb08342-9ec9-4d36-a3b6-bd3bd454d8d4 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:29.873184 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-bcb162e0-fb1e-41e4-9568-e547384ecff3 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83c1c8fce04c57a685de883344b7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e752c3aef55649ea98ec1a2f3607c27f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:53:29.883627 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-bcb162e0-fb1e-41e4-9568-e547384ecff3 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] 10.222.0.36 "GET /compute/v2.1/servers/6490290c-19e1-49db-9190-3b945ece5145" status: 200 len: 1761 microversion: 2.1 time: 0.258008 Oct 15 13:53:29.884619 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 288/568] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:53:29 2022] GET /compute/v2.1/servers/6490290c-19e1-49db-9190-3b945ece5145 => generated 1761 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:53:30.037396 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-dfb08342-9ec9-4d36-a3b6-bd3bd454d8d4 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:53:30.044888 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-38622f84-c334-40f6-9c17-c4b1a9dfbede tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:53:30.045499 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-38622f84-c334-40f6-9c17-c4b1a9dfbede tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] [instance: d6ce134b-a723-453b-8847-b0725e969e89] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:53:30.047502 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-dfb08342-9ec9-4d36-a3b6-bd3bd454d8d4 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:53:30.049349 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-dfb08342-9ec9-4d36-a3b6-bd3bd454d8d4 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:53:30.050859 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-dfb08342-9ec9-4d36-a3b6-bd3bd454d8d4 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c" status: 200 len: 1810 microversion: 2.20 time: 0.215175 Oct 15 13:53:30.051652 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 281/569] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:53:29 2022] GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c => generated 1810 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 13:53:30.060083 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-38622f84-c334-40f6-9c17-c4b1a9dfbede tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:30.060711 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-38622f84-c334-40f6-9c17-c4b1a9dfbede tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:30.061236 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-38622f84-c334-40f6-9c17-c4b1a9dfbede tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:30.062220 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-38622f84-c334-40f6-9c17-c4b1a9dfbede tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:30.062783 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-38622f84-c334-40f6-9c17-c4b1a9dfbede tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:30.063359 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-38622f84-c334-40f6-9c17-c4b1a9dfbede tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:30.243948 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-38622f84-c334-40f6-9c17-c4b1a9dfbede tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707bd577eee14892990367f396270f7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '190914cc865b4003ab4b735d937e130d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:53:30.253458 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-38622f84-c334-40f6-9c17-c4b1a9dfbede tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] 10.222.0.36 "GET /compute/v2.1/servers/d6ce134b-a723-453b-8847-b0725e969e89" status: 200 len: 1509 microversion: 2.1 time: 0.212273 Oct 15 13:53:30.254042 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 289/570] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:53:30 2022] GET /compute/v2.1/servers/d6ce134b-a723-453b-8847-b0725e969e89 => generated 1509 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:53:31.079033 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-315e9d3d-37be-45c4-b616-87e42aff02df tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:53:31.080150 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-315e9d3d-37be-45c4-b616-87e42aff02df tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 5fc359cf-ff2c-4189-b058-31eb3c97568c] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:53:31.091652 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-315e9d3d-37be-45c4-b616-87e42aff02df tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:31.092816 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-315e9d3d-37be-45c4-b616-87e42aff02df tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:31.093593 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-315e9d3d-37be-45c4-b616-87e42aff02df tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:31.095402 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-315e9d3d-37be-45c4-b616-87e42aff02df tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:31.095402 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-315e9d3d-37be-45c4-b616-87e42aff02df tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:31.095934 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-315e9d3d-37be-45c4-b616-87e42aff02df tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:31.279045 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-315e9d3d-37be-45c4-b616-87e42aff02df tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:53:31.289253 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-315e9d3d-37be-45c4-b616-87e42aff02df tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:53:31.290825 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-315e9d3d-37be-45c4-b616-87e42aff02df tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:53:31.292021 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-315e9d3d-37be-45c4-b616-87e42aff02df tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c" status: 200 len: 1752 microversion: 2.20 time: 0.218736 Oct 15 13:53:31.292584 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 282/571] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:53:31 2022] GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c => generated 1752 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 13:53:32.318319 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-14babccc-a0dc-43c4-ad40-66e233efa0b1 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:53:32.319000 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-14babccc-a0dc-43c4-ad40-66e233efa0b1 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 5fc359cf-ff2c-4189-b058-31eb3c97568c] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:53:32.325718 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-14babccc-a0dc-43c4-ad40-66e233efa0b1 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:32.326200 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-14babccc-a0dc-43c4-ad40-66e233efa0b1 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:32.326634 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-14babccc-a0dc-43c4-ad40-66e233efa0b1 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:32.327326 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-14babccc-a0dc-43c4-ad40-66e233efa0b1 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:32.327775 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-14babccc-a0dc-43c4-ad40-66e233efa0b1 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:32.328461 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-14babccc-a0dc-43c4-ad40-66e233efa0b1 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:32.345331 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG dbcounter [-] [125243] Writing DB stats nova_cell1:SELECT=100 {{(pid=125243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:53:32.529092 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-14babccc-a0dc-43c4-ad40-66e233efa0b1 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:53:32.538070 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-14babccc-a0dc-43c4-ad40-66e233efa0b1 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:53:32.539507 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-14babccc-a0dc-43c4-ad40-66e233efa0b1 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:53:32.540701 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-14babccc-a0dc-43c4-ad40-66e233efa0b1 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c" status: 200 len: 1808 microversion: 2.20 time: 0.226897 Oct 15 13:53:32.541274 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 290/572] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:53:32 2022] GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c => generated 1808 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 13:53:33.566778 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-1bc4f910-092d-4384-b5c1-7d990b58d0b0 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:53:33.567689 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-1bc4f910-092d-4384-b5c1-7d990b58d0b0 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 5fc359cf-ff2c-4189-b058-31eb3c97568c] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:53:33.579091 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-1bc4f910-092d-4384-b5c1-7d990b58d0b0 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:33.579592 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-1bc4f910-092d-4384-b5c1-7d990b58d0b0 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:33.580062 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-1bc4f910-092d-4384-b5c1-7d990b58d0b0 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:33.580787 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-1bc4f910-092d-4384-b5c1-7d990b58d0b0 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:33.581266 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-1bc4f910-092d-4384-b5c1-7d990b58d0b0 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:33.581698 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-1bc4f910-092d-4384-b5c1-7d990b58d0b0 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:33.814751 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-1bc4f910-092d-4384-b5c1-7d990b58d0b0 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:53:33.825499 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-1bc4f910-092d-4384-b5c1-7d990b58d0b0 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:53:33.826979 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-1bc4f910-092d-4384-b5c1-7d990b58d0b0 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:53:33.828204 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-1bc4f910-092d-4384-b5c1-7d990b58d0b0 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c" status: 200 len: 1808 microversion: 2.20 time: 0.266043 Oct 15 13:53:33.828756 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 283/573] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:53:33 2022] GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c => generated 1808 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 13:53:34.855589 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-e1e00b5a-2f60-4ca4-8396-54aa7f444ae4 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:53:34.856211 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-e1e00b5a-2f60-4ca4-8396-54aa7f444ae4 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 5fc359cf-ff2c-4189-b058-31eb3c97568c] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:53:34.863863 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-e1e00b5a-2f60-4ca4-8396-54aa7f444ae4 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:34.869161 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-e1e00b5a-2f60-4ca4-8396-54aa7f444ae4 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:34.869776 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-e1e00b5a-2f60-4ca4-8396-54aa7f444ae4 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:34.870593 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-e1e00b5a-2f60-4ca4-8396-54aa7f444ae4 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:34.871063 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-e1e00b5a-2f60-4ca4-8396-54aa7f444ae4 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:34.871469 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-e1e00b5a-2f60-4ca4-8396-54aa7f444ae4 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:35.021812 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-e1e00b5a-2f60-4ca4-8396-54aa7f444ae4 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:53:35.038962 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-e1e00b5a-2f60-4ca4-8396-54aa7f444ae4 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:53:35.041733 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-e1e00b5a-2f60-4ca4-8396-54aa7f444ae4 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:53:35.043852 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-e1e00b5a-2f60-4ca4-8396-54aa7f444ae4 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c" status: 200 len: 1808 microversion: 2.20 time: 0.192553 Oct 15 13:53:35.044673 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 291/574] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:53:34 2022] GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c => generated 1808 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 13:53:36.069895 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-f3e5f3ac-7edc-45e9-9c8c-f6571a305178 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:53:36.070651 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-f3e5f3ac-7edc-45e9-9c8c-f6571a305178 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 5fc359cf-ff2c-4189-b058-31eb3c97568c] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:53:36.082215 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-f3e5f3ac-7edc-45e9-9c8c-f6571a305178 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:36.082788 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-f3e5f3ac-7edc-45e9-9c8c-f6571a305178 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:36.083269 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-f3e5f3ac-7edc-45e9-9c8c-f6571a305178 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:36.084553 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-f3e5f3ac-7edc-45e9-9c8c-f6571a305178 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:36.085339 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-f3e5f3ac-7edc-45e9-9c8c-f6571a305178 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:36.088612 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-f3e5f3ac-7edc-45e9-9c8c-f6571a305178 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:36.248078 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-f3e5f3ac-7edc-45e9-9c8c-f6571a305178 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:53:36.259949 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-f3e5f3ac-7edc-45e9-9c8c-f6571a305178 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:53:36.260379 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-f3e5f3ac-7edc-45e9-9c8c-f6571a305178 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:53:36.261610 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-f3e5f3ac-7edc-45e9-9c8c-f6571a305178 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c" status: 200 len: 1808 microversion: 2.20 time: 0.195666 Oct 15 13:53:36.262185 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 284/575] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:53:36 2022] GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c => generated 1808 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 13:53:37.288740 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-8dd65b43-d6ec-47e8-a9a3-5483107a702a tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:53:37.289347 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-8dd65b43-d6ec-47e8-a9a3-5483107a702a tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 5fc359cf-ff2c-4189-b058-31eb3c97568c] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:53:37.296718 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-8dd65b43-d6ec-47e8-a9a3-5483107a702a tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:37.297303 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-8dd65b43-d6ec-47e8-a9a3-5483107a702a tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:37.297843 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-8dd65b43-d6ec-47e8-a9a3-5483107a702a tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:37.298950 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-8dd65b43-d6ec-47e8-a9a3-5483107a702a tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:37.299823 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-8dd65b43-d6ec-47e8-a9a3-5483107a702a tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:37.300479 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-8dd65b43-d6ec-47e8-a9a3-5483107a702a tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:37.471226 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-8dd65b43-d6ec-47e8-a9a3-5483107a702a tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:53:37.485053 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-8dd65b43-d6ec-47e8-a9a3-5483107a702a tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:53:37.487041 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-8dd65b43-d6ec-47e8-a9a3-5483107a702a tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:53:37.488743 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-8dd65b43-d6ec-47e8-a9a3-5483107a702a tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c" status: 200 len: 1808 microversion: 2.20 time: 0.204178 Oct 15 13:53:37.490503 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 292/576] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:53:37 2022] GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c => generated 1808 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 13:53:38.517049 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-409d4fcc-20c5-4b93-8681-527eb82efbc0 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:53:38.517894 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-409d4fcc-20c5-4b93-8681-527eb82efbc0 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 5fc359cf-ff2c-4189-b058-31eb3c97568c] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:53:38.525312 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-409d4fcc-20c5-4b93-8681-527eb82efbc0 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:38.525803 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-409d4fcc-20c5-4b93-8681-527eb82efbc0 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:38.526251 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-409d4fcc-20c5-4b93-8681-527eb82efbc0 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:38.526965 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-409d4fcc-20c5-4b93-8681-527eb82efbc0 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:38.527499 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-409d4fcc-20c5-4b93-8681-527eb82efbc0 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:38.527954 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-409d4fcc-20c5-4b93-8681-527eb82efbc0 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:38.545051 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG dbcounter [-] [125242] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=125242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:53:38.698683 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-409d4fcc-20c5-4b93-8681-527eb82efbc0 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:53:38.709029 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-409d4fcc-20c5-4b93-8681-527eb82efbc0 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:53:38.710552 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-409d4fcc-20c5-4b93-8681-527eb82efbc0 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:53:38.711728 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-409d4fcc-20c5-4b93-8681-527eb82efbc0 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c" status: 200 len: 1808 microversion: 2.20 time: 0.198825 Oct 15 13:53:38.712351 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 285/577] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:53:38 2022] GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c => generated 1808 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 13:53:39.142975 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-6c10d0a4-3895-4833-b72a-cb7f23010b61 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e2bb581a-89d5-4d2f-bcba-23862333c27e"}} {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 13:53:39.147838 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-6c10d0a4-3895-4833-b72a-cb7f23010b61 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] [instance: cb269dd0-b5af-4013-9ded-062f40176b8f] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:53:39.159805 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-6c10d0a4-3895-4833-b72a-cb7f23010b61 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:39.160659 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-6c10d0a4-3895-4833-b72a-cb7f23010b61 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:39.161400 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-6c10d0a4-3895-4833-b72a-cb7f23010b61 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:39.162378 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-6c10d0a4-3895-4833-b72a-cb7f23010b61 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:39.163096 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-6c10d0a4-3895-4833-b72a-cb7f23010b61 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:39.164053 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-6c10d0a4-3895-4833-b72a-cb7f23010b61 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:39.739270 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-a057491c-d95f-40f7-b1b5-09c3ee004572 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:53:39.740088 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-a057491c-d95f-40f7-b1b5-09c3ee004572 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 5fc359cf-ff2c-4189-b058-31eb3c97568c] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:53:39.747920 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-a057491c-d95f-40f7-b1b5-09c3ee004572 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:39.748415 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-a057491c-d95f-40f7-b1b5-09c3ee004572 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:39.749039 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-a057491c-d95f-40f7-b1b5-09c3ee004572 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:39.749947 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-a057491c-d95f-40f7-b1b5-09c3ee004572 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:39.750565 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-a057491c-d95f-40f7-b1b5-09c3ee004572 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:39.751312 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-a057491c-d95f-40f7-b1b5-09c3ee004572 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:39.892394 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-a057491c-d95f-40f7-b1b5-09c3ee004572 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:53:39.902395 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-a057491c-d95f-40f7-b1b5-09c3ee004572 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:53:39.903854 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-a057491c-d95f-40f7-b1b5-09c3ee004572 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:53:39.905070 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-a057491c-d95f-40f7-b1b5-09c3ee004572 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c" status: 200 len: 1808 microversion: 2.20 time: 0.170287 Oct 15 13:53:39.905683 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 286/578] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:53:39 2022] GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c => generated 1808 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 13:53:40.939492 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-d69ded21-add2-4100-8bf0-87fa92d580c9 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:53:40.940370 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-d69ded21-add2-4100-8bf0-87fa92d580c9 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 5fc359cf-ff2c-4189-b058-31eb3c97568c] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:53:40.948624 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-d69ded21-add2-4100-8bf0-87fa92d580c9 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:40.949340 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-d69ded21-add2-4100-8bf0-87fa92d580c9 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:40.949948 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-d69ded21-add2-4100-8bf0-87fa92d580c9 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:40.950895 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-d69ded21-add2-4100-8bf0-87fa92d580c9 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:40.951367 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-d69ded21-add2-4100-8bf0-87fa92d580c9 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:40.951761 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-d69ded21-add2-4100-8bf0-87fa92d580c9 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:41.096523 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-d69ded21-add2-4100-8bf0-87fa92d580c9 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:53:41.106365 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-d69ded21-add2-4100-8bf0-87fa92d580c9 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:53:41.107931 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-d69ded21-add2-4100-8bf0-87fa92d580c9 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:53:41.109237 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-d69ded21-add2-4100-8bf0-87fa92d580c9 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c" status: 200 len: 1808 microversion: 2.20 time: 0.174375 Oct 15 13:53:41.109943 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 287/579] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:53:40 2022] GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c => generated 1808 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 13:53:42.141623 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-bd14cdf5-b4e0-4887-a180-8f9de390c4c4 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:53:42.143283 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-bd14cdf5-b4e0-4887-a180-8f9de390c4c4 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 5fc359cf-ff2c-4189-b058-31eb3c97568c] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:53:42.155332 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-bd14cdf5-b4e0-4887-a180-8f9de390c4c4 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:42.156245 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-bd14cdf5-b4e0-4887-a180-8f9de390c4c4 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:42.157035 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-bd14cdf5-b4e0-4887-a180-8f9de390c4c4 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:42.158247 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-bd14cdf5-b4e0-4887-a180-8f9de390c4c4 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:42.159027 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-bd14cdf5-b4e0-4887-a180-8f9de390c4c4 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:42.160012 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-bd14cdf5-b4e0-4887-a180-8f9de390c4c4 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:42.350826 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-bd14cdf5-b4e0-4887-a180-8f9de390c4c4 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:53:42.375795 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-bd14cdf5-b4e0-4887-a180-8f9de390c4c4 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:53:42.378379 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-bd14cdf5-b4e0-4887-a180-8f9de390c4c4 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:53:42.381562 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-bd14cdf5-b4e0-4887-a180-8f9de390c4c4 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c" status: 200 len: 1808 microversion: 2.20 time: 0.248574 Oct 15 13:53:42.382661 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 288/580] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:53:42 2022] GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c => generated 1808 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 13:53:43.418305 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-ca4dd7c0-6548-4c9d-927c-b5e45502ed63 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:53:43.419631 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-ca4dd7c0-6548-4c9d-927c-b5e45502ed63 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 5fc359cf-ff2c-4189-b058-31eb3c97568c] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:53:43.421549 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG dbcounter [-] [125242] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=1 {{(pid=125242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:53:43.428859 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-ca4dd7c0-6548-4c9d-927c-b5e45502ed63 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:43.428859 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-ca4dd7c0-6548-4c9d-927c-b5e45502ed63 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:43.429257 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-ca4dd7c0-6548-4c9d-927c-b5e45502ed63 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:43.430195 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-ca4dd7c0-6548-4c9d-927c-b5e45502ed63 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:43.430655 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-ca4dd7c0-6548-4c9d-927c-b5e45502ed63 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:43.431087 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-ca4dd7c0-6548-4c9d-927c-b5e45502ed63 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:43.607986 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-ca4dd7c0-6548-4c9d-927c-b5e45502ed63 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:53:43.617250 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-ca4dd7c0-6548-4c9d-927c-b5e45502ed63 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:53:43.618754 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-ca4dd7c0-6548-4c9d-927c-b5e45502ed63 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:53:43.619957 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-ca4dd7c0-6548-4c9d-927c-b5e45502ed63 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c" status: 200 len: 1808 microversion: 2.20 time: 0.205653 Oct 15 13:53:43.620518 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 289/581] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:53:43 2022] GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c => generated 1808 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 15 13:53:43.625625 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-e5133d6e-9205-4728-b0d6-002e8cf29d44 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1359286420", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1731665434", "security_groups": [{"name": "tempest-secgroup-smoke-1562745215"}], "block_device_mapping_v2": [{"uuid": "1f6bfdb6-b799-4267-8305-d4ab4138bb94", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "701b540a-8a09-42dc-a3a2-18dbe248ffc3"}]}} {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 13:53:43.769204 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.network.neutron [None req-e5133d6e-9205-4728-b0d6-002e8cf29d44 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] validate_networks() for [('701b540a-8a09-42dc-a3a2-18dbe248ffc3', None, None, None, None, None)] {{(pid=125242) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 15 13:53:44.192361 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.virt.hardware [None req-e5133d6e-9205-4728-b0d6-002e8cf29d44 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Flavor limits 0:0:0 {{(pid=125242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 15 13:53:44.192945 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.virt.hardware [None req-e5133d6e-9205-4728-b0d6-002e8cf29d44 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Image limits 0:0:0 {{(pid=125242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 15 13:53:44.193561 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.virt.hardware [None req-e5133d6e-9205-4728-b0d6-002e8cf29d44 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Flavor pref 0:0:0 {{(pid=125242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 15 13:53:44.194126 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.virt.hardware [None req-e5133d6e-9205-4728-b0d6-002e8cf29d44 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Image pref 0:0:0 {{(pid=125242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 15 13:53:44.194543 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.virt.hardware [None req-e5133d6e-9205-4728-b0d6-002e8cf29d44 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 15 13:53:44.204268 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-e5133d6e-9205-4728-b0d6-002e8cf29d44 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:44.204834 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-e5133d6e-9205-4728-b0d6-002e8cf29d44 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:44.205313 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-e5133d6e-9205-4728-b0d6-002e8cf29d44 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:44.206087 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-e5133d6e-9205-4728-b0d6-002e8cf29d44 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:44.206620 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-e5133d6e-9205-4728-b0d6-002e8cf29d44 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:44.207136 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-e5133d6e-9205-4728-b0d6-002e8cf29d44 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:44.224914 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.quota [None req-e5133d6e-9205-4728-b0d6-002e8cf29d44 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Getting quotas for project 243c0b9b4bd742659061745c8dc4c696. Resources: {'cores', 'ram', 'instances'} {{(pid=125242) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 15 13:53:44.230034 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.quota [None req-e5133d6e-9205-4728-b0d6-002e8cf29d44 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Getting quotas for user 193bf7a17f544770a27c07f6b8cc0988 and project 243c0b9b4bd742659061745c8dc4c696. Resources: {'cores', 'ram', 'instances'} {{(pid=125242) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 15 13:53:44.292348 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-e5133d6e-9205-4728-b0d6-002e8cf29d44 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Going to run 1 instances... {{(pid=125242) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 15 13:53:44.294647 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-e5133d6e-9205-4728-b0d6-002e8cf29d44 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] [instance: 9209310f-9812-4e8e-9a64-a46690948204] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1f6bfdb6-b799-4267-8305-d4ab4138bb94',volume_size=None,volume_type=None)] {{(pid=125242) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 15 13:53:44.446856 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-e5133d6e-9205-4728-b0d6-002e8cf29d44 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.824997 Oct 15 13:53:44.447969 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 290/582] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 15 13:53:43 2022] POST /compute/v2.1/servers => generated 406 bytes in 826 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 15 13:53:44.465757 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-eb51ee5e-be18-44a9-9b12-c1e625a021b0 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:53:44.466383 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-eb51ee5e-be18-44a9-9b12-c1e625a021b0 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] [instance: 9209310f-9812-4e8e-9a64-a46690948204] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:53:44.527277 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-eb51ee5e-be18-44a9-9b12-c1e625a021b0 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '193bf7a17f544770a27c07f6b8cc0988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243c0b9b4bd742659061745c8dc4c696', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:53:44.534530 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-eb51ee5e-be18-44a9-9b12-c1e625a021b0 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] 10.222.0.36 "GET /compute/v2.1/servers/9209310f-9812-4e8e-9a64-a46690948204" status: 200 len: 1095 microversion: 2.1 time: 0.075837 Oct 15 13:53:44.535212 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 291/583] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:53:44 2022] GET /compute/v2.1/servers/9209310f-9812-4e8e-9a64-a46690948204 => generated 1095 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:53:44.650683 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-8d18abc3-4a4a-4823-ae6b-d1ef23e76057 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:53:44.651491 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-8d18abc3-4a4a-4823-ae6b-d1ef23e76057 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 5fc359cf-ff2c-4189-b058-31eb3c97568c] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:53:44.658360 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-8d18abc3-4a4a-4823-ae6b-d1ef23e76057 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:44.659096 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-8d18abc3-4a4a-4823-ae6b-d1ef23e76057 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:44.659715 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-8d18abc3-4a4a-4823-ae6b-d1ef23e76057 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:44.660637 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-8d18abc3-4a4a-4823-ae6b-d1ef23e76057 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:44.661258 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-8d18abc3-4a4a-4823-ae6b-d1ef23e76057 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:44.661685 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-8d18abc3-4a4a-4823-ae6b-d1ef23e76057 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:44.869823 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-8d18abc3-4a4a-4823-ae6b-d1ef23e76057 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:53:44.885669 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-8d18abc3-4a4a-4823-ae6b-d1ef23e76057 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:53:44.888923 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-8d18abc3-4a4a-4823-ae6b-d1ef23e76057 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:53:44.891687 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-8d18abc3-4a4a-4823-ae6b-d1ef23e76057 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c" status: 200 len: 1808 microversion: 2.20 time: 0.245626 Oct 15 13:53:44.894351 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 292/584] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:53:44 2022] GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c => generated 1808 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 15 13:53:45.559434 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-3f3cf4f0-795d-41d2-a696-7078af42b693 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:53:45.560319 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-3f3cf4f0-795d-41d2-a696-7078af42b693 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] [instance: 9209310f-9812-4e8e-9a64-a46690948204] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:53:45.569086 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-3f3cf4f0-795d-41d2-a696-7078af42b693 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:45.569577 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-3f3cf4f0-795d-41d2-a696-7078af42b693 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:45.570035 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-3f3cf4f0-795d-41d2-a696-7078af42b693 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:45.570741 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-3f3cf4f0-795d-41d2-a696-7078af42b693 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:45.571187 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-3f3cf4f0-795d-41d2-a696-7078af42b693 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:45.571671 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-3f3cf4f0-795d-41d2-a696-7078af42b693 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:45.636617 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-3f3cf4f0-795d-41d2-a696-7078af42b693 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '193bf7a17f544770a27c07f6b8cc0988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243c0b9b4bd742659061745c8dc4c696', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:53:45.644377 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-3f3cf4f0-795d-41d2-a696-7078af42b693 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] 10.222.0.36 "GET /compute/v2.1/servers/9209310f-9812-4e8e-9a64-a46690948204" status: 200 len: 1145 microversion: 2.1 time: 0.089088 Oct 15 13:53:45.645156 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 293/585] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:53:45 2022] GET /compute/v2.1/servers/9209310f-9812-4e8e-9a64-a46690948204 => generated 1145 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 13:53:45.923730 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-30ee7a90-a0da-4861-b2b5-e99521e524a0 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:53:45.924356 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-30ee7a90-a0da-4861-b2b5-e99521e524a0 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 5fc359cf-ff2c-4189-b058-31eb3c97568c] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:53:45.930931 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-30ee7a90-a0da-4861-b2b5-e99521e524a0 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:45.931415 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-30ee7a90-a0da-4861-b2b5-e99521e524a0 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:45.931846 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-30ee7a90-a0da-4861-b2b5-e99521e524a0 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:45.932558 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-30ee7a90-a0da-4861-b2b5-e99521e524a0 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:45.933014 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-30ee7a90-a0da-4861-b2b5-e99521e524a0 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:45.933433 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-30ee7a90-a0da-4861-b2b5-e99521e524a0 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:46.074856 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-30ee7a90-a0da-4861-b2b5-e99521e524a0 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:53:46.084488 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-30ee7a90-a0da-4861-b2b5-e99521e524a0 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:53:46.086204 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-30ee7a90-a0da-4861-b2b5-e99521e524a0 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:53:46.087389 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-30ee7a90-a0da-4861-b2b5-e99521e524a0 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c" status: 200 len: 1808 microversion: 2.20 time: 0.167615 Oct 15 13:53:46.088028 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 294/586] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:53:45 2022] GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c => generated 1808 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 15 13:53:46.667176 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-edafe354-ca80-46b4-a15e-aee621a51c5d tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:53:46.668114 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-edafe354-ca80-46b4-a15e-aee621a51c5d tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] [instance: 9209310f-9812-4e8e-9a64-a46690948204] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:53:46.675069 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-edafe354-ca80-46b4-a15e-aee621a51c5d tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:46.675561 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-edafe354-ca80-46b4-a15e-aee621a51c5d tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:46.676038 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-edafe354-ca80-46b4-a15e-aee621a51c5d tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:46.676743 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-edafe354-ca80-46b4-a15e-aee621a51c5d tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:46.677199 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-edafe354-ca80-46b4-a15e-aee621a51c5d tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:46.677735 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-edafe354-ca80-46b4-a15e-aee621a51c5d tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:46.764079 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-edafe354-ca80-46b4-a15e-aee621a51c5d tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '193bf7a17f544770a27c07f6b8cc0988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243c0b9b4bd742659061745c8dc4c696', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:53:46.772929 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-edafe354-ca80-46b4-a15e-aee621a51c5d tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] 10.222.0.36 "GET /compute/v2.1/servers/9209310f-9812-4e8e-9a64-a46690948204" status: 200 len: 1145 microversion: 2.1 time: 0.109813 Oct 15 13:53:46.775208 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 295/587] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:53:46 2022] GET /compute/v2.1/servers/9209310f-9812-4e8e-9a64-a46690948204 => generated 1145 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:53:47.115130 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-fe6c50e0-84eb-411a-be0c-e4a940a3aa5a tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:53:47.115759 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-fe6c50e0-84eb-411a-be0c-e4a940a3aa5a tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 5fc359cf-ff2c-4189-b058-31eb3c97568c] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:53:47.122348 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-fe6c50e0-84eb-411a-be0c-e4a940a3aa5a tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:47.122938 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-fe6c50e0-84eb-411a-be0c-e4a940a3aa5a tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:47.123400 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-fe6c50e0-84eb-411a-be0c-e4a940a3aa5a tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:47.124148 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-fe6c50e0-84eb-411a-be0c-e4a940a3aa5a tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:47.124788 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-fe6c50e0-84eb-411a-be0c-e4a940a3aa5a tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:47.125321 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-fe6c50e0-84eb-411a-be0c-e4a940a3aa5a tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:47.270021 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-fe6c50e0-84eb-411a-be0c-e4a940a3aa5a tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:53:47.280091 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-fe6c50e0-84eb-411a-be0c-e4a940a3aa5a tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:53:47.281613 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-fe6c50e0-84eb-411a-be0c-e4a940a3aa5a tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:53:47.282792 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-fe6c50e0-84eb-411a-be0c-e4a940a3aa5a tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c" status: 200 len: 1808 microversion: 2.20 time: 0.171834 Oct 15 13:53:47.283343 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 296/588] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:53:47 2022] GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c => generated 1808 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 15 13:53:47.796637 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-4e0dda65-2c31-4231-995e-764c835ef766 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:53:47.797197 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-4e0dda65-2c31-4231-995e-764c835ef766 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] [instance: 9209310f-9812-4e8e-9a64-a46690948204] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:53:47.805295 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-4e0dda65-2c31-4231-995e-764c835ef766 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:47.806599 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-4e0dda65-2c31-4231-995e-764c835ef766 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:47.807031 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-4e0dda65-2c31-4231-995e-764c835ef766 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:47.807729 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-4e0dda65-2c31-4231-995e-764c835ef766 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:47.808207 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-4e0dda65-2c31-4231-995e-764c835ef766 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:47.808621 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-4e0dda65-2c31-4231-995e-764c835ef766 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:47.874905 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-4e0dda65-2c31-4231-995e-764c835ef766 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '193bf7a17f544770a27c07f6b8cc0988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243c0b9b4bd742659061745c8dc4c696', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:53:47.884005 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-4e0dda65-2c31-4231-995e-764c835ef766 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] 10.222.0.36 "GET /compute/v2.1/servers/9209310f-9812-4e8e-9a64-a46690948204" status: 200 len: 1145 microversion: 2.1 time: 0.091055 Oct 15 13:53:47.892451 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 297/589] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:53:47 2022] GET /compute/v2.1/servers/9209310f-9812-4e8e-9a64-a46690948204 => generated 1145 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:53:48.310743 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-853f5b30-8da4-4187-8803-6ce14fa06f3a tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:53:48.311466 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-853f5b30-8da4-4187-8803-6ce14fa06f3a tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 5fc359cf-ff2c-4189-b058-31eb3c97568c] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:53:48.319334 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-853f5b30-8da4-4187-8803-6ce14fa06f3a tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:48.320025 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-853f5b30-8da4-4187-8803-6ce14fa06f3a tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:48.320468 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-853f5b30-8da4-4187-8803-6ce14fa06f3a tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:48.321495 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-853f5b30-8da4-4187-8803-6ce14fa06f3a tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:48.321958 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-853f5b30-8da4-4187-8803-6ce14fa06f3a tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:48.322536 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-853f5b30-8da4-4187-8803-6ce14fa06f3a tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:48.466139 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-853f5b30-8da4-4187-8803-6ce14fa06f3a tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:53:48.474840 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-853f5b30-8da4-4187-8803-6ce14fa06f3a tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:53:48.476305 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-853f5b30-8da4-4187-8803-6ce14fa06f3a tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:53:48.477468 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-853f5b30-8da4-4187-8803-6ce14fa06f3a tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c" status: 200 len: 1808 microversion: 2.20 time: 0.172443 Oct 15 13:53:48.478033 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 298/590] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:53:48 2022] GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c => generated 1808 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 13:53:48.907907 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-a60d7fe5-e9fa-4f6e-a760-64d12a47a84d tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:53:48.908673 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-a60d7fe5-e9fa-4f6e-a760-64d12a47a84d tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] [instance: 9209310f-9812-4e8e-9a64-a46690948204] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:53:48.915762 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-a60d7fe5-e9fa-4f6e-a760-64d12a47a84d tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:48.916311 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-a60d7fe5-e9fa-4f6e-a760-64d12a47a84d tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:48.916753 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-a60d7fe5-e9fa-4f6e-a760-64d12a47a84d tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:48.917596 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-a60d7fe5-e9fa-4f6e-a760-64d12a47a84d tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:48.918035 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-a60d7fe5-e9fa-4f6e-a760-64d12a47a84d tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:48.918589 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-a60d7fe5-e9fa-4f6e-a760-64d12a47a84d tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:48.991767 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-a60d7fe5-e9fa-4f6e-a760-64d12a47a84d tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '193bf7a17f544770a27c07f6b8cc0988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243c0b9b4bd742659061745c8dc4c696', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:53:49.003127 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-a60d7fe5-e9fa-4f6e-a760-64d12a47a84d tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] 10.222.0.36 "GET /compute/v2.1/servers/9209310f-9812-4e8e-9a64-a46690948204" status: 200 len: 1145 microversion: 2.1 time: 0.098789 Oct 15 13:53:49.003918 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 299/591] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:53:48 2022] GET /compute/v2.1/servers/9209310f-9812-4e8e-9a64-a46690948204 => generated 1145 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:53:49.155100 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG dbcounter [-] [125243] Writing DB stats nova_api:SELECT=49 {{(pid=125243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:53:49.307852 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG dbcounter [-] [125243] Writing DB stats nova_cell1:SELECT=21 {{(pid=125243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:53:49.511689 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-91cbd56a-777e-408d-8df1-c06be3a4e7a0 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:53:49.512752 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-91cbd56a-777e-408d-8df1-c06be3a4e7a0 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 5fc359cf-ff2c-4189-b058-31eb3c97568c] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:53:49.521175 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-91cbd56a-777e-408d-8df1-c06be3a4e7a0 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:49.521690 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-91cbd56a-777e-408d-8df1-c06be3a4e7a0 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:49.522120 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-91cbd56a-777e-408d-8df1-c06be3a4e7a0 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:49.522825 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-91cbd56a-777e-408d-8df1-c06be3a4e7a0 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:49.523277 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-91cbd56a-777e-408d-8df1-c06be3a4e7a0 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:49.523789 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-91cbd56a-777e-408d-8df1-c06be3a4e7a0 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:49.670111 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-91cbd56a-777e-408d-8df1-c06be3a4e7a0 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:53:49.680404 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-91cbd56a-777e-408d-8df1-c06be3a4e7a0 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:53:49.681871 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-91cbd56a-777e-408d-8df1-c06be3a4e7a0 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:53:49.683319 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-91cbd56a-777e-408d-8df1-c06be3a4e7a0 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c" status: 200 len: 1808 microversion: 2.20 time: 0.177819 Oct 15 13:53:49.683885 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 300/592] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:53:49 2022] GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c => generated 1808 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 15 13:53:50.027045 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-24ed9f08-eb47-4048-b3b5-a2e8dee5bf3f tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:53:50.028086 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-24ed9f08-eb47-4048-b3b5-a2e8dee5bf3f tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] [instance: 9209310f-9812-4e8e-9a64-a46690948204] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:53:50.035050 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-24ed9f08-eb47-4048-b3b5-a2e8dee5bf3f tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:50.035546 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-24ed9f08-eb47-4048-b3b5-a2e8dee5bf3f tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:50.036027 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-24ed9f08-eb47-4048-b3b5-a2e8dee5bf3f tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:50.036725 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-24ed9f08-eb47-4048-b3b5-a2e8dee5bf3f tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:50.037181 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-24ed9f08-eb47-4048-b3b5-a2e8dee5bf3f tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:50.037609 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-24ed9f08-eb47-4048-b3b5-a2e8dee5bf3f tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:50.101635 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-24ed9f08-eb47-4048-b3b5-a2e8dee5bf3f tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '193bf7a17f544770a27c07f6b8cc0988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243c0b9b4bd742659061745c8dc4c696', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:53:50.109847 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-24ed9f08-eb47-4048-b3b5-a2e8dee5bf3f tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] 10.222.0.36 "GET /compute/v2.1/servers/9209310f-9812-4e8e-9a64-a46690948204" status: 200 len: 1145 microversion: 2.1 time: 0.086852 Oct 15 13:53:50.110415 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 301/593] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:53:50 2022] GET /compute/v2.1/servers/9209310f-9812-4e8e-9a64-a46690948204 => generated 1145 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:53:50.714029 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-29d795ab-1638-452e-b0bd-d6328ee6ab3f tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:53:50.714632 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-29d795ab-1638-452e-b0bd-d6328ee6ab3f tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 5fc359cf-ff2c-4189-b058-31eb3c97568c] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:53:50.721780 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-29d795ab-1638-452e-b0bd-d6328ee6ab3f tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:50.722275 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-29d795ab-1638-452e-b0bd-d6328ee6ab3f tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:50.722717 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-29d795ab-1638-452e-b0bd-d6328ee6ab3f tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:50.723419 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-29d795ab-1638-452e-b0bd-d6328ee6ab3f tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:50.723890 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-29d795ab-1638-452e-b0bd-d6328ee6ab3f tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:50.724315 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-29d795ab-1638-452e-b0bd-d6328ee6ab3f tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:50.864767 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-29d795ab-1638-452e-b0bd-d6328ee6ab3f tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:53:50.877614 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-29d795ab-1638-452e-b0bd-d6328ee6ab3f tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:53:50.879107 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-29d795ab-1638-452e-b0bd-d6328ee6ab3f tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:53:50.880326 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-29d795ab-1638-452e-b0bd-d6328ee6ab3f tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c" status: 200 len: 1808 microversion: 2.20 time: 0.170294 Oct 15 13:53:50.880910 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 302/594] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:53:50 2022] GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c => generated 1808 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 13:53:51.134163 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-a37b3368-6b30-4367-910f-9d6801e5717e tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:53:51.134851 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-a37b3368-6b30-4367-910f-9d6801e5717e tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] [instance: 9209310f-9812-4e8e-9a64-a46690948204] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:53:51.141814 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-a37b3368-6b30-4367-910f-9d6801e5717e tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:51.142301 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-a37b3368-6b30-4367-910f-9d6801e5717e tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:51.142726 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-a37b3368-6b30-4367-910f-9d6801e5717e tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:51.143409 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-a37b3368-6b30-4367-910f-9d6801e5717e tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:51.143853 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-a37b3368-6b30-4367-910f-9d6801e5717e tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:51.144304 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-a37b3368-6b30-4367-910f-9d6801e5717e tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:51.215707 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-a37b3368-6b30-4367-910f-9d6801e5717e tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '193bf7a17f544770a27c07f6b8cc0988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243c0b9b4bd742659061745c8dc4c696', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:53:51.218025 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG dbcounter [-] [125242] Writing DB stats nova_cell1:SELECT=100 {{(pid=125242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:53:51.225143 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-a37b3368-6b30-4367-910f-9d6801e5717e tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] 10.222.0.36 "GET /compute/v2.1/servers/9209310f-9812-4e8e-9a64-a46690948204" status: 200 len: 1145 microversion: 2.1 time: 0.094966 Oct 15 13:53:51.225722 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 303/595] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:53:51 2022] GET /compute/v2.1/servers/9209310f-9812-4e8e-9a64-a46690948204 => generated 1145 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:53:51.906264 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-a2f14c32-c592-4414-a8db-fbe5afa84b45 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:53:51.906840 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-a2f14c32-c592-4414-a8db-fbe5afa84b45 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 5fc359cf-ff2c-4189-b058-31eb3c97568c] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:53:51.913267 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-a2f14c32-c592-4414-a8db-fbe5afa84b45 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:51.913756 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-a2f14c32-c592-4414-a8db-fbe5afa84b45 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:51.914183 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-a2f14c32-c592-4414-a8db-fbe5afa84b45 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:51.914865 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-a2f14c32-c592-4414-a8db-fbe5afa84b45 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:51.915315 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-a2f14c32-c592-4414-a8db-fbe5afa84b45 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:51.915737 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-a2f14c32-c592-4414-a8db-fbe5afa84b45 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:52.055488 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-a2f14c32-c592-4414-a8db-fbe5afa84b45 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:53:52.065167 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-a2f14c32-c592-4414-a8db-fbe5afa84b45 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:53:52.066681 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-a2f14c32-c592-4414-a8db-fbe5afa84b45 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:53:52.067862 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-a2f14c32-c592-4414-a8db-fbe5afa84b45 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c" status: 200 len: 1808 microversion: 2.20 time: 0.165752 Oct 15 13:53:52.068676 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 304/596] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:53:51 2022] GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c => generated 1808 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 13:53:52.309942 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-f4228d1e-d2f3-432f-8796-44f35a0bd6b6 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:53:52.310762 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-f4228d1e-d2f3-432f-8796-44f35a0bd6b6 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] [instance: 9209310f-9812-4e8e-9a64-a46690948204] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:53:52.317825 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-f4228d1e-d2f3-432f-8796-44f35a0bd6b6 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:52.318354 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-f4228d1e-d2f3-432f-8796-44f35a0bd6b6 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:52.318786 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-f4228d1e-d2f3-432f-8796-44f35a0bd6b6 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:52.319499 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-f4228d1e-d2f3-432f-8796-44f35a0bd6b6 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:52.319979 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-f4228d1e-d2f3-432f-8796-44f35a0bd6b6 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:52.320376 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-f4228d1e-d2f3-432f-8796-44f35a0bd6b6 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:52.391432 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-f4228d1e-d2f3-432f-8796-44f35a0bd6b6 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '193bf7a17f544770a27c07f6b8cc0988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243c0b9b4bd742659061745c8dc4c696', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:53:52.399784 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-f4228d1e-d2f3-432f-8796-44f35a0bd6b6 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] 10.222.0.36 "GET /compute/v2.1/servers/9209310f-9812-4e8e-9a64-a46690948204" status: 200 len: 1145 microversion: 2.1 time: 0.093719 Oct 15 13:53:52.400403 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 305/597] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:53:52 2022] GET /compute/v2.1/servers/9209310f-9812-4e8e-9a64-a46690948204 => generated 1145 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:53:53.095540 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-418e5d12-9fd1-42bd-bd88-bdf7e401c7a6 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:53:53.096129 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-418e5d12-9fd1-42bd-bd88-bdf7e401c7a6 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 5fc359cf-ff2c-4189-b058-31eb3c97568c] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:53:53.102736 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-418e5d12-9fd1-42bd-bd88-bdf7e401c7a6 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:53.103237 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-418e5d12-9fd1-42bd-bd88-bdf7e401c7a6 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:53.103675 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-418e5d12-9fd1-42bd-bd88-bdf7e401c7a6 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:53.105182 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-418e5d12-9fd1-42bd-bd88-bdf7e401c7a6 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:53.105182 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-418e5d12-9fd1-42bd-bd88-bdf7e401c7a6 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:53.105709 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-418e5d12-9fd1-42bd-bd88-bdf7e401c7a6 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:53.245857 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-418e5d12-9fd1-42bd-bd88-bdf7e401c7a6 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:53:53.255370 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-418e5d12-9fd1-42bd-bd88-bdf7e401c7a6 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:53:53.256915 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-418e5d12-9fd1-42bd-bd88-bdf7e401c7a6 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:53:53.258082 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-418e5d12-9fd1-42bd-bd88-bdf7e401c7a6 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c" status: 200 len: 1808 microversion: 2.20 time: 0.168020 Oct 15 13:53:53.258680 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 306/598] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:53:53 2022] GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c => generated 1808 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 13:53:53.423463 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-f59f5f80-f231-4181-a78c-dd4d6bbdcbdf tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:53:53.424200 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-f59f5f80-f231-4181-a78c-dd4d6bbdcbdf tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] [instance: 9209310f-9812-4e8e-9a64-a46690948204] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:53:53.430990 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-f59f5f80-f231-4181-a78c-dd4d6bbdcbdf tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:53.431473 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-f59f5f80-f231-4181-a78c-dd4d6bbdcbdf tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:53.431940 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-f59f5f80-f231-4181-a78c-dd4d6bbdcbdf tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:53.432651 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-f59f5f80-f231-4181-a78c-dd4d6bbdcbdf tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:53.433104 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-f59f5f80-f231-4181-a78c-dd4d6bbdcbdf tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:53.433521 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-f59f5f80-f231-4181-a78c-dd4d6bbdcbdf tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:53.496418 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-f59f5f80-f231-4181-a78c-dd4d6bbdcbdf tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '193bf7a17f544770a27c07f6b8cc0988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243c0b9b4bd742659061745c8dc4c696', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:53:53.504953 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-f59f5f80-f231-4181-a78c-dd4d6bbdcbdf tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] 10.222.0.36 "GET /compute/v2.1/servers/9209310f-9812-4e8e-9a64-a46690948204" status: 200 len: 1145 microversion: 2.1 time: 0.085478 Oct 15 13:53:53.505745 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 307/599] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:53:53 2022] GET /compute/v2.1/servers/9209310f-9812-4e8e-9a64-a46690948204 => generated 1145 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:53:54.287369 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-faa37c8d-0efa-4a29-a3c2-cbeb36ae5b0a tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:53:54.288117 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-faa37c8d-0efa-4a29-a3c2-cbeb36ae5b0a tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 5fc359cf-ff2c-4189-b058-31eb3c97568c] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:53:54.290874 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG dbcounter [-] [125242] Writing DB stats nova_cell0:SELECT=2 {{(pid=125242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:53:54.298661 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-faa37c8d-0efa-4a29-a3c2-cbeb36ae5b0a tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:54.299142 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-faa37c8d-0efa-4a29-a3c2-cbeb36ae5b0a tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:54.299587 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-faa37c8d-0efa-4a29-a3c2-cbeb36ae5b0a tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:54.300294 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-faa37c8d-0efa-4a29-a3c2-cbeb36ae5b0a tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:54.300749 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-faa37c8d-0efa-4a29-a3c2-cbeb36ae5b0a tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:54.301175 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-faa37c8d-0efa-4a29-a3c2-cbeb36ae5b0a tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:54.450178 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-faa37c8d-0efa-4a29-a3c2-cbeb36ae5b0a tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:53:54.459662 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-faa37c8d-0efa-4a29-a3c2-cbeb36ae5b0a tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:53:54.461150 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-faa37c8d-0efa-4a29-a3c2-cbeb36ae5b0a tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:53:54.462333 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-faa37c8d-0efa-4a29-a3c2-cbeb36ae5b0a tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c" status: 200 len: 1808 microversion: 2.20 time: 0.181503 Oct 15 13:53:54.462923 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 308/600] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:53:54 2022] GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c => generated 1808 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 13:53:54.529353 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-a323e5c3-adb8-4265-8f3a-9a932a1909ee tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:53:54.529952 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-a323e5c3-adb8-4265-8f3a-9a932a1909ee tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] [instance: 9209310f-9812-4e8e-9a64-a46690948204] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:53:54.531960 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG dbcounter [-] [125242] Writing DB stats nova_cell0:SELECT=8 {{(pid=125242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:53:54.537668 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-a323e5c3-adb8-4265-8f3a-9a932a1909ee tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:54.538155 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-a323e5c3-adb8-4265-8f3a-9a932a1909ee tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:54.538577 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-a323e5c3-adb8-4265-8f3a-9a932a1909ee tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:54.539258 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-a323e5c3-adb8-4265-8f3a-9a932a1909ee tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:54.539698 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-a323e5c3-adb8-4265-8f3a-9a932a1909ee tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:54.540140 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-a323e5c3-adb8-4265-8f3a-9a932a1909ee tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:54.609399 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-a323e5c3-adb8-4265-8f3a-9a932a1909ee tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '193bf7a17f544770a27c07f6b8cc0988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243c0b9b4bd742659061745c8dc4c696', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:53:54.617224 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-a323e5c3-adb8-4265-8f3a-9a932a1909ee tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] 10.222.0.36 "GET /compute/v2.1/servers/9209310f-9812-4e8e-9a64-a46690948204" status: 200 len: 1145 microversion: 2.1 time: 0.091740 Oct 15 13:53:54.617782 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 309/601] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:53:54 2022] GET /compute/v2.1/servers/9209310f-9812-4e8e-9a64-a46690948204 => generated 1145 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:53:55.488411 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-fec34a01-6741-45ae-8eb0-843ef816fa65 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:53:55.489216 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-fec34a01-6741-45ae-8eb0-843ef816fa65 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 5fc359cf-ff2c-4189-b058-31eb3c97568c] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:53:55.496051 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-fec34a01-6741-45ae-8eb0-843ef816fa65 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:55.496549 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-fec34a01-6741-45ae-8eb0-843ef816fa65 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:55.496987 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-fec34a01-6741-45ae-8eb0-843ef816fa65 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:55.497691 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-fec34a01-6741-45ae-8eb0-843ef816fa65 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:55.498143 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-fec34a01-6741-45ae-8eb0-843ef816fa65 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:55.498569 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-fec34a01-6741-45ae-8eb0-843ef816fa65 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:55.636253 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-fec34a01-6741-45ae-8eb0-843ef816fa65 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:53:55.645778 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-fec34a01-6741-45ae-8eb0-843ef816fa65 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:53:55.647233 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-fec34a01-6741-45ae-8eb0-843ef816fa65 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:53:55.648453 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-fec34a01-6741-45ae-8eb0-843ef816fa65 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c" status: 200 len: 1808 microversion: 2.20 time: 0.164478 Oct 15 13:53:55.649031 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 310/602] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:53:55 2022] GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c => generated 1808 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 13:53:55.653366 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-a7a19fb0-7a04-4079-a716-ad410f4d1bea tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:53:55.653964 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-a7a19fb0-7a04-4079-a716-ad410f4d1bea tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] [instance: 9209310f-9812-4e8e-9a64-a46690948204] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:53:55.660076 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-a7a19fb0-7a04-4079-a716-ad410f4d1bea tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:55.660569 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-a7a19fb0-7a04-4079-a716-ad410f4d1bea tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:55.661004 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-a7a19fb0-7a04-4079-a716-ad410f4d1bea tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:55.661693 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-a7a19fb0-7a04-4079-a716-ad410f4d1bea tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:55.662144 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-a7a19fb0-7a04-4079-a716-ad410f4d1bea tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:55.662542 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-a7a19fb0-7a04-4079-a716-ad410f4d1bea tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:55.730905 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-a7a19fb0-7a04-4079-a716-ad410f4d1bea tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '193bf7a17f544770a27c07f6b8cc0988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243c0b9b4bd742659061745c8dc4c696', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:53:55.740870 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-a7a19fb0-7a04-4079-a716-ad410f4d1bea tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] 10.222.0.36 "GET /compute/v2.1/servers/9209310f-9812-4e8e-9a64-a46690948204" status: 200 len: 1145 microversion: 2.1 time: 0.090810 Oct 15 13:53:55.741358 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 311/603] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:53:55 2022] GET /compute/v2.1/servers/9209310f-9812-4e8e-9a64-a46690948204 => generated 1145 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:53:56.674550 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-e7a94b46-b173-4506-bec7-4573eff13290 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:53:56.675219 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-e7a94b46-b173-4506-bec7-4573eff13290 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 5fc359cf-ff2c-4189-b058-31eb3c97568c] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:53:56.681982 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-e7a94b46-b173-4506-bec7-4573eff13290 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:56.682463 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-e7a94b46-b173-4506-bec7-4573eff13290 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:56.682891 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-e7a94b46-b173-4506-bec7-4573eff13290 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:56.683585 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-e7a94b46-b173-4506-bec7-4573eff13290 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:56.684063 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-e7a94b46-b173-4506-bec7-4573eff13290 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:56.684479 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-e7a94b46-b173-4506-bec7-4573eff13290 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:56.829916 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-e7a94b46-b173-4506-bec7-4573eff13290 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:53:56.843943 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-e7a94b46-b173-4506-bec7-4573eff13290 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:53:56.846242 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-e7a94b46-b173-4506-bec7-4573eff13290 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:53:56.847400 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-e7a94b46-b173-4506-bec7-4573eff13290 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c" status: 200 len: 1808 microversion: 2.20 time: 0.176994 Oct 15 13:53:56.847958 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 312/604] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:53:56 2022] GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c => generated 1808 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 13:53:56.852281 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-c355b25d-f98c-433b-94b8-efb04a69dcf1 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:53:56.852880 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-c355b25d-f98c-433b-94b8-efb04a69dcf1 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] [instance: 9209310f-9812-4e8e-9a64-a46690948204] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:53:56.859063 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-c355b25d-f98c-433b-94b8-efb04a69dcf1 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:56.859547 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-c355b25d-f98c-433b-94b8-efb04a69dcf1 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:56.860014 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-c355b25d-f98c-433b-94b8-efb04a69dcf1 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:56.860825 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-c355b25d-f98c-433b-94b8-efb04a69dcf1 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:56.861331 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-c355b25d-f98c-433b-94b8-efb04a69dcf1 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:56.861751 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-c355b25d-f98c-433b-94b8-efb04a69dcf1 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:56.922614 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-c355b25d-f98c-433b-94b8-efb04a69dcf1 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '193bf7a17f544770a27c07f6b8cc0988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243c0b9b4bd742659061745c8dc4c696', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:53:56.931069 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-c355b25d-f98c-433b-94b8-efb04a69dcf1 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] 10.222.0.36 "GET /compute/v2.1/servers/9209310f-9812-4e8e-9a64-a46690948204" status: 200 len: 1145 microversion: 2.1 time: 0.082009 Oct 15 13:53:56.931553 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 313/605] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:53:56 2022] GET /compute/v2.1/servers/9209310f-9812-4e8e-9a64-a46690948204 => generated 1145 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:53:57.612262 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-6c10d0a4-3895-4833-b72a-cb7f23010b61 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] 10.222.0.36 "POST /compute/v2.1/servers/cb269dd0-b5af-4013-9ded-062f40176b8f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 18.473709 Oct 15 13:53:57.618581 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 293/606] 10.222.0.36 () {60 vars in 1323 bytes} [Sat Oct 15 13:53:39 2022] POST /compute/v2.1/servers/cb269dd0-b5af-4013-9ded-062f40176b8f/os-volume_attachments => generated 194 bytes in 18481 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 13:53:57.872795 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-fd4e0c2f-6e45-4b34-8426-2417b1d65292 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:53:57.874144 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-fd4e0c2f-6e45-4b34-8426-2417b1d65292 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 5fc359cf-ff2c-4189-b058-31eb3c97568c] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:53:57.881587 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-fd4e0c2f-6e45-4b34-8426-2417b1d65292 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:57.882233 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-fd4e0c2f-6e45-4b34-8426-2417b1d65292 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:57.883000 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-fd4e0c2f-6e45-4b34-8426-2417b1d65292 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:57.883856 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-fd4e0c2f-6e45-4b34-8426-2417b1d65292 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:57.884509 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-fd4e0c2f-6e45-4b34-8426-2417b1d65292 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:57.885189 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-fd4e0c2f-6e45-4b34-8426-2417b1d65292 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:57.956008 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-04f08577-b32f-437a-92dc-c73ce7254626 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:53:57.956802 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-04f08577-b32f-437a-92dc-c73ce7254626 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] [instance: 9209310f-9812-4e8e-9a64-a46690948204] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:53:57.964121 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-04f08577-b32f-437a-92dc-c73ce7254626 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:57.965097 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-04f08577-b32f-437a-92dc-c73ce7254626 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:57.965470 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-04f08577-b32f-437a-92dc-c73ce7254626 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:57.966181 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-04f08577-b32f-437a-92dc-c73ce7254626 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:57.966623 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-04f08577-b32f-437a-92dc-c73ce7254626 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:57.967050 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-04f08577-b32f-437a-92dc-c73ce7254626 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:58.062472 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-04f08577-b32f-437a-92dc-c73ce7254626 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '193bf7a17f544770a27c07f6b8cc0988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243c0b9b4bd742659061745c8dc4c696', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:53:58.071471 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-04f08577-b32f-437a-92dc-c73ce7254626 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] 10.222.0.36 "GET /compute/v2.1/servers/9209310f-9812-4e8e-9a64-a46690948204" status: 200 len: 1193 microversion: 2.1 time: 0.120498 Oct 15 13:53:58.072414 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 294/607] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:53:57 2022] GET /compute/v2.1/servers/9209310f-9812-4e8e-9a64-a46690948204 => generated 1193 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 13:53:58.118975 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-fd4e0c2f-6e45-4b34-8426-2417b1d65292 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:53:58.129441 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-fd4e0c2f-6e45-4b34-8426-2417b1d65292 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:53:58.130878 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-fd4e0c2f-6e45-4b34-8426-2417b1d65292 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:53:58.132094 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-fd4e0c2f-6e45-4b34-8426-2417b1d65292 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c" status: 200 len: 1808 microversion: 2.20 time: 0.263362 Oct 15 13:53:58.132671 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 314/608] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:53:57 2022] GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c => generated 1808 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 13:53:59.096569 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-25059b90-b44e-4bf5-a45f-2fdbd0132b04 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:53:59.097317 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-25059b90-b44e-4bf5-a45f-2fdbd0132b04 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] [instance: 9209310f-9812-4e8e-9a64-a46690948204] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:53:59.104894 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-25059b90-b44e-4bf5-a45f-2fdbd0132b04 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:59.105485 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-25059b90-b44e-4bf5-a45f-2fdbd0132b04 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:59.105924 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-25059b90-b44e-4bf5-a45f-2fdbd0132b04 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:59.106641 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-25059b90-b44e-4bf5-a45f-2fdbd0132b04 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:59.107096 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-25059b90-b44e-4bf5-a45f-2fdbd0132b04 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:59.107521 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-25059b90-b44e-4bf5-a45f-2fdbd0132b04 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:59.305084 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-b288d23d-8dcc-4c6e-90d1-2cd3bb9aeb05 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:53:59.306677 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-b288d23d-8dcc-4c6e-90d1-2cd3bb9aeb05 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 5fc359cf-ff2c-4189-b058-31eb3c97568c] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:53:59.316201 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-b288d23d-8dcc-4c6e-90d1-2cd3bb9aeb05 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:59.316702 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-b288d23d-8dcc-4c6e-90d1-2cd3bb9aeb05 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:59.317137 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-b288d23d-8dcc-4c6e-90d1-2cd3bb9aeb05 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:59.317859 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-b288d23d-8dcc-4c6e-90d1-2cd3bb9aeb05 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:53:59.318329 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-b288d23d-8dcc-4c6e-90d1-2cd3bb9aeb05 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:53:59.318733 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-b288d23d-8dcc-4c6e-90d1-2cd3bb9aeb05 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:53:59.379056 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-25059b90-b44e-4bf5-a45f-2fdbd0132b04 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '193bf7a17f544770a27c07f6b8cc0988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243c0b9b4bd742659061745c8dc4c696', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:53:59.391408 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-25059b90-b44e-4bf5-a45f-2fdbd0132b04 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] 10.222.0.36 "GET /compute/v2.1/servers/9209310f-9812-4e8e-9a64-a46690948204" status: 200 len: 1279 microversion: 2.1 time: 0.299245 Oct 15 13:53:59.397742 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 295/609] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:53:59 2022] GET /compute/v2.1/servers/9209310f-9812-4e8e-9a64-a46690948204 => generated 1279 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:53:59.825701 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-b288d23d-8dcc-4c6e-90d1-2cd3bb9aeb05 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:53:59.835189 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-b288d23d-8dcc-4c6e-90d1-2cd3bb9aeb05 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:53:59.836694 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-b288d23d-8dcc-4c6e-90d1-2cd3bb9aeb05 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:53:59.837899 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-b288d23d-8dcc-4c6e-90d1-2cd3bb9aeb05 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c" status: 200 len: 1808 microversion: 2.20 time: 0.683537 Oct 15 13:53:59.839859 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 315/610] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:53:59 2022] GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c => generated 1808 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 15 13:54:00.429765 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-5dff3ab0-4b45-471b-a479-15edacba4215 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:54:00.430900 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-5dff3ab0-4b45-471b-a479-15edacba4215 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] [instance: 9209310f-9812-4e8e-9a64-a46690948204] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:54:00.443616 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-5dff3ab0-4b45-471b-a479-15edacba4215 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:00.444517 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-5dff3ab0-4b45-471b-a479-15edacba4215 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:00.445300 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-5dff3ab0-4b45-471b-a479-15edacba4215 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:00.446532 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-5dff3ab0-4b45-471b-a479-15edacba4215 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:00.447186 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-5dff3ab0-4b45-471b-a479-15edacba4215 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:00.447730 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-5dff3ab0-4b45-471b-a479-15edacba4215 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:00.458611 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [req-c31e16fd-c64a-42b1-ba78-38d9110024c0 req-06aba33f-c70f-4544-9611-5c276262f607 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9209310f-9812-4e8e-9a64-a46690948204", "tag": "35cb3e4c-0e68-4b14-9bc8-fb35d5b7a493"}]} {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 13:54:00.481162 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [req-c31e16fd-c64a-42b1-ba78-38d9110024c0 req-06aba33f-c70f-4544-9611-5c276262f607 service nova] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:00.482667 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [req-c31e16fd-c64a-42b1-ba78-38d9110024c0 req-06aba33f-c70f-4544-9611-5c276262f607 service nova] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:00.483651 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [req-c31e16fd-c64a-42b1-ba78-38d9110024c0 req-06aba33f-c70f-4544-9611-5c276262f607 service nova] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:00.496899 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.compute.server_external_events [req-c31e16fd-c64a-42b1-ba78-38d9110024c0 req-06aba33f-c70f-4544-9611-5c276262f607 service nova] Creating event network-changed:35cb3e4c-0e68-4b14-9bc8-fb35d5b7a493 for instance 9209310f-9812-4e8e-9a64-a46690948204 on hv-cinder-86149 Oct 15 13:54:00.502228 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [req-c31e16fd-c64a-42b1-ba78-38d9110024c0 req-06aba33f-c70f-4544-9611-5c276262f607 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047070 Oct 15 13:54:00.502542 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 316/611] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 15 13:54:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 13:54:00.603252 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-c317cfe5-4046-4eb6-b910-e4b329cc08e1 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f64596ec-21fa-42a5-b214-e2e5510e40e0", "device": "/dev/sdb"}} {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 13:54:00.607358 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-c317cfe5-4046-4eb6-b910-e4b329cc08e1 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] [instance: d6ce134b-a723-453b-8847-b0725e969e89] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:54:00.614419 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-c317cfe5-4046-4eb6-b910-e4b329cc08e1 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:00.614911 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-c317cfe5-4046-4eb6-b910-e4b329cc08e1 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:00.615349 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-c317cfe5-4046-4eb6-b910-e4b329cc08e1 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:00.616110 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-c317cfe5-4046-4eb6-b910-e4b329cc08e1 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:00.616564 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-c317cfe5-4046-4eb6-b910-e4b329cc08e1 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:00.616985 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-c317cfe5-4046-4eb6-b910-e4b329cc08e1 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:00.711320 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-5dff3ab0-4b45-471b-a479-15edacba4215 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '193bf7a17f544770a27c07f6b8cc0988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243c0b9b4bd742659061745c8dc4c696', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:54:00.719184 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-5dff3ab0-4b45-471b-a479-15edacba4215 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] 10.222.0.36 "GET /compute/v2.1/servers/9209310f-9812-4e8e-9a64-a46690948204" status: 200 len: 1279 microversion: 2.1 time: 0.297293 Oct 15 13:54:00.720431 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 296/612] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:54:00 2022] GET /compute/v2.1/servers/9209310f-9812-4e8e-9a64-a46690948204 => generated 1279 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:54:00.865032 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-c409183a-8198-4bf2-8f7f-84550399b9cd tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:54:00.866134 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-c409183a-8198-4bf2-8f7f-84550399b9cd tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 5fc359cf-ff2c-4189-b058-31eb3c97568c] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:54:00.892402 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-c409183a-8198-4bf2-8f7f-84550399b9cd tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:00.893263 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-c409183a-8198-4bf2-8f7f-84550399b9cd tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:00.893741 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-c409183a-8198-4bf2-8f7f-84550399b9cd tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:00.894693 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-c409183a-8198-4bf2-8f7f-84550399b9cd tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:00.895193 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-c409183a-8198-4bf2-8f7f-84550399b9cd tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:00.895656 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-c409183a-8198-4bf2-8f7f-84550399b9cd tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:00.953383 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-c317cfe5-4046-4eb6-b910-e4b329cc08e1 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] 10.222.0.36 "POST /compute/v2.1/servers/d6ce134b-a723-453b-8847-b0725e969e89/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.354403 Oct 15 13:54:00.954030 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 317/613] 10.222.0.36 () {60 vars in 1323 bytes} [Sat Oct 15 13:54:00 2022] POST /compute/v2.1/servers/d6ce134b-a723-453b-8847-b0725e969e89/os-volume_attachments => generated 194 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 15 13:54:01.122597 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-c409183a-8198-4bf2-8f7f-84550399b9cd tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:54:01.133205 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-c409183a-8198-4bf2-8f7f-84550399b9cd tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:54:01.134809 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-c409183a-8198-4bf2-8f7f-84550399b9cd tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:54:01.136043 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-c409183a-8198-4bf2-8f7f-84550399b9cd tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c" status: 200 len: 1808 microversion: 2.20 time: 0.275785 Oct 15 13:54:01.136714 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 297/614] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:54:00 2022] GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c => generated 1808 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 15 13:54:01.744358 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-5ad032e1-9e43-4385-87a8-1d022e7b1fdc tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:54:01.745060 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-5ad032e1-9e43-4385-87a8-1d022e7b1fdc tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] [instance: 9209310f-9812-4e8e-9a64-a46690948204] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:54:01.752736 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-5ad032e1-9e43-4385-87a8-1d022e7b1fdc tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:01.753327 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-5ad032e1-9e43-4385-87a8-1d022e7b1fdc tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:01.753962 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-5ad032e1-9e43-4385-87a8-1d022e7b1fdc tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:01.754711 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-5ad032e1-9e43-4385-87a8-1d022e7b1fdc tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:01.755258 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-5ad032e1-9e43-4385-87a8-1d022e7b1fdc tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:01.755712 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-5ad032e1-9e43-4385-87a8-1d022e7b1fdc tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:01.917912 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-5ad032e1-9e43-4385-87a8-1d022e7b1fdc tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '193bf7a17f544770a27c07f6b8cc0988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243c0b9b4bd742659061745c8dc4c696', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:54:01.930612 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-5ad032e1-9e43-4385-87a8-1d022e7b1fdc tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] 10.222.0.36 "GET /compute/v2.1/servers/9209310f-9812-4e8e-9a64-a46690948204" status: 200 len: 1279 microversion: 2.1 time: 0.190620 Oct 15 13:54:01.931568 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 318/615] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:54:01 2022] GET /compute/v2.1/servers/9209310f-9812-4e8e-9a64-a46690948204 => generated 1279 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:54:02.162101 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-fece3eb5-7ad4-4bf0-9973-6ee54db20728 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:54:02.162650 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-fece3eb5-7ad4-4bf0-9973-6ee54db20728 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 5fc359cf-ff2c-4189-b058-31eb3c97568c] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:54:02.170511 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-fece3eb5-7ad4-4bf0-9973-6ee54db20728 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:02.171002 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-fece3eb5-7ad4-4bf0-9973-6ee54db20728 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:02.171503 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-fece3eb5-7ad4-4bf0-9973-6ee54db20728 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:02.172258 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-fece3eb5-7ad4-4bf0-9973-6ee54db20728 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:02.172712 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-fece3eb5-7ad4-4bf0-9973-6ee54db20728 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:02.173133 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-fece3eb5-7ad4-4bf0-9973-6ee54db20728 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:02.320335 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-fece3eb5-7ad4-4bf0-9973-6ee54db20728 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:54:02.329512 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-fece3eb5-7ad4-4bf0-9973-6ee54db20728 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:54:02.331216 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-fece3eb5-7ad4-4bf0-9973-6ee54db20728 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:54:02.332405 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-fece3eb5-7ad4-4bf0-9973-6ee54db20728 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c" status: 200 len: 1808 microversion: 2.20 time: 0.174575 Oct 15 13:54:02.332995 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 298/616] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:54:02 2022] GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c => generated 1808 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 13:54:02.954155 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-42c36e78-1b99-4f25-bcfb-a89c285be769 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:54:02.955674 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-42c36e78-1b99-4f25-bcfb-a89c285be769 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] [instance: 9209310f-9812-4e8e-9a64-a46690948204] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:54:02.962827 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-42c36e78-1b99-4f25-bcfb-a89c285be769 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:02.963335 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-42c36e78-1b99-4f25-bcfb-a89c285be769 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:02.963772 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-42c36e78-1b99-4f25-bcfb-a89c285be769 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:02.964518 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-42c36e78-1b99-4f25-bcfb-a89c285be769 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:02.964981 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-42c36e78-1b99-4f25-bcfb-a89c285be769 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:02.965414 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-42c36e78-1b99-4f25-bcfb-a89c285be769 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:03.130251 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-42c36e78-1b99-4f25-bcfb-a89c285be769 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '193bf7a17f544770a27c07f6b8cc0988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243c0b9b4bd742659061745c8dc4c696', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:54:03.132650 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG dbcounter [-] [125242] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:54:03.139449 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-42c36e78-1b99-4f25-bcfb-a89c285be769 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] 10.222.0.36 "GET /compute/v2.1/servers/9209310f-9812-4e8e-9a64-a46690948204" status: 200 len: 1279 microversion: 2.1 time: 0.189395 Oct 15 13:54:03.140076 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 319/617] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:54:02 2022] GET /compute/v2.1/servers/9209310f-9812-4e8e-9a64-a46690948204 => generated 1279 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:54:03.359205 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-dbad34eb-0542-40af-a155-c008eb664793 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:54:03.359819 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-dbad34eb-0542-40af-a155-c008eb664793 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 5fc359cf-ff2c-4189-b058-31eb3c97568c] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:54:03.367341 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-dbad34eb-0542-40af-a155-c008eb664793 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:03.367838 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-dbad34eb-0542-40af-a155-c008eb664793 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:03.368341 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-dbad34eb-0542-40af-a155-c008eb664793 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:03.369034 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-dbad34eb-0542-40af-a155-c008eb664793 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:03.369487 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-dbad34eb-0542-40af-a155-c008eb664793 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:03.369912 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-dbad34eb-0542-40af-a155-c008eb664793 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:03.532538 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-dbad34eb-0542-40af-a155-c008eb664793 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:54:03.542639 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-dbad34eb-0542-40af-a155-c008eb664793 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:54:03.544399 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-dbad34eb-0542-40af-a155-c008eb664793 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:54:03.545568 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-dbad34eb-0542-40af-a155-c008eb664793 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c" status: 200 len: 1808 microversion: 2.20 time: 0.190488 Oct 15 13:54:03.546135 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 299/618] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:54:03 2022] GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c => generated 1808 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 13:54:04.163963 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-d2d1ac4e-e50a-4618-b1fa-0df84ffe193f tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:54:04.164546 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-d2d1ac4e-e50a-4618-b1fa-0df84ffe193f tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] [instance: 9209310f-9812-4e8e-9a64-a46690948204] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:54:04.172953 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-d2d1ac4e-e50a-4618-b1fa-0df84ffe193f tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:04.173511 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-d2d1ac4e-e50a-4618-b1fa-0df84ffe193f tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:04.174175 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-d2d1ac4e-e50a-4618-b1fa-0df84ffe193f tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:04.174881 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-d2d1ac4e-e50a-4618-b1fa-0df84ffe193f tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:04.175371 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-d2d1ac4e-e50a-4618-b1fa-0df84ffe193f tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:04.175811 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-d2d1ac4e-e50a-4618-b1fa-0df84ffe193f tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:04.332511 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-d2d1ac4e-e50a-4618-b1fa-0df84ffe193f tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '193bf7a17f544770a27c07f6b8cc0988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243c0b9b4bd742659061745c8dc4c696', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:54:04.341400 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-d2d1ac4e-e50a-4618-b1fa-0df84ffe193f tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] 10.222.0.36 "GET /compute/v2.1/servers/9209310f-9812-4e8e-9a64-a46690948204" status: 200 len: 1279 microversion: 2.1 time: 0.181327 Oct 15 13:54:04.341987 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 320/619] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:54:04 2022] GET /compute/v2.1/servers/9209310f-9812-4e8e-9a64-a46690948204 => generated 1279 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:54:04.572661 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-daacdcb7-2b1d-4ac1-b1a8-05433d6a3b6d tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:54:04.573321 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-daacdcb7-2b1d-4ac1-b1a8-05433d6a3b6d tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 5fc359cf-ff2c-4189-b058-31eb3c97568c] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:54:04.580567 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-daacdcb7-2b1d-4ac1-b1a8-05433d6a3b6d tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:04.581059 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-daacdcb7-2b1d-4ac1-b1a8-05433d6a3b6d tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:04.581492 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-daacdcb7-2b1d-4ac1-b1a8-05433d6a3b6d tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:04.582194 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-daacdcb7-2b1d-4ac1-b1a8-05433d6a3b6d tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:04.582633 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-daacdcb7-2b1d-4ac1-b1a8-05433d6a3b6d tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:04.583048 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-daacdcb7-2b1d-4ac1-b1a8-05433d6a3b6d tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:04.743348 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-daacdcb7-2b1d-4ac1-b1a8-05433d6a3b6d tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:54:04.752421 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-daacdcb7-2b1d-4ac1-b1a8-05433d6a3b6d tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:54:04.753850 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-daacdcb7-2b1d-4ac1-b1a8-05433d6a3b6d tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:54:04.755113 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-daacdcb7-2b1d-4ac1-b1a8-05433d6a3b6d tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c" status: 200 len: 1808 microversion: 2.20 time: 0.186881 Oct 15 13:54:04.755663 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 300/620] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:54:04 2022] GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c => generated 1808 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 13:54:05.381447 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-b098b60e-4170-4f19-9e6c-2f2270fad160 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:54:05.382051 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-b098b60e-4170-4f19-9e6c-2f2270fad160 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] [instance: 9209310f-9812-4e8e-9a64-a46690948204] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:54:05.389022 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-b098b60e-4170-4f19-9e6c-2f2270fad160 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:05.389507 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-b098b60e-4170-4f19-9e6c-2f2270fad160 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:05.389943 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-b098b60e-4170-4f19-9e6c-2f2270fad160 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:05.390638 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-b098b60e-4170-4f19-9e6c-2f2270fad160 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:05.391082 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-b098b60e-4170-4f19-9e6c-2f2270fad160 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:05.391498 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-b098b60e-4170-4f19-9e6c-2f2270fad160 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:05.545697 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-b098b60e-4170-4f19-9e6c-2f2270fad160 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '193bf7a17f544770a27c07f6b8cc0988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243c0b9b4bd742659061745c8dc4c696', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:54:05.554239 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-b098b60e-4170-4f19-9e6c-2f2270fad160 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] 10.222.0.36 "GET /compute/v2.1/servers/9209310f-9812-4e8e-9a64-a46690948204" status: 200 len: 1279 microversion: 2.1 time: 0.176764 Oct 15 13:54:05.554822 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 321/621] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:54:05 2022] GET /compute/v2.1/servers/9209310f-9812-4e8e-9a64-a46690948204 => generated 1279 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:54:05.781857 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-f75b8192-3026-4e58-9163-703368c7e469 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:54:05.783558 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-f75b8192-3026-4e58-9163-703368c7e469 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 5fc359cf-ff2c-4189-b058-31eb3c97568c] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:54:05.792747 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-f75b8192-3026-4e58-9163-703368c7e469 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:05.793608 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-f75b8192-3026-4e58-9163-703368c7e469 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:05.794042 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-f75b8192-3026-4e58-9163-703368c7e469 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:05.794757 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-f75b8192-3026-4e58-9163-703368c7e469 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:05.795204 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-f75b8192-3026-4e58-9163-703368c7e469 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:05.795628 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-f75b8192-3026-4e58-9163-703368c7e469 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:05.948193 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-f75b8192-3026-4e58-9163-703368c7e469 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:54:05.959058 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-f75b8192-3026-4e58-9163-703368c7e469 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:54:05.960515 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-f75b8192-3026-4e58-9163-703368c7e469 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:54:05.961718 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-f75b8192-3026-4e58-9163-703368c7e469 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c" status: 200 len: 1808 microversion: 2.20 time: 0.184729 Oct 15 13:54:05.962294 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 301/622] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:54:05 2022] GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c => generated 1808 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 13:54:06.316981 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-b9bfba93-fde5-48bc-8ae7-d25d9ae1f1c8 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 13:54:06.319541 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-b9bfba93-fde5-48bc-8ae7-d25d9ae1f1c8 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] [instance: cb269dd0-b5af-4013-9ded-062f40176b8f] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:54:06.326029 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-b9bfba93-fde5-48bc-8ae7-d25d9ae1f1c8 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:06.326629 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-b9bfba93-fde5-48bc-8ae7-d25d9ae1f1c8 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:06.327090 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-b9bfba93-fde5-48bc-8ae7-d25d9ae1f1c8 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:06.327923 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-b9bfba93-fde5-48bc-8ae7-d25d9ae1f1c8 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:06.328396 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-b9bfba93-fde5-48bc-8ae7-d25d9ae1f1c8 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:06.329183 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-b9bfba93-fde5-48bc-8ae7-d25d9ae1f1c8 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:06.358387 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.objects.instance [None req-b9bfba93-fde5-48bc-8ae7-d25d9ae1f1c8 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lazy-loading 'flavor' on Instance uuid cb269dd0-b5af-4013-9ded-062f40176b8f {{(pid=125242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 15 13:54:06.536330 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-b9bfba93-fde5-48bc-8ae7-d25d9ae1f1c8 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] 10.222.0.36 "POST /compute/v2.1/servers/cb269dd0-b5af-4013-9ded-062f40176b8f/action" status: 200 len: 32 microversion: 2.1 time: 0.223257 Oct 15 13:54:06.537889 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 322/623] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 15 13:54:06 2022] POST /compute/v2.1/servers/cb269dd0-b5af-4013-9ded-062f40176b8f/action => generated 32 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 15 13:54:06.546480 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-8771c40f-c7e1-43a9-b4bc-32ba680a4058 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:54:06.547099 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-8771c40f-c7e1-43a9-b4bc-32ba680a4058 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] [instance: cb269dd0-b5af-4013-9ded-062f40176b8f] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:54:06.553897 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-8771c40f-c7e1-43a9-b4bc-32ba680a4058 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:06.554390 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-8771c40f-c7e1-43a9-b4bc-32ba680a4058 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:06.554830 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-8771c40f-c7e1-43a9-b4bc-32ba680a4058 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:06.555586 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-8771c40f-c7e1-43a9-b4bc-32ba680a4058 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:06.556023 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-8771c40f-c7e1-43a9-b4bc-32ba680a4058 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:06.556456 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-8771c40f-c7e1-43a9-b4bc-32ba680a4058 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:06.580763 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-89555b64-e44d-4732-a725-41d41b98a08c tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:54:06.581537 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-89555b64-e44d-4732-a725-41d41b98a08c tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] [instance: 9209310f-9812-4e8e-9a64-a46690948204] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:54:06.588316 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-89555b64-e44d-4732-a725-41d41b98a08c tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:06.588834 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-89555b64-e44d-4732-a725-41d41b98a08c tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:06.589291 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-89555b64-e44d-4732-a725-41d41b98a08c tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:06.590156 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-89555b64-e44d-4732-a725-41d41b98a08c tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:06.590742 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-89555b64-e44d-4732-a725-41d41b98a08c tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:06.591182 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-89555b64-e44d-4732-a725-41d41b98a08c tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:06.756458 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-8771c40f-c7e1-43a9-b4bc-32ba680a4058 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5150c06020594efe957359f641eba5da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a0813bae074cd2aa552be82abe8493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:54:06.772415 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-8771c40f-c7e1-43a9-b4bc-32ba680a4058 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] 10.222.0.36 "GET /compute/v2.1/servers/cb269dd0-b5af-4013-9ded-062f40176b8f" status: 200 len: 1736 microversion: 2.1 time: 0.229346 Oct 15 13:54:06.773495 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 302/624] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:54:06 2022] GET /compute/v2.1/servers/cb269dd0-b5af-4013-9ded-062f40176b8f => generated 1736 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:54:06.789160 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-89555b64-e44d-4732-a725-41d41b98a08c tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '193bf7a17f544770a27c07f6b8cc0988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243c0b9b4bd742659061745c8dc4c696', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:54:06.799634 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-89555b64-e44d-4732-a725-41d41b98a08c tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] 10.222.0.36 "GET /compute/v2.1/servers/9209310f-9812-4e8e-9a64-a46690948204" status: 200 len: 1267 microversion: 2.1 time: 0.223413 Oct 15 13:54:06.801366 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 323/625] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:54:06 2022] GET /compute/v2.1/servers/9209310f-9812-4e8e-9a64-a46690948204 => generated 1267 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:54:06.988953 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-52ce5e16-b4cd-43e4-bdd1-72a282600958 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:54:06.989700 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-52ce5e16-b4cd-43e4-bdd1-72a282600958 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 5fc359cf-ff2c-4189-b058-31eb3c97568c] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:54:06.997651 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-52ce5e16-b4cd-43e4-bdd1-72a282600958 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:06.998325 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-52ce5e16-b4cd-43e4-bdd1-72a282600958 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:06.998987 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-52ce5e16-b4cd-43e4-bdd1-72a282600958 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:06.999814 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-52ce5e16-b4cd-43e4-bdd1-72a282600958 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:07.000577 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-52ce5e16-b4cd-43e4-bdd1-72a282600958 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:07.001243 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-52ce5e16-b4cd-43e4-bdd1-72a282600958 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:07.152490 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-52ce5e16-b4cd-43e4-bdd1-72a282600958 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:54:07.163760 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-52ce5e16-b4cd-43e4-bdd1-72a282600958 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:54:07.165257 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-52ce5e16-b4cd-43e4-bdd1-72a282600958 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:54:07.166438 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-52ce5e16-b4cd-43e4-bdd1-72a282600958 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c" status: 200 len: 1808 microversion: 2.20 time: 0.181817 Oct 15 13:54:07.167028 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 303/626] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:54:06 2022] GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c => generated 1808 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 13:54:07.196760 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [req-ac6dc049-edf1-4668-aad0-9e3e88ab015d req-1998af56-95ff-4764-97a6-2ea6141c7b91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5fc359cf-ff2c-4189-b058-31eb3c97568c", "name": "network-vif-plugged", "status": "completed", "tag": "5a131939-5800-4807-b2cc-42f66041598f"}]} {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 13:54:07.207568 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [req-ac6dc049-edf1-4668-aad0-9e3e88ab015d req-1998af56-95ff-4764-97a6-2ea6141c7b91 service nova] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:07.208093 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [req-ac6dc049-edf1-4668-aad0-9e3e88ab015d req-1998af56-95ff-4764-97a6-2ea6141c7b91 service nova] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:07.208524 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [req-ac6dc049-edf1-4668-aad0-9e3e88ab015d req-1998af56-95ff-4764-97a6-2ea6141c7b91 service nova] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:07.221324 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.compute.server_external_events [req-ac6dc049-edf1-4668-aad0-9e3e88ab015d req-1998af56-95ff-4764-97a6-2ea6141c7b91 service nova] Creating event network-vif-plugged:5a131939-5800-4807-b2cc-42f66041598f for instance 5fc359cf-ff2c-4189-b058-31eb3c97568c on hv-cinder-86149 Oct 15 13:54:07.226653 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [req-ac6dc049-edf1-4668-aad0-9e3e88ab015d req-1998af56-95ff-4764-97a6-2ea6141c7b91 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033696 Oct 15 13:54:07.227269 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 324/627] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 15 13:54:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 13:54:07.811317 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-c2d323bc-c4d6-4125-a7cd-227751479c3b tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:54:07.812284 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-c2d323bc-c4d6-4125-a7cd-227751479c3b tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] [instance: cb269dd0-b5af-4013-9ded-062f40176b8f] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:54:07.820010 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-c2d323bc-c4d6-4125-a7cd-227751479c3b tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:07.820536 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-c2d323bc-c4d6-4125-a7cd-227751479c3b tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:07.820967 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-c2d323bc-c4d6-4125-a7cd-227751479c3b tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:07.821666 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-c2d323bc-c4d6-4125-a7cd-227751479c3b tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:07.822113 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-c2d323bc-c4d6-4125-a7cd-227751479c3b tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:07.822537 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-c2d323bc-c4d6-4125-a7cd-227751479c3b tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:07.824800 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-6569c405-6e01-4d6d-9f35-78553848dc29 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:54:07.825485 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-6569c405-6e01-4d6d-9f35-78553848dc29 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] [instance: 9209310f-9812-4e8e-9a64-a46690948204] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:54:07.832239 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-6569c405-6e01-4d6d-9f35-78553848dc29 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:07.832722 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-6569c405-6e01-4d6d-9f35-78553848dc29 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:07.833149 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-6569c405-6e01-4d6d-9f35-78553848dc29 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:07.833832 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-6569c405-6e01-4d6d-9f35-78553848dc29 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:07.834269 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-6569c405-6e01-4d6d-9f35-78553848dc29 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:07.834688 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-6569c405-6e01-4d6d-9f35-78553848dc29 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:08.041195 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-c2d323bc-c4d6-4125-a7cd-227751479c3b tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5150c06020594efe957359f641eba5da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a0813bae074cd2aa552be82abe8493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:54:08.050723 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-c2d323bc-c4d6-4125-a7cd-227751479c3b tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] 10.222.0.36 "GET /compute/v2.1/servers/cb269dd0-b5af-4013-9ded-062f40176b8f" status: 200 len: 1736 microversion: 2.1 time: 0.245601 Oct 15 13:54:08.051326 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 304/628] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:54:07 2022] GET /compute/v2.1/servers/cb269dd0-b5af-4013-9ded-062f40176b8f => generated 1736 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:54:08.057595 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-6569c405-6e01-4d6d-9f35-78553848dc29 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '193bf7a17f544770a27c07f6b8cc0988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243c0b9b4bd742659061745c8dc4c696', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:54:08.070687 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-6569c405-6e01-4d6d-9f35-78553848dc29 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] 10.222.0.36 "GET /compute/v2.1/servers/9209310f-9812-4e8e-9a64-a46690948204" status: 200 len: 1267 microversion: 2.1 time: 0.249972 Oct 15 13:54:08.071595 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 325/629] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:54:07 2022] GET /compute/v2.1/servers/9209310f-9812-4e8e-9a64-a46690948204 => generated 1267 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:54:08.192784 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-2dff848c-03bc-4e2f-b091-d97d3cfb55a4 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:54:08.193293 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-2dff848c-03bc-4e2f-b091-d97d3cfb55a4 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 5fc359cf-ff2c-4189-b058-31eb3c97568c] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:54:08.199539 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-2dff848c-03bc-4e2f-b091-d97d3cfb55a4 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:08.200270 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-2dff848c-03bc-4e2f-b091-d97d3cfb55a4 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:08.200688 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-2dff848c-03bc-4e2f-b091-d97d3cfb55a4 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:08.201557 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-2dff848c-03bc-4e2f-b091-d97d3cfb55a4 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:08.202261 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-2dff848c-03bc-4e2f-b091-d97d3cfb55a4 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:08.202888 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-2dff848c-03bc-4e2f-b091-d97d3cfb55a4 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:08.344038 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-2dff848c-03bc-4e2f-b091-d97d3cfb55a4 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:54:08.359081 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-2dff848c-03bc-4e2f-b091-d97d3cfb55a4 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:54:08.361316 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-2dff848c-03bc-4e2f-b091-d97d3cfb55a4 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:54:08.362914 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-2dff848c-03bc-4e2f-b091-d97d3cfb55a4 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c" status: 200 len: 1808 microversion: 2.20 time: 0.174314 Oct 15 13:54:08.363524 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 305/630] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:54:08 2022] GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c => generated 1808 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 13:54:09.074972 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-e0f71bea-c8b7-4c22-b560-fe4484ced90a tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:54:09.075699 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-e0f71bea-c8b7-4c22-b560-fe4484ced90a tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] [instance: cb269dd0-b5af-4013-9ded-062f40176b8f] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:54:09.087539 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-e0f71bea-c8b7-4c22-b560-fe4484ced90a tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:09.088100 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-e0f71bea-c8b7-4c22-b560-fe4484ced90a tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:09.090568 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-e0f71bea-c8b7-4c22-b560-fe4484ced90a tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:09.091595 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-e0f71bea-c8b7-4c22-b560-fe4484ced90a tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:09.091759 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-e0f71bea-c8b7-4c22-b560-fe4484ced90a tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:09.092390 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-e0f71bea-c8b7-4c22-b560-fe4484ced90a tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:09.102985 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-fdaa5798-7e08-4e3d-b13a-89c94615f818 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:54:09.103605 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-fdaa5798-7e08-4e3d-b13a-89c94615f818 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] [instance: 9209310f-9812-4e8e-9a64-a46690948204] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:54:09.115322 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-fdaa5798-7e08-4e3d-b13a-89c94615f818 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:09.115802 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-fdaa5798-7e08-4e3d-b13a-89c94615f818 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:09.121467 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-fdaa5798-7e08-4e3d-b13a-89c94615f818 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:09.122435 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-fdaa5798-7e08-4e3d-b13a-89c94615f818 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:09.123055 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-fdaa5798-7e08-4e3d-b13a-89c94615f818 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:09.123486 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-fdaa5798-7e08-4e3d-b13a-89c94615f818 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:09.354711 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-e0f71bea-c8b7-4c22-b560-fe4484ced90a tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5150c06020594efe957359f641eba5da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a0813bae074cd2aa552be82abe8493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:54:09.365080 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-e0f71bea-c8b7-4c22-b560-fe4484ced90a tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] 10.222.0.36 "GET /compute/v2.1/servers/cb269dd0-b5af-4013-9ded-062f40176b8f" status: 200 len: 1736 microversion: 2.1 time: 0.293964 Oct 15 13:54:09.365882 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 326/631] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:54:09 2022] GET /compute/v2.1/servers/cb269dd0-b5af-4013-9ded-062f40176b8f => generated 1736 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:54:09.375258 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-fdaa5798-7e08-4e3d-b13a-89c94615f818 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '193bf7a17f544770a27c07f6b8cc0988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243c0b9b4bd742659061745c8dc4c696', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:54:09.381669 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-fdaa5798-7e08-4e3d-b13a-89c94615f818 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] 10.222.0.36 "GET /compute/v2.1/servers/9209310f-9812-4e8e-9a64-a46690948204" status: 200 len: 1267 microversion: 2.1 time: 0.282481 Oct 15 13:54:09.382180 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 306/632] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:54:09 2022] GET /compute/v2.1/servers/9209310f-9812-4e8e-9a64-a46690948204 => generated 1267 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:54:09.389316 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-99612157-3069-43dc-a74c-e36deae8f444 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:54:09.389935 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-99612157-3069-43dc-a74c-e36deae8f444 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 5fc359cf-ff2c-4189-b058-31eb3c97568c] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:54:09.396540 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-99612157-3069-43dc-a74c-e36deae8f444 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:09.397040 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-99612157-3069-43dc-a74c-e36deae8f444 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:09.397477 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-99612157-3069-43dc-a74c-e36deae8f444 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:09.398189 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-99612157-3069-43dc-a74c-e36deae8f444 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:09.398644 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-99612157-3069-43dc-a74c-e36deae8f444 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:09.399072 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-99612157-3069-43dc-a74c-e36deae8f444 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:09.630165 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-99612157-3069-43dc-a74c-e36deae8f444 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:54:09.639908 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-99612157-3069-43dc-a74c-e36deae8f444 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:54:09.641851 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-99612157-3069-43dc-a74c-e36deae8f444 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:54:09.643799 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-99612157-3069-43dc-a74c-e36deae8f444 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c" status: 200 len: 1808 microversion: 2.20 time: 0.258187 Oct 15 13:54:09.644507 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 327/633] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:54:09 2022] GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c => generated 1808 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 13:54:10.391182 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-e803c182-6225-4688-a38a-41870a3137e3 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:54:10.391796 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-e803c182-6225-4688-a38a-41870a3137e3 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] [instance: cb269dd0-b5af-4013-9ded-062f40176b8f] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:54:10.399604 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-e803c182-6225-4688-a38a-41870a3137e3 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:10.400272 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-e803c182-6225-4688-a38a-41870a3137e3 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:10.400750 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-e803c182-6225-4688-a38a-41870a3137e3 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:10.401452 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-e803c182-6225-4688-a38a-41870a3137e3 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:10.401895 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-e803c182-6225-4688-a38a-41870a3137e3 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:10.402354 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-e803c182-6225-4688-a38a-41870a3137e3 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:10.405860 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-f154ffab-96ab-4487-983f-76a506eaeb12 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:54:10.406557 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-f154ffab-96ab-4487-983f-76a506eaeb12 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] [instance: 9209310f-9812-4e8e-9a64-a46690948204] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:54:10.413613 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-f154ffab-96ab-4487-983f-76a506eaeb12 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:10.414186 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-f154ffab-96ab-4487-983f-76a506eaeb12 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:10.414549 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-f154ffab-96ab-4487-983f-76a506eaeb12 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:10.415291 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-f154ffab-96ab-4487-983f-76a506eaeb12 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:10.415751 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-f154ffab-96ab-4487-983f-76a506eaeb12 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:10.416203 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-f154ffab-96ab-4487-983f-76a506eaeb12 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:10.634107 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-e803c182-6225-4688-a38a-41870a3137e3 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5150c06020594efe957359f641eba5da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a0813bae074cd2aa552be82abe8493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:54:10.639929 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-f154ffab-96ab-4487-983f-76a506eaeb12 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '193bf7a17f544770a27c07f6b8cc0988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243c0b9b4bd742659061745c8dc4c696', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:54:10.642970 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-e803c182-6225-4688-a38a-41870a3137e3 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] 10.222.0.36 "GET /compute/v2.1/servers/cb269dd0-b5af-4013-9ded-062f40176b8f" status: 200 len: 1736 microversion: 2.1 time: 0.256320 Oct 15 13:54:10.643602 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 307/634] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:54:10 2022] GET /compute/v2.1/servers/cb269dd0-b5af-4013-9ded-062f40176b8f => generated 1736 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:54:10.648389 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-f154ffab-96ab-4487-983f-76a506eaeb12 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] 10.222.0.36 "GET /compute/v2.1/servers/9209310f-9812-4e8e-9a64-a46690948204" status: 200 len: 1267 microversion: 2.1 time: 0.246669 Oct 15 13:54:10.648999 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 328/635] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:54:10 2022] GET /compute/v2.1/servers/9209310f-9812-4e8e-9a64-a46690948204 => generated 1267 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:54:10.687396 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-fa11df04-d911-4fb7-9c59-667e3e80dcc6 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:54:10.688034 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-fa11df04-d911-4fb7-9c59-667e3e80dcc6 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 5fc359cf-ff2c-4189-b058-31eb3c97568c] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:54:10.694625 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-fa11df04-d911-4fb7-9c59-667e3e80dcc6 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:10.695133 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-fa11df04-d911-4fb7-9c59-667e3e80dcc6 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:10.695567 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-fa11df04-d911-4fb7-9c59-667e3e80dcc6 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:10.696284 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-fa11df04-d911-4fb7-9c59-667e3e80dcc6 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:10.696736 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-fa11df04-d911-4fb7-9c59-667e3e80dcc6 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:10.697151 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-fa11df04-d911-4fb7-9c59-667e3e80dcc6 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:10.842320 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-fa11df04-d911-4fb7-9c59-667e3e80dcc6 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:54:10.851940 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-fa11df04-d911-4fb7-9c59-667e3e80dcc6 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:54:10.853760 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-fa11df04-d911-4fb7-9c59-667e3e80dcc6 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:54:10.855304 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-fa11df04-d911-4fb7-9c59-667e3e80dcc6 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c" status: 200 len: 1808 microversion: 2.20 time: 0.172054 Oct 15 13:54:10.855911 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 308/636] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:54:10 2022] GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c => generated 1808 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 13:54:11.666480 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-afaa3cd1-e46f-4e6b-b6e2-c1bd3d90c6ae tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:54:11.667151 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-afaa3cd1-e46f-4e6b-b6e2-c1bd3d90c6ae tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] [instance: cb269dd0-b5af-4013-9ded-062f40176b8f] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:54:11.670923 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-4935d382-8a52-42be-99ea-160997d7e66f tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:54:11.671698 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-4935d382-8a52-42be-99ea-160997d7e66f tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] [instance: 9209310f-9812-4e8e-9a64-a46690948204] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:54:11.674404 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-afaa3cd1-e46f-4e6b-b6e2-c1bd3d90c6ae tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:11.674895 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-afaa3cd1-e46f-4e6b-b6e2-c1bd3d90c6ae tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:11.675330 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-afaa3cd1-e46f-4e6b-b6e2-c1bd3d90c6ae tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:11.676071 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-afaa3cd1-e46f-4e6b-b6e2-c1bd3d90c6ae tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:11.676522 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-afaa3cd1-e46f-4e6b-b6e2-c1bd3d90c6ae tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:11.676940 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-afaa3cd1-e46f-4e6b-b6e2-c1bd3d90c6ae tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:11.678858 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-4935d382-8a52-42be-99ea-160997d7e66f tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:11.679349 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-4935d382-8a52-42be-99ea-160997d7e66f tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:11.679788 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-4935d382-8a52-42be-99ea-160997d7e66f tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:11.680553 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-4935d382-8a52-42be-99ea-160997d7e66f tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:11.683224 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-4935d382-8a52-42be-99ea-160997d7e66f tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:11.683224 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-4935d382-8a52-42be-99ea-160997d7e66f tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:11.686012 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG dbcounter [-] [125243] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:54:11.897723 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-afaa3cd1-e46f-4e6b-b6e2-c1bd3d90c6ae tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5150c06020594efe957359f641eba5da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a0813bae074cd2aa552be82abe8493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:54:11.901046 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-4935d382-8a52-42be-99ea-160997d7e66f tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '193bf7a17f544770a27c07f6b8cc0988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243c0b9b4bd742659061745c8dc4c696', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:54:11.909534 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-afaa3cd1-e46f-4e6b-b6e2-c1bd3d90c6ae tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] 10.222.0.36 "GET /compute/v2.1/servers/cb269dd0-b5af-4013-9ded-062f40176b8f" status: 200 len: 1736 microversion: 2.1 time: 0.246847 Oct 15 13:54:11.910179 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 329/637] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:54:11 2022] GET /compute/v2.1/servers/cb269dd0-b5af-4013-9ded-062f40176b8f => generated 1736 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:54:11.910289 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-4935d382-8a52-42be-99ea-160997d7e66f tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] 10.222.0.36 "GET /compute/v2.1/servers/9209310f-9812-4e8e-9a64-a46690948204" status: 200 len: 1267 microversion: 2.1 time: 0.243421 Oct 15 13:54:11.911798 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 309/638] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:54:11 2022] GET /compute/v2.1/servers/9209310f-9812-4e8e-9a64-a46690948204 => generated 1267 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:54:11.917003 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-47de1858-a227-44a5-b45f-18a40464d388 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:54:11.918003 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-47de1858-a227-44a5-b45f-18a40464d388 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 5fc359cf-ff2c-4189-b058-31eb3c97568c] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:54:11.921610 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG dbcounter [-] [125242] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=125242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:54:11.927115 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-47de1858-a227-44a5-b45f-18a40464d388 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:11.927812 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-47de1858-a227-44a5-b45f-18a40464d388 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:11.928382 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-47de1858-a227-44a5-b45f-18a40464d388 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:11.929265 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-47de1858-a227-44a5-b45f-18a40464d388 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:11.930033 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-47de1858-a227-44a5-b45f-18a40464d388 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:11.930467 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-47de1858-a227-44a5-b45f-18a40464d388 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:12.092975 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-47de1858-a227-44a5-b45f-18a40464d388 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:54:12.102361 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-47de1858-a227-44a5-b45f-18a40464d388 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:54:12.103807 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-47de1858-a227-44a5-b45f-18a40464d388 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:54:12.105346 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-47de1858-a227-44a5-b45f-18a40464d388 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c" status: 200 len: 1808 microversion: 2.20 time: 0.194149 Oct 15 13:54:12.106005 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 330/639] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:54:11 2022] GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c => generated 1808 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 13:54:12.934615 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-3c16123e-71e3-4e29-9a9a-153a41368a3a tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:54:12.935390 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-3c16123e-71e3-4e29-9a9a-153a41368a3a tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] [instance: 9209310f-9812-4e8e-9a64-a46690948204] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:54:12.935794 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-8d03c86c-7a27-46a6-a90d-f8ce117c9bb4 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:54:12.936722 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-8d03c86c-7a27-46a6-a90d-f8ce117c9bb4 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] [instance: cb269dd0-b5af-4013-9ded-062f40176b8f] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:54:12.942524 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-3c16123e-71e3-4e29-9a9a-153a41368a3a tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:12.943020 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-3c16123e-71e3-4e29-9a9a-153a41368a3a tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:12.943478 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-3c16123e-71e3-4e29-9a9a-153a41368a3a tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:12.944221 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-3c16123e-71e3-4e29-9a9a-153a41368a3a tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:12.944670 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-3c16123e-71e3-4e29-9a9a-153a41368a3a tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:12.945089 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-3c16123e-71e3-4e29-9a9a-153a41368a3a tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:12.945231 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-8d03c86c-7a27-46a6-a90d-f8ce117c9bb4 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:12.945603 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-8d03c86c-7a27-46a6-a90d-f8ce117c9bb4 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:12.946040 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-8d03c86c-7a27-46a6-a90d-f8ce117c9bb4 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:12.946737 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-8d03c86c-7a27-46a6-a90d-f8ce117c9bb4 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:12.947167 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-8d03c86c-7a27-46a6-a90d-f8ce117c9bb4 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:12.947580 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-8d03c86c-7a27-46a6-a90d-f8ce117c9bb4 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:13.156165 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-3c16123e-71e3-4e29-9a9a-153a41368a3a tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '193bf7a17f544770a27c07f6b8cc0988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243c0b9b4bd742659061745c8dc4c696', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:54:13.164077 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-8d03c86c-7a27-46a6-a90d-f8ce117c9bb4 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5150c06020594efe957359f641eba5da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a0813bae074cd2aa552be82abe8493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:54:13.164602 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-3c16123e-71e3-4e29-9a9a-153a41368a3a tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] 10.222.0.36 "GET /compute/v2.1/servers/9209310f-9812-4e8e-9a64-a46690948204" status: 200 len: 1267 microversion: 2.1 time: 0.233954 Oct 15 13:54:13.165198 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 331/640] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:54:12 2022] GET /compute/v2.1/servers/9209310f-9812-4e8e-9a64-a46690948204 => generated 1267 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:54:13.170189 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-77aecb7e-12c3-49a0-bf8d-1003f7bf7754 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:54:13.171094 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-77aecb7e-12c3-49a0-bf8d-1003f7bf7754 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 5fc359cf-ff2c-4189-b058-31eb3c97568c] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:54:13.180540 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-77aecb7e-12c3-49a0-bf8d-1003f7bf7754 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:13.181291 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-77aecb7e-12c3-49a0-bf8d-1003f7bf7754 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:13.181933 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-77aecb7e-12c3-49a0-bf8d-1003f7bf7754 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:13.182516 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-8d03c86c-7a27-46a6-a90d-f8ce117c9bb4 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] 10.222.0.36 "GET /compute/v2.1/servers/cb269dd0-b5af-4013-9ded-062f40176b8f" status: 200 len: 1736 microversion: 2.1 time: 0.251333 Oct 15 13:54:13.182703 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-77aecb7e-12c3-49a0-bf8d-1003f7bf7754 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:13.183179 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-77aecb7e-12c3-49a0-bf8d-1003f7bf7754 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:13.183586 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 310/641] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:54:12 2022] GET /compute/v2.1/servers/cb269dd0-b5af-4013-9ded-062f40176b8f => generated 1736 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:54:13.183733 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-77aecb7e-12c3-49a0-bf8d-1003f7bf7754 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:13.348574 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-77aecb7e-12c3-49a0-bf8d-1003f7bf7754 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:54:13.358578 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-77aecb7e-12c3-49a0-bf8d-1003f7bf7754 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:54:13.360107 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-77aecb7e-12c3-49a0-bf8d-1003f7bf7754 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:54:13.361486 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-77aecb7e-12c3-49a0-bf8d-1003f7bf7754 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c" status: 200 len: 1808 microversion: 2.20 time: 0.195305 Oct 15 13:54:13.362150 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 332/642] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:54:13 2022] GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c => generated 1808 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 13:54:14.189456 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-2a217086-cd23-401f-a800-76068bde39da tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:54:14.190755 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-2a217086-cd23-401f-a800-76068bde39da tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] [instance: 9209310f-9812-4e8e-9a64-a46690948204] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:54:14.198617 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-2a217086-cd23-401f-a800-76068bde39da tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:14.199117 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-2a217086-cd23-401f-a800-76068bde39da tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:14.199558 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-2a217086-cd23-401f-a800-76068bde39da tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:14.200309 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-2a217086-cd23-401f-a800-76068bde39da tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:14.200765 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-2a217086-cd23-401f-a800-76068bde39da tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:14.201193 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-2a217086-cd23-401f-a800-76068bde39da tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:14.212934 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-cf72e0b8-93aa-4970-b018-f459c4ffe276 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:54:14.214059 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-cf72e0b8-93aa-4970-b018-f459c4ffe276 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] [instance: cb269dd0-b5af-4013-9ded-062f40176b8f] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:54:14.226091 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-cf72e0b8-93aa-4970-b018-f459c4ffe276 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:14.226984 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-cf72e0b8-93aa-4970-b018-f459c4ffe276 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:14.227765 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-cf72e0b8-93aa-4970-b018-f459c4ffe276 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:14.229472 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-cf72e0b8-93aa-4970-b018-f459c4ffe276 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:14.230360 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-cf72e0b8-93aa-4970-b018-f459c4ffe276 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:14.231097 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-cf72e0b8-93aa-4970-b018-f459c4ffe276 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:14.431558 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-2a217086-cd23-401f-a800-76068bde39da tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '193bf7a17f544770a27c07f6b8cc0988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243c0b9b4bd742659061745c8dc4c696', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:54:14.443672 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-2a217086-cd23-401f-a800-76068bde39da tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] 10.222.0.36 "GET /compute/v2.1/servers/9209310f-9812-4e8e-9a64-a46690948204" status: 200 len: 1267 microversion: 2.1 time: 0.258133 Oct 15 13:54:14.444678 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 311/643] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:54:14 2022] GET /compute/v2.1/servers/9209310f-9812-4e8e-9a64-a46690948204 => generated 1267 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:54:14.447151 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-cf72e0b8-93aa-4970-b018-f459c4ffe276 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5150c06020594efe957359f641eba5da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a0813bae074cd2aa552be82abe8493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:54:14.453353 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-204c92c6-49a3-4996-87c1-fd1de5cea14a tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:54:14.454044 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-204c92c6-49a3-4996-87c1-fd1de5cea14a tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 5fc359cf-ff2c-4189-b058-31eb3c97568c] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:54:14.462346 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-cf72e0b8-93aa-4970-b018-f459c4ffe276 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] 10.222.0.36 "GET /compute/v2.1/servers/cb269dd0-b5af-4013-9ded-062f40176b8f" status: 200 len: 1736 microversion: 2.1 time: 0.258619 Oct 15 13:54:14.463363 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 333/644] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:54:14 2022] GET /compute/v2.1/servers/cb269dd0-b5af-4013-9ded-062f40176b8f => generated 1736 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 13:54:14.464903 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-204c92c6-49a3-4996-87c1-fd1de5cea14a tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:14.465747 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-204c92c6-49a3-4996-87c1-fd1de5cea14a tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:14.466513 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-204c92c6-49a3-4996-87c1-fd1de5cea14a tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:14.467791 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-204c92c6-49a3-4996-87c1-fd1de5cea14a tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:14.468663 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-204c92c6-49a3-4996-87c1-fd1de5cea14a tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:14.469429 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-204c92c6-49a3-4996-87c1-fd1de5cea14a tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:14.631622 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-204c92c6-49a3-4996-87c1-fd1de5cea14a tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:54:14.641727 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-204c92c6-49a3-4996-87c1-fd1de5cea14a tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:54:14.643231 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-204c92c6-49a3-4996-87c1-fd1de5cea14a tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:54:14.644673 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-204c92c6-49a3-4996-87c1-fd1de5cea14a tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c" status: 200 len: 1808 microversion: 2.20 time: 0.198692 Oct 15 13:54:14.645380 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 312/645] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:54:14 2022] GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c => generated 1808 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 13:54:15.488313 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-764b1629-6113-4733-a895-1cd1281fe43d tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:54:15.489421 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-764b1629-6113-4733-a895-1cd1281fe43d tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] [instance: 9209310f-9812-4e8e-9a64-a46690948204] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:54:15.501163 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-764b1629-6113-4733-a895-1cd1281fe43d tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:15.501439 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-98f91286-cfc4-49aa-87c2-a4dd5e085f65 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:54:15.501973 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-764b1629-6113-4733-a895-1cd1281fe43d tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:15.502124 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-98f91286-cfc4-49aa-87c2-a4dd5e085f65 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] [instance: cb269dd0-b5af-4013-9ded-062f40176b8f] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:54:15.502786 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-764b1629-6113-4733-a895-1cd1281fe43d tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:15.504126 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-764b1629-6113-4733-a895-1cd1281fe43d tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:15.504958 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-764b1629-6113-4733-a895-1cd1281fe43d tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:15.505696 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-764b1629-6113-4733-a895-1cd1281fe43d tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:15.511049 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-98f91286-cfc4-49aa-87c2-a4dd5e085f65 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:15.511755 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-98f91286-cfc4-49aa-87c2-a4dd5e085f65 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:15.512357 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-98f91286-cfc4-49aa-87c2-a4dd5e085f65 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:15.513952 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-98f91286-cfc4-49aa-87c2-a4dd5e085f65 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:15.515184 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-98f91286-cfc4-49aa-87c2-a4dd5e085f65 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:15.516384 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-98f91286-cfc4-49aa-87c2-a4dd5e085f65 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:16.043370 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-98f91286-cfc4-49aa-87c2-a4dd5e085f65 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5150c06020594efe957359f641eba5da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a0813bae074cd2aa552be82abe8493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:54:16.048977 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-764b1629-6113-4733-a895-1cd1281fe43d tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '193bf7a17f544770a27c07f6b8cc0988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243c0b9b4bd742659061745c8dc4c696', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:54:16.057343 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-98f91286-cfc4-49aa-87c2-a4dd5e085f65 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] 10.222.0.36 "GET /compute/v2.1/servers/cb269dd0-b5af-4013-9ded-062f40176b8f" status: 200 len: 1736 microversion: 2.1 time: 0.560186 Oct 15 13:54:16.058299 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 313/646] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:54:15 2022] GET /compute/v2.1/servers/cb269dd0-b5af-4013-9ded-062f40176b8f => generated 1736 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 13:54:16.062425 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-764b1629-6113-4733-a895-1cd1281fe43d tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] 10.222.0.36 "GET /compute/v2.1/servers/9209310f-9812-4e8e-9a64-a46690948204" status: 200 len: 1267 microversion: 2.1 time: 0.582677 Oct 15 13:54:16.063372 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 334/647] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:54:15 2022] GET /compute/v2.1/servers/9209310f-9812-4e8e-9a64-a46690948204 => generated 1267 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:54:16.076045 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-d4a031af-bca5-41cf-8cd0-26746ca333af tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:54:16.076045 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-d4a031af-bca5-41cf-8cd0-26746ca333af tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 5fc359cf-ff2c-4189-b058-31eb3c97568c] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:54:16.079560 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-d4a031af-bca5-41cf-8cd0-26746ca333af tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:16.080495 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-d4a031af-bca5-41cf-8cd0-26746ca333af tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:16.081310 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-d4a031af-bca5-41cf-8cd0-26746ca333af tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:16.082642 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-d4a031af-bca5-41cf-8cd0-26746ca333af tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:16.083491 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-d4a031af-bca5-41cf-8cd0-26746ca333af tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:16.084308 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-d4a031af-bca5-41cf-8cd0-26746ca333af tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:16.294854 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-d4a031af-bca5-41cf-8cd0-26746ca333af tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:54:16.311157 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-d4a031af-bca5-41cf-8cd0-26746ca333af tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:54:16.314285 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-d4a031af-bca5-41cf-8cd0-26746ca333af tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:54:16.316604 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-d4a031af-bca5-41cf-8cd0-26746ca333af tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c" status: 200 len: 1808 microversion: 2.20 time: 0.256346 Oct 15 13:54:16.317678 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 314/648] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:54:16 2022] GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c => generated 1808 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 13:54:17.086310 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-6fa9a09e-5ce0-4b9c-ba88-57f7f1bd159b tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:54:17.087047 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-6fa9a09e-5ce0-4b9c-ba88-57f7f1bd159b tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] [instance: cb269dd0-b5af-4013-9ded-062f40176b8f] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:54:17.096016 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-6fa9a09e-5ce0-4b9c-ba88-57f7f1bd159b tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:17.096666 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-6fa9a09e-5ce0-4b9c-ba88-57f7f1bd159b tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:17.097119 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-6fa9a09e-5ce0-4b9c-ba88-57f7f1bd159b tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:17.097911 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-6fa9a09e-5ce0-4b9c-ba88-57f7f1bd159b tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:17.098406 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-6fa9a09e-5ce0-4b9c-ba88-57f7f1bd159b tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:17.098813 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-6fa9a09e-5ce0-4b9c-ba88-57f7f1bd159b tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:17.101958 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG dbcounter [-] [125242] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:54:17.105797 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-903785ea-877e-4013-9555-c3143a8e8a16 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:54:17.106795 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-903785ea-877e-4013-9555-c3143a8e8a16 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] [instance: 9209310f-9812-4e8e-9a64-a46690948204] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:54:17.118631 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-903785ea-877e-4013-9555-c3143a8e8a16 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:17.119473 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-903785ea-877e-4013-9555-c3143a8e8a16 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:17.120279 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-903785ea-877e-4013-9555-c3143a8e8a16 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:17.121592 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-903785ea-877e-4013-9555-c3143a8e8a16 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:17.122471 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-903785ea-877e-4013-9555-c3143a8e8a16 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:17.123314 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-903785ea-877e-4013-9555-c3143a8e8a16 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:17.323945 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-6fa9a09e-5ce0-4b9c-ba88-57f7f1bd159b tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5150c06020594efe957359f641eba5da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a0813bae074cd2aa552be82abe8493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:54:17.334555 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-6fa9a09e-5ce0-4b9c-ba88-57f7f1bd159b tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] 10.222.0.36 "GET /compute/v2.1/servers/cb269dd0-b5af-4013-9ded-062f40176b8f" status: 200 len: 1736 microversion: 2.1 time: 0.252511 Oct 15 13:54:17.335441 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 335/649] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:54:17 2022] GET /compute/v2.1/servers/cb269dd0-b5af-4013-9ded-062f40176b8f => generated 1736 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:54:17.347960 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-453d4e06-b701-4c67-bf8a-36bfe5929e24 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:54:17.348846 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-453d4e06-b701-4c67-bf8a-36bfe5929e24 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 5fc359cf-ff2c-4189-b058-31eb3c97568c] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:54:17.356297 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-453d4e06-b701-4c67-bf8a-36bfe5929e24 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:17.356793 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-453d4e06-b701-4c67-bf8a-36bfe5929e24 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:17.357228 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-453d4e06-b701-4c67-bf8a-36bfe5929e24 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:17.357951 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-453d4e06-b701-4c67-bf8a-36bfe5929e24 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:17.358431 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-453d4e06-b701-4c67-bf8a-36bfe5929e24 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:17.358859 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-453d4e06-b701-4c67-bf8a-36bfe5929e24 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:17.365326 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-903785ea-877e-4013-9555-c3143a8e8a16 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '193bf7a17f544770a27c07f6b8cc0988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243c0b9b4bd742659061745c8dc4c696', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:54:17.375131 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-903785ea-877e-4013-9555-c3143a8e8a16 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] 10.222.0.36 "GET /compute/v2.1/servers/9209310f-9812-4e8e-9a64-a46690948204" status: 200 len: 1267 microversion: 2.1 time: 0.277215 Oct 15 13:54:17.376177 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 315/650] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:54:17 2022] GET /compute/v2.1/servers/9209310f-9812-4e8e-9a64-a46690948204 => generated 1267 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:54:17.531775 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-453d4e06-b701-4c67-bf8a-36bfe5929e24 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:54:17.543414 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-453d4e06-b701-4c67-bf8a-36bfe5929e24 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:54:17.545350 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-453d4e06-b701-4c67-bf8a-36bfe5929e24 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:54:17.546649 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-453d4e06-b701-4c67-bf8a-36bfe5929e24 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c" status: 200 len: 1808 microversion: 2.20 time: 0.205502 Oct 15 13:54:17.547309 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 336/651] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:54:17 2022] GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c => generated 1808 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 13:54:18.359518 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-f7719487-d721-444c-8d87-5cff66eac415 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:54:18.360459 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-f7719487-d721-444c-8d87-5cff66eac415 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] [instance: cb269dd0-b5af-4013-9ded-062f40176b8f] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:54:18.370348 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-f7719487-d721-444c-8d87-5cff66eac415 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:18.370844 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-f7719487-d721-444c-8d87-5cff66eac415 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:18.371297 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-f7719487-d721-444c-8d87-5cff66eac415 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:18.372079 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-f7719487-d721-444c-8d87-5cff66eac415 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:18.372534 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-f7719487-d721-444c-8d87-5cff66eac415 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:18.372998 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-f7719487-d721-444c-8d87-5cff66eac415 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:18.413808 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-e1ee688b-bcc2-4efb-98ce-10c63c40c9f1 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:54:18.414411 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-e1ee688b-bcc2-4efb-98ce-10c63c40c9f1 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] [instance: 9209310f-9812-4e8e-9a64-a46690948204] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:54:18.421374 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-e1ee688b-bcc2-4efb-98ce-10c63c40c9f1 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:18.421862 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-e1ee688b-bcc2-4efb-98ce-10c63c40c9f1 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:18.422295 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-e1ee688b-bcc2-4efb-98ce-10c63c40c9f1 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:18.423026 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-e1ee688b-bcc2-4efb-98ce-10c63c40c9f1 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:18.423499 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-e1ee688b-bcc2-4efb-98ce-10c63c40c9f1 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:18.424094 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-e1ee688b-bcc2-4efb-98ce-10c63c40c9f1 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:18.663160 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-f7719487-d721-444c-8d87-5cff66eac415 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5150c06020594efe957359f641eba5da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a0813bae074cd2aa552be82abe8493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:54:18.675998 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-f7719487-d721-444c-8d87-5cff66eac415 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] 10.222.0.36 "GET /compute/v2.1/servers/cb269dd0-b5af-4013-9ded-062f40176b8f" status: 200 len: 1736 microversion: 2.1 time: 0.320030 Oct 15 13:54:18.676952 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 316/652] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:54:18 2022] GET /compute/v2.1/servers/cb269dd0-b5af-4013-9ded-062f40176b8f => generated 1736 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 13:54:18.677125 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-e1ee688b-bcc2-4efb-98ce-10c63c40c9f1 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '193bf7a17f544770a27c07f6b8cc0988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243c0b9b4bd742659061745c8dc4c696', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:54:18.684852 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-f6e48517-93ee-4161-8d95-c338693dcd46 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:54:18.685857 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-f6e48517-93ee-4161-8d95-c338693dcd46 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 5fc359cf-ff2c-4189-b058-31eb3c97568c] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:54:18.692161 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-e1ee688b-bcc2-4efb-98ce-10c63c40c9f1 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] 10.222.0.36 "GET /compute/v2.1/servers/9209310f-9812-4e8e-9a64-a46690948204" status: 200 len: 1267 microversion: 2.1 time: 0.281835 Oct 15 13:54:18.693164 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 337/653] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:54:18 2022] GET /compute/v2.1/servers/9209310f-9812-4e8e-9a64-a46690948204 => generated 1267 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 13:54:18.698437 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-f6e48517-93ee-4161-8d95-c338693dcd46 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:18.698437 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-f6e48517-93ee-4161-8d95-c338693dcd46 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:18.698729 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-f6e48517-93ee-4161-8d95-c338693dcd46 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:18.699848 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-f6e48517-93ee-4161-8d95-c338693dcd46 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:18.700739 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-f6e48517-93ee-4161-8d95-c338693dcd46 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:18.701516 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-f6e48517-93ee-4161-8d95-c338693dcd46 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:18.879008 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-f6e48517-93ee-4161-8d95-c338693dcd46 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:54:18.889689 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-f6e48517-93ee-4161-8d95-c338693dcd46 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:54:18.891148 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-f6e48517-93ee-4161-8d95-c338693dcd46 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:54:18.892374 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-f6e48517-93ee-4161-8d95-c338693dcd46 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c" status: 200 len: 1808 microversion: 2.20 time: 0.214197 Oct 15 13:54:18.893093 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 317/654] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:54:18 2022] GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c => generated 1808 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 13:54:19.707423 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-7a3d4468-a9f4-45b1-970e-7d163ecbc14a tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:54:19.708420 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-7a3d4468-a9f4-45b1-970e-7d163ecbc14a tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] [instance: cb269dd0-b5af-4013-9ded-062f40176b8f] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:54:19.718908 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-7a3d4468-a9f4-45b1-970e-7d163ecbc14a tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:19.720043 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-7a3d4468-a9f4-45b1-970e-7d163ecbc14a tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:19.720677 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-7a3d4468-a9f4-45b1-970e-7d163ecbc14a tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:19.722241 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-7a3d4468-a9f4-45b1-970e-7d163ecbc14a tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:19.722893 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-7a3d4468-a9f4-45b1-970e-7d163ecbc14a tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:19.723393 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-7a3d4468-a9f4-45b1-970e-7d163ecbc14a tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:19.736047 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-101d7fa7-f9fe-46b6-9124-d78135864cba tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:54:19.737392 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-101d7fa7-f9fe-46b6-9124-d78135864cba tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] [instance: 9209310f-9812-4e8e-9a64-a46690948204] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:54:19.749089 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG dbcounter [-] [125243] Writing DB stats nova_api:SELECT=49 {{(pid=125243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:54:19.753348 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-101d7fa7-f9fe-46b6-9124-d78135864cba tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:19.754696 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-101d7fa7-f9fe-46b6-9124-d78135864cba tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:19.755422 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-101d7fa7-f9fe-46b6-9124-d78135864cba tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:19.756663 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-101d7fa7-f9fe-46b6-9124-d78135864cba tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:19.757402 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-101d7fa7-f9fe-46b6-9124-d78135864cba tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:19.758120 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-101d7fa7-f9fe-46b6-9124-d78135864cba tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:20.092309 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-7a3d4468-a9f4-45b1-970e-7d163ecbc14a tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5150c06020594efe957359f641eba5da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a0813bae074cd2aa552be82abe8493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:54:20.101627 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-101d7fa7-f9fe-46b6-9124-d78135864cba tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '193bf7a17f544770a27c07f6b8cc0988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243c0b9b4bd742659061745c8dc4c696', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:54:20.109519 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-7a3d4468-a9f4-45b1-970e-7d163ecbc14a tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] 10.222.0.36 "GET /compute/v2.1/servers/cb269dd0-b5af-4013-9ded-062f40176b8f" status: 200 len: 1736 microversion: 2.1 time: 0.406307 Oct 15 13:54:20.110561 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 338/655] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:54:19 2022] GET /compute/v2.1/servers/cb269dd0-b5af-4013-9ded-062f40176b8f => generated 1736 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:54:20.113993 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-101d7fa7-f9fe-46b6-9124-d78135864cba tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] 10.222.0.36 "GET /compute/v2.1/servers/9209310f-9812-4e8e-9a64-a46690948204" status: 200 len: 1267 microversion: 2.1 time: 0.383323 Oct 15 13:54:20.114957 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 318/656] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:54:19 2022] GET /compute/v2.1/servers/9209310f-9812-4e8e-9a64-a46690948204 => generated 1267 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:54:20.119587 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-250ca6f3-a8e4-4983-b2c1-72e2bb6a66b2 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:54:20.120715 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-250ca6f3-a8e4-4983-b2c1-72e2bb6a66b2 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 5fc359cf-ff2c-4189-b058-31eb3c97568c] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:54:20.132085 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-250ca6f3-a8e4-4983-b2c1-72e2bb6a66b2 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:20.132955 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-250ca6f3-a8e4-4983-b2c1-72e2bb6a66b2 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:20.133681 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-250ca6f3-a8e4-4983-b2c1-72e2bb6a66b2 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:20.134902 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-250ca6f3-a8e4-4983-b2c1-72e2bb6a66b2 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:20.135703 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-250ca6f3-a8e4-4983-b2c1-72e2bb6a66b2 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:20.136476 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-250ca6f3-a8e4-4983-b2c1-72e2bb6a66b2 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:20.331306 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-250ca6f3-a8e4-4983-b2c1-72e2bb6a66b2 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:54:20.342287 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-250ca6f3-a8e4-4983-b2c1-72e2bb6a66b2 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:54:20.343770 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-250ca6f3-a8e4-4983-b2c1-72e2bb6a66b2 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:54:20.345174 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-250ca6f3-a8e4-4983-b2c1-72e2bb6a66b2 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c" status: 200 len: 1808 microversion: 2.20 time: 0.232942 Oct 15 13:54:20.345823 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 339/657] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:54:20 2022] GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c => generated 1808 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 13:54:21.141469 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-7875f717-9390-47ed-9f3b-8099ac262fc7 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:54:21.142959 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-7875f717-9390-47ed-9f3b-8099ac262fc7 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] [instance: cb269dd0-b5af-4013-9ded-062f40176b8f] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:54:21.145409 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-69672500-0142-436b-b3c9-2f18674309ad tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:54:21.146415 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-69672500-0142-436b-b3c9-2f18674309ad tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] [instance: 9209310f-9812-4e8e-9a64-a46690948204] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:54:21.155012 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-7875f717-9390-47ed-9f3b-8099ac262fc7 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:21.155963 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-7875f717-9390-47ed-9f3b-8099ac262fc7 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:21.156459 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-69672500-0142-436b-b3c9-2f18674309ad tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:21.156890 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-7875f717-9390-47ed-9f3b-8099ac262fc7 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:21.157292 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-69672500-0142-436b-b3c9-2f18674309ad tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:21.158300 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-7875f717-9390-47ed-9f3b-8099ac262fc7 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:21.158947 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-69672500-0142-436b-b3c9-2f18674309ad tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:21.159836 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-7875f717-9390-47ed-9f3b-8099ac262fc7 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:21.160512 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-7875f717-9390-47ed-9f3b-8099ac262fc7 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:21.161311 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-69672500-0142-436b-b3c9-2f18674309ad tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:21.162359 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-69672500-0142-436b-b3c9-2f18674309ad tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:21.162921 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-69672500-0142-436b-b3c9-2f18674309ad tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:21.402167 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-69672500-0142-436b-b3c9-2f18674309ad tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '193bf7a17f544770a27c07f6b8cc0988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243c0b9b4bd742659061745c8dc4c696', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:54:21.407431 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-7875f717-9390-47ed-9f3b-8099ac262fc7 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5150c06020594efe957359f641eba5da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a0813bae074cd2aa552be82abe8493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:54:21.417565 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-69672500-0142-436b-b3c9-2f18674309ad tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] 10.222.0.36 "GET /compute/v2.1/servers/9209310f-9812-4e8e-9a64-a46690948204" status: 200 len: 1267 microversion: 2.1 time: 0.277755 Oct 15 13:54:21.418234 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-7875f717-9390-47ed-9f3b-8099ac262fc7 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] 10.222.0.36 "GET /compute/v2.1/servers/cb269dd0-b5af-4013-9ded-062f40176b8f" status: 200 len: 1736 microversion: 2.1 time: 0.284472 Oct 15 13:54:21.418704 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 340/658] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:54:21 2022] GET /compute/v2.1/servers/9209310f-9812-4e8e-9a64-a46690948204 => generated 1267 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 13:54:21.419391 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 319/659] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:54:21 2022] GET /compute/v2.1/servers/cb269dd0-b5af-4013-9ded-062f40176b8f => generated 1736 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:54:21.427336 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-0aff3208-2fd8-4508-9ca9-27228f1bd208 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:54:21.428504 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-0aff3208-2fd8-4508-9ca9-27228f1bd208 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 5fc359cf-ff2c-4189-b058-31eb3c97568c] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:54:21.439652 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-0aff3208-2fd8-4508-9ca9-27228f1bd208 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:21.440545 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-0aff3208-2fd8-4508-9ca9-27228f1bd208 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:21.441545 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-0aff3208-2fd8-4508-9ca9-27228f1bd208 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:21.442797 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-0aff3208-2fd8-4508-9ca9-27228f1bd208 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:21.443609 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-0aff3208-2fd8-4508-9ca9-27228f1bd208 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:21.444452 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-0aff3208-2fd8-4508-9ca9-27228f1bd208 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:21.630177 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-0aff3208-2fd8-4508-9ca9-27228f1bd208 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:54:21.640032 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-0aff3208-2fd8-4508-9ca9-27228f1bd208 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:54:21.641636 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-0aff3208-2fd8-4508-9ca9-27228f1bd208 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:54:21.642911 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-0aff3208-2fd8-4508-9ca9-27228f1bd208 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c" status: 200 len: 1795 microversion: 2.20 time: 0.222848 Oct 15 13:54:21.643511 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 341/660] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:54:21 2022] GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c => generated 1795 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 13:54:22.443714 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-cd432244-23bf-4f54-9a32-9d6b3047d30c tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:54:22.444592 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-cd432244-23bf-4f54-9a32-9d6b3047d30c tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] [instance: 9209310f-9812-4e8e-9a64-a46690948204] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:54:22.447475 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-7dc4a9ce-76e4-4694-b846-d3a23cca08ae tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:54:22.448676 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-7dc4a9ce-76e4-4694-b846-d3a23cca08ae tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] [instance: cb269dd0-b5af-4013-9ded-062f40176b8f] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:54:22.452264 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-cd432244-23bf-4f54-9a32-9d6b3047d30c tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:22.453043 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-cd432244-23bf-4f54-9a32-9d6b3047d30c tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:22.453600 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-cd432244-23bf-4f54-9a32-9d6b3047d30c tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:22.454610 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-cd432244-23bf-4f54-9a32-9d6b3047d30c tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:22.455284 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-cd432244-23bf-4f54-9a32-9d6b3047d30c tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:22.455909 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-cd432244-23bf-4f54-9a32-9d6b3047d30c tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:22.457956 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-7dc4a9ce-76e4-4694-b846-d3a23cca08ae tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:22.458813 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-7dc4a9ce-76e4-4694-b846-d3a23cca08ae tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:22.459671 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-7dc4a9ce-76e4-4694-b846-d3a23cca08ae tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:22.460555 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-7dc4a9ce-76e4-4694-b846-d3a23cca08ae tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:22.461260 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-7dc4a9ce-76e4-4694-b846-d3a23cca08ae tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:22.461819 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-7dc4a9ce-76e4-4694-b846-d3a23cca08ae tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:22.729825 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-cd432244-23bf-4f54-9a32-9d6b3047d30c tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '193bf7a17f544770a27c07f6b8cc0988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243c0b9b4bd742659061745c8dc4c696', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:54:22.745807 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-cd432244-23bf-4f54-9a32-9d6b3047d30c tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] 10.222.0.36 "GET /compute/v2.1/servers/9209310f-9812-4e8e-9a64-a46690948204" status: 200 len: 1267 microversion: 2.1 time: 0.307122 Oct 15 13:54:22.746928 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 320/661] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:54:22 2022] GET /compute/v2.1/servers/9209310f-9812-4e8e-9a64-a46690948204 => generated 1267 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:54:22.754482 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-7dc4a9ce-76e4-4694-b846-d3a23cca08ae tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5150c06020594efe957359f641eba5da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a0813bae074cd2aa552be82abe8493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:54:22.774275 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-7dc4a9ce-76e4-4694-b846-d3a23cca08ae tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] 10.222.0.36 "GET /compute/v2.1/servers/cb269dd0-b5af-4013-9ded-062f40176b8f" status: 200 len: 1736 microversion: 2.1 time: 0.331036 Oct 15 13:54:22.792346 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 342/662] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:54:22 2022] GET /compute/v2.1/servers/cb269dd0-b5af-4013-9ded-062f40176b8f => generated 1736 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 13:54:23.786228 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-de91d9ce-467f-4332-9aac-4e3d3663ffa9 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:54:23.787401 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-de91d9ce-467f-4332-9aac-4e3d3663ffa9 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] [instance: 9209310f-9812-4e8e-9a64-a46690948204] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:54:23.796390 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-de91d9ce-467f-4332-9aac-4e3d3663ffa9 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:23.796893 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-de91d9ce-467f-4332-9aac-4e3d3663ffa9 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:23.797305 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-de91d9ce-467f-4332-9aac-4e3d3663ffa9 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:23.798074 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-de91d9ce-467f-4332-9aac-4e3d3663ffa9 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:23.798546 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-de91d9ce-467f-4332-9aac-4e3d3663ffa9 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:23.798974 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-de91d9ce-467f-4332-9aac-4e3d3663ffa9 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:23.806888 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-efdecf8c-2e08-4c25-9b8a-4fc913b1bc3b tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:54:23.807775 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-efdecf8c-2e08-4c25-9b8a-4fc913b1bc3b tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] [instance: cb269dd0-b5af-4013-9ded-062f40176b8f] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:54:23.815670 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-efdecf8c-2e08-4c25-9b8a-4fc913b1bc3b tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:23.816362 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-efdecf8c-2e08-4c25-9b8a-4fc913b1bc3b tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:23.817051 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-efdecf8c-2e08-4c25-9b8a-4fc913b1bc3b tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:23.818129 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-efdecf8c-2e08-4c25-9b8a-4fc913b1bc3b tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:23.818741 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-efdecf8c-2e08-4c25-9b8a-4fc913b1bc3b tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:23.819244 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-efdecf8c-2e08-4c25-9b8a-4fc913b1bc3b tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:24.103449 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-de91d9ce-467f-4332-9aac-4e3d3663ffa9 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '193bf7a17f544770a27c07f6b8cc0988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243c0b9b4bd742659061745c8dc4c696', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:54:24.114602 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-de91d9ce-467f-4332-9aac-4e3d3663ffa9 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] 10.222.0.36 "GET /compute/v2.1/servers/9209310f-9812-4e8e-9a64-a46690948204" status: 200 len: 1267 microversion: 2.1 time: 0.332568 Oct 15 13:54:24.115456 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 321/663] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:54:23 2022] GET /compute/v2.1/servers/9209310f-9812-4e8e-9a64-a46690948204 => generated 1267 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:54:24.144881 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-efdecf8c-2e08-4c25-9b8a-4fc913b1bc3b tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5150c06020594efe957359f641eba5da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a0813bae074cd2aa552be82abe8493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:54:24.153796 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-efdecf8c-2e08-4c25-9b8a-4fc913b1bc3b tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] 10.222.0.36 "GET /compute/v2.1/servers/cb269dd0-b5af-4013-9ded-062f40176b8f" status: 200 len: 1736 microversion: 2.1 time: 0.352151 Oct 15 13:54:24.154409 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 343/664] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:54:23 2022] GET /compute/v2.1/servers/cb269dd0-b5af-4013-9ded-062f40176b8f => generated 1736 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:54:25.139209 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-d1bd0b9d-834c-4157-8a49-27a7a9f82367 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:54:25.139853 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-d1bd0b9d-834c-4157-8a49-27a7a9f82367 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] [instance: 9209310f-9812-4e8e-9a64-a46690948204] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:54:25.147461 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-d1bd0b9d-834c-4157-8a49-27a7a9f82367 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:25.148053 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-d1bd0b9d-834c-4157-8a49-27a7a9f82367 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:25.148542 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-d1bd0b9d-834c-4157-8a49-27a7a9f82367 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:25.149436 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-d1bd0b9d-834c-4157-8a49-27a7a9f82367 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:25.149939 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-d1bd0b9d-834c-4157-8a49-27a7a9f82367 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:25.150564 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-d1bd0b9d-834c-4157-8a49-27a7a9f82367 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:25.180128 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-ad9091ab-7411-40ce-8efe-bd417aae8f83 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:54:25.180993 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-ad9091ab-7411-40ce-8efe-bd417aae8f83 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] [instance: cb269dd0-b5af-4013-9ded-062f40176b8f] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:54:25.188649 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-ad9091ab-7411-40ce-8efe-bd417aae8f83 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:25.189141 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-ad9091ab-7411-40ce-8efe-bd417aae8f83 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:25.189606 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-ad9091ab-7411-40ce-8efe-bd417aae8f83 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:25.190774 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-ad9091ab-7411-40ce-8efe-bd417aae8f83 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:25.191238 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-ad9091ab-7411-40ce-8efe-bd417aae8f83 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:25.191660 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-ad9091ab-7411-40ce-8efe-bd417aae8f83 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:25.403566 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-d1bd0b9d-834c-4157-8a49-27a7a9f82367 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '193bf7a17f544770a27c07f6b8cc0988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243c0b9b4bd742659061745c8dc4c696', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:54:25.414008 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-ad9091ab-7411-40ce-8efe-bd417aae8f83 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5150c06020594efe957359f641eba5da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a0813bae074cd2aa552be82abe8493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:54:25.415191 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-d1bd0b9d-834c-4157-8a49-27a7a9f82367 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] 10.222.0.36 "GET /compute/v2.1/servers/9209310f-9812-4e8e-9a64-a46690948204" status: 200 len: 1267 microversion: 2.1 time: 0.279840 Oct 15 13:54:25.415987 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 322/665] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:54:25 2022] GET /compute/v2.1/servers/9209310f-9812-4e8e-9a64-a46690948204 => generated 1267 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:54:25.430374 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-ad9091ab-7411-40ce-8efe-bd417aae8f83 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] 10.222.0.36 "GET /compute/v2.1/servers/cb269dd0-b5af-4013-9ded-062f40176b8f" status: 200 len: 1736 microversion: 2.1 time: 0.254253 Oct 15 13:54:25.431533 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 344/666] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:54:25 2022] GET /compute/v2.1/servers/cb269dd0-b5af-4013-9ded-062f40176b8f => generated 1736 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 13:54:26.440751 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-4761862e-5f97-47e8-bc28-0a5396c01143 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:54:26.441574 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-4761862e-5f97-47e8-bc28-0a5396c01143 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] [instance: 9209310f-9812-4e8e-9a64-a46690948204] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:54:26.448843 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-4761862e-5f97-47e8-bc28-0a5396c01143 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:26.449349 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-4761862e-5f97-47e8-bc28-0a5396c01143 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:26.449782 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-4761862e-5f97-47e8-bc28-0a5396c01143 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:26.450502 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-4761862e-5f97-47e8-bc28-0a5396c01143 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:26.450954 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-4761862e-5f97-47e8-bc28-0a5396c01143 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:26.451379 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-4761862e-5f97-47e8-bc28-0a5396c01143 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:26.458920 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-4b193d74-159c-4b7d-ac5a-4b2379e417f4 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:54:26.459917 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-4b193d74-159c-4b7d-ac5a-4b2379e417f4 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] [instance: cb269dd0-b5af-4013-9ded-062f40176b8f] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:54:26.471982 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-4b193d74-159c-4b7d-ac5a-4b2379e417f4 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:26.472744 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-4b193d74-159c-4b7d-ac5a-4b2379e417f4 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:26.473338 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-4b193d74-159c-4b7d-ac5a-4b2379e417f4 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:26.474219 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-4b193d74-159c-4b7d-ac5a-4b2379e417f4 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:26.474913 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-4b193d74-159c-4b7d-ac5a-4b2379e417f4 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:26.475499 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-4b193d74-159c-4b7d-ac5a-4b2379e417f4 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:26.706330 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-4761862e-5f97-47e8-bc28-0a5396c01143 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '193bf7a17f544770a27c07f6b8cc0988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243c0b9b4bd742659061745c8dc4c696', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:54:26.716793 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-4b193d74-159c-4b7d-ac5a-4b2379e417f4 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5150c06020594efe957359f641eba5da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a0813bae074cd2aa552be82abe8493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:54:26.728278 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-4761862e-5f97-47e8-bc28-0a5396c01143 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] 10.222.0.36 "GET /compute/v2.1/servers/9209310f-9812-4e8e-9a64-a46690948204" status: 200 len: 1267 microversion: 2.1 time: 0.290437 Oct 15 13:54:26.729792 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 323/667] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:54:26 2022] GET /compute/v2.1/servers/9209310f-9812-4e8e-9a64-a46690948204 => generated 1267 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:54:26.732522 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-4b193d74-159c-4b7d-ac5a-4b2379e417f4 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] 10.222.0.36 "GET /compute/v2.1/servers/cb269dd0-b5af-4013-9ded-062f40176b8f" status: 200 len: 1736 microversion: 2.1 time: 0.281239 Oct 15 13:54:26.733609 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 345/668] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:54:26 2022] GET /compute/v2.1/servers/cb269dd0-b5af-4013-9ded-062f40176b8f => generated 1736 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:54:27.506752 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [req-efee491f-2564-4d61-9927-7b0dc76c1602 req-7d49c546-58ce-44c8-863d-afdde1e31a6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9209310f-9812-4e8e-9a64-a46690948204", "name": "network-vif-plugged", "status": "completed", "tag": "35cb3e4c-0e68-4b14-9bc8-fb35d5b7a493"}]} {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 13:54:27.519310 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [req-efee491f-2564-4d61-9927-7b0dc76c1602 req-7d49c546-58ce-44c8-863d-afdde1e31a6d service nova] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:27.520280 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [req-efee491f-2564-4d61-9927-7b0dc76c1602 req-7d49c546-58ce-44c8-863d-afdde1e31a6d service nova] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:27.521315 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [req-efee491f-2564-4d61-9927-7b0dc76c1602 req-7d49c546-58ce-44c8-863d-afdde1e31a6d service nova] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:27.539297 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.compute.server_external_events [req-efee491f-2564-4d61-9927-7b0dc76c1602 req-7d49c546-58ce-44c8-863d-afdde1e31a6d service nova] Creating event network-vif-plugged:35cb3e4c-0e68-4b14-9bc8-fb35d5b7a493 for instance 9209310f-9812-4e8e-9a64-a46690948204 on hv-cinder-86149 Oct 15 13:54:27.544714 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [req-efee491f-2564-4d61-9927-7b0dc76c1602 req-7d49c546-58ce-44c8-863d-afdde1e31a6d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044636 Oct 15 13:54:27.545562 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 324/669] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 15 13:54:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 13:54:27.771921 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-d0aecaa8-10b9-43a7-b1e9-170201466f6d tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:54:27.772920 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-d0aecaa8-10b9-43a7-b1e9-170201466f6d tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] [instance: 9209310f-9812-4e8e-9a64-a46690948204] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:54:27.773996 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-02882549-3ad4-4fdb-a92a-7485a83b9477 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:54:27.775505 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-02882549-3ad4-4fdb-a92a-7485a83b9477 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] [instance: cb269dd0-b5af-4013-9ded-062f40176b8f] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:54:27.788868 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-d0aecaa8-10b9-43a7-b1e9-170201466f6d tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:27.789708 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-d0aecaa8-10b9-43a7-b1e9-170201466f6d tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:27.790300 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-d0aecaa8-10b9-43a7-b1e9-170201466f6d tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:27.791902 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-d0aecaa8-10b9-43a7-b1e9-170201466f6d tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:27.792604 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-d0aecaa8-10b9-43a7-b1e9-170201466f6d tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:27.793188 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-d0aecaa8-10b9-43a7-b1e9-170201466f6d tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:27.796375 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-02882549-3ad4-4fdb-a92a-7485a83b9477 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:27.797684 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-02882549-3ad4-4fdb-a92a-7485a83b9477 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:27.798703 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-02882549-3ad4-4fdb-a92a-7485a83b9477 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:27.800642 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-02882549-3ad4-4fdb-a92a-7485a83b9477 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:27.801650 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-02882549-3ad4-4fdb-a92a-7485a83b9477 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:27.802253 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-02882549-3ad4-4fdb-a92a-7485a83b9477 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:28.278147 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-d0aecaa8-10b9-43a7-b1e9-170201466f6d tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '193bf7a17f544770a27c07f6b8cc0988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243c0b9b4bd742659061745c8dc4c696', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:54:28.288651 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-d0aecaa8-10b9-43a7-b1e9-170201466f6d tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] 10.222.0.36 "GET /compute/v2.1/servers/9209310f-9812-4e8e-9a64-a46690948204" status: 200 len: 1267 microversion: 2.1 time: 0.525024 Oct 15 13:54:28.300773 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 346/670] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:54:27 2022] GET /compute/v2.1/servers/9209310f-9812-4e8e-9a64-a46690948204 => generated 1267 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:54:28.317573 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-02882549-3ad4-4fdb-a92a-7485a83b9477 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5150c06020594efe957359f641eba5da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a0813bae074cd2aa552be82abe8493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:54:28.328862 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-02882549-3ad4-4fdb-a92a-7485a83b9477 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] 10.222.0.36 "GET /compute/v2.1/servers/cb269dd0-b5af-4013-9ded-062f40176b8f" status: 200 len: 1736 microversion: 2.1 time: 0.562553 Oct 15 13:54:28.329474 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 325/671] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:54:27 2022] GET /compute/v2.1/servers/cb269dd0-b5af-4013-9ded-062f40176b8f => generated 1736 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:54:29.316096 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-d55378a3-4d9e-41a2-bf19-a0635c7b252e tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:54:29.316981 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-d55378a3-4d9e-41a2-bf19-a0635c7b252e tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] [instance: 9209310f-9812-4e8e-9a64-a46690948204] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:54:29.324334 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-d55378a3-4d9e-41a2-bf19-a0635c7b252e tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:29.324815 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-d55378a3-4d9e-41a2-bf19-a0635c7b252e tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:29.325249 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-d55378a3-4d9e-41a2-bf19-a0635c7b252e tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:29.325968 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-d55378a3-4d9e-41a2-bf19-a0635c7b252e tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:29.326420 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-d55378a3-4d9e-41a2-bf19-a0635c7b252e tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:29.326840 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-d55378a3-4d9e-41a2-bf19-a0635c7b252e tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:29.359275 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-ee320638-c41e-42bc-a69e-697a27c38c50 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:54:29.360298 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-ee320638-c41e-42bc-a69e-697a27c38c50 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] [instance: cb269dd0-b5af-4013-9ded-062f40176b8f] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:54:29.370736 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-ee320638-c41e-42bc-a69e-697a27c38c50 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:29.371369 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-ee320638-c41e-42bc-a69e-697a27c38c50 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:29.371922 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-ee320638-c41e-42bc-a69e-697a27c38c50 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:29.372748 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-ee320638-c41e-42bc-a69e-697a27c38c50 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:29.373300 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-ee320638-c41e-42bc-a69e-697a27c38c50 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:29.373819 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-ee320638-c41e-42bc-a69e-697a27c38c50 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:29.402645 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG dbcounter [-] [125243] Writing DB stats nova_cell1:SELECT=100 {{(pid=125243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:54:29.569497 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-d55378a3-4d9e-41a2-bf19-a0635c7b252e tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '193bf7a17f544770a27c07f6b8cc0988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243c0b9b4bd742659061745c8dc4c696', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:54:29.585731 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-d55378a3-4d9e-41a2-bf19-a0635c7b252e tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] 10.222.0.36 "GET /compute/v2.1/servers/9209310f-9812-4e8e-9a64-a46690948204" status: 200 len: 1267 microversion: 2.1 time: 0.273858 Oct 15 13:54:29.586802 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 347/672] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:54:29 2022] GET /compute/v2.1/servers/9209310f-9812-4e8e-9a64-a46690948204 => generated 1267 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:54:29.610254 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-ee320638-c41e-42bc-a69e-697a27c38c50 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5150c06020594efe957359f641eba5da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a0813bae074cd2aa552be82abe8493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:54:29.629325 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-ee320638-c41e-42bc-a69e-697a27c38c50 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] 10.222.0.36 "GET /compute/v2.1/servers/cb269dd0-b5af-4013-9ded-062f40176b8f" status: 200 len: 1736 microversion: 2.1 time: 0.273957 Oct 15 13:54:29.629946 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 326/673] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:54:29 2022] GET /compute/v2.1/servers/cb269dd0-b5af-4013-9ded-062f40176b8f => generated 1736 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 13:54:30.611927 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-41582718-d2f9-4380-8fd8-a91b7db05436 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:54:30.613070 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-41582718-d2f9-4380-8fd8-a91b7db05436 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] [instance: 9209310f-9812-4e8e-9a64-a46690948204] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:54:30.620228 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-41582718-d2f9-4380-8fd8-a91b7db05436 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:30.620712 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-41582718-d2f9-4380-8fd8-a91b7db05436 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:30.621133 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-41582718-d2f9-4380-8fd8-a91b7db05436 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:30.621838 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-41582718-d2f9-4380-8fd8-a91b7db05436 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:30.622280 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-41582718-d2f9-4380-8fd8-a91b7db05436 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:30.622791 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-41582718-d2f9-4380-8fd8-a91b7db05436 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:30.654381 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-62621f02-d41d-4d90-9b4c-0351732e5909 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:54:30.655136 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-62621f02-d41d-4d90-9b4c-0351732e5909 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] [instance: cb269dd0-b5af-4013-9ded-062f40176b8f] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:54:30.662888 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-62621f02-d41d-4d90-9b4c-0351732e5909 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:30.663382 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-62621f02-d41d-4d90-9b4c-0351732e5909 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:30.663824 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-62621f02-d41d-4d90-9b4c-0351732e5909 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:30.664582 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-62621f02-d41d-4d90-9b4c-0351732e5909 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:30.665041 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-62621f02-d41d-4d90-9b4c-0351732e5909 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:30.665468 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-62621f02-d41d-4d90-9b4c-0351732e5909 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:30.914893 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-41582718-d2f9-4380-8fd8-a91b7db05436 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '193bf7a17f544770a27c07f6b8cc0988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243c0b9b4bd742659061745c8dc4c696', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:54:30.919727 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-62621f02-d41d-4d90-9b4c-0351732e5909 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5150c06020594efe957359f641eba5da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a0813bae074cd2aa552be82abe8493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:54:30.924693 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-41582718-d2f9-4380-8fd8-a91b7db05436 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] 10.222.0.36 "GET /compute/v2.1/servers/9209310f-9812-4e8e-9a64-a46690948204" status: 200 len: 1267 microversion: 2.1 time: 0.316448 Oct 15 13:54:30.925609 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 348/674] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:54:30 2022] GET /compute/v2.1/servers/9209310f-9812-4e8e-9a64-a46690948204 => generated 1267 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:54:30.932834 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-62621f02-d41d-4d90-9b4c-0351732e5909 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] 10.222.0.36 "GET /compute/v2.1/servers/cb269dd0-b5af-4013-9ded-062f40176b8f" status: 200 len: 1736 microversion: 2.1 time: 0.282828 Oct 15 13:54:30.933667 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 327/675] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:54:30 2022] GET /compute/v2.1/servers/cb269dd0-b5af-4013-9ded-062f40176b8f => generated 1736 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 13:54:31.526985 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-09d5c32a-ffce-421b-b466-769a7e366aac tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:54:31.527487 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-09d5c32a-ffce-421b-b466-769a7e366aac tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] [instance: d6ce134b-a723-453b-8847-b0725e969e89] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:54:31.535528 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-09d5c32a-ffce-421b-b466-769a7e366aac tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:31.536315 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-09d5c32a-ffce-421b-b466-769a7e366aac tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:31.536957 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-09d5c32a-ffce-421b-b466-769a7e366aac tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:31.537698 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-09d5c32a-ffce-421b-b466-769a7e366aac tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:31.538158 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-09d5c32a-ffce-421b-b466-769a7e366aac tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:31.538579 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-09d5c32a-ffce-421b-b466-769a7e366aac tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:31.698698 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.objects.instance [None req-09d5c32a-ffce-421b-b466-769a7e366aac tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Lazy-loading 'services' on Instance uuid d6ce134b-a723-453b-8847-b0725e969e89 {{(pid=125242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 15 13:54:31.834874 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-09d5c32a-ffce-421b-b466-769a7e366aac tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] 10.222.0.36 "DELETE /compute/v2.1/servers/d6ce134b-a723-453b-8847-b0725e969e89/os-volume_attachments/f64596ec-21fa-42a5-b214-e2e5510e40e0" status: 202 len: 0 microversion: 2.1 time: 0.311558 Oct 15 13:54:31.835917 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 349/676] 10.222.0.36 () {58 vars in 1416 bytes} [Sat Oct 15 13:54:31 2022] DELETE /compute/v2.1/servers/d6ce134b-a723-453b-8847-b0725e969e89/os-volume_attachments/f64596ec-21fa-42a5-b214-e2e5510e40e0 => generated 0 bytes in 314 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 15 13:54:31.949928 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-a6f1b9c2-8624-4162-a19d-c78b84182fea tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:54:31.950549 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-a6f1b9c2-8624-4162-a19d-c78b84182fea tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] [instance: 9209310f-9812-4e8e-9a64-a46690948204] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:54:31.958609 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-a6f1b9c2-8624-4162-a19d-c78b84182fea tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:31.959104 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-a6f1b9c2-8624-4162-a19d-c78b84182fea tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:31.959574 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-a6f1b9c2-8624-4162-a19d-c78b84182fea tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:31.960019 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-087d7835-35d8-44bd-af6f-870953a9062a tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:54:31.960330 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-a6f1b9c2-8624-4162-a19d-c78b84182fea tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:31.960781 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-a6f1b9c2-8624-4162-a19d-c78b84182fea tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:31.960922 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-087d7835-35d8-44bd-af6f-870953a9062a tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] [instance: cb269dd0-b5af-4013-9ded-062f40176b8f] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:54:31.961179 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-a6f1b9c2-8624-4162-a19d-c78b84182fea tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:31.968848 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-087d7835-35d8-44bd-af6f-870953a9062a tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:31.969343 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-087d7835-35d8-44bd-af6f-870953a9062a tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:31.969785 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-087d7835-35d8-44bd-af6f-870953a9062a tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:31.970497 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-087d7835-35d8-44bd-af6f-870953a9062a tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:31.970948 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-087d7835-35d8-44bd-af6f-870953a9062a tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:31.971604 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-087d7835-35d8-44bd-af6f-870953a9062a tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:32.182641 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-a6f1b9c2-8624-4162-a19d-c78b84182fea tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '193bf7a17f544770a27c07f6b8cc0988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243c0b9b4bd742659061745c8dc4c696', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:54:32.186626 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-087d7835-35d8-44bd-af6f-870953a9062a tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5150c06020594efe957359f641eba5da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a0813bae074cd2aa552be82abe8493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:54:32.191292 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-a6f1b9c2-8624-4162-a19d-c78b84182fea tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] 10.222.0.36 "GET /compute/v2.1/servers/9209310f-9812-4e8e-9a64-a46690948204" status: 200 len: 1455 microversion: 2.1 time: 0.245349 Oct 15 13:54:32.191907 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 328/677] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:54:31 2022] GET /compute/v2.1/servers/9209310f-9812-4e8e-9a64-a46690948204 => generated 1455 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:54:32.196002 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-087d7835-35d8-44bd-af6f-870953a9062a tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] 10.222.0.36 "GET /compute/v2.1/servers/cb269dd0-b5af-4013-9ded-062f40176b8f" status: 200 len: 1736 microversion: 2.1 time: 0.241876 Oct 15 13:54:32.196796 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 350/678] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:54:31 2022] GET /compute/v2.1/servers/cb269dd0-b5af-4013-9ded-062f40176b8f => generated 1736 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:54:32.228336 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-ffe972c2-0faa-4d6d-926d-6383cab80346 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:54:32.228984 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-ffe972c2-0faa-4d6d-926d-6383cab80346 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] [instance: 9209310f-9812-4e8e-9a64-a46690948204] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:54:32.236151 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-ffe972c2-0faa-4d6d-926d-6383cab80346 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:32.236637 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-ffe972c2-0faa-4d6d-926d-6383cab80346 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:32.237134 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-ffe972c2-0faa-4d6d-926d-6383cab80346 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:32.237870 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-ffe972c2-0faa-4d6d-926d-6383cab80346 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:32.238378 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-ffe972c2-0faa-4d6d-926d-6383cab80346 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:32.238811 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-ffe972c2-0faa-4d6d-926d-6383cab80346 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:32.393782 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-ffe972c2-0faa-4d6d-926d-6383cab80346 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '193bf7a17f544770a27c07f6b8cc0988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243c0b9b4bd742659061745c8dc4c696', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:54:32.407681 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-ffe972c2-0faa-4d6d-926d-6383cab80346 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] 10.222.0.36 "GET /compute/v2.1/servers/9209310f-9812-4e8e-9a64-a46690948204" status: 200 len: 1455 microversion: 2.1 time: 0.183299 Oct 15 13:54:32.408704 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 329/679] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:54:32 2022] GET /compute/v2.1/servers/9209310f-9812-4e8e-9a64-a46690948204 => generated 1455 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:54:33.236030 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-7985e5e3-c019-4f22-a1d8-92aa4709b0d3 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:54:33.237294 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-7985e5e3-c019-4f22-a1d8-92aa4709b0d3 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] [instance: cb269dd0-b5af-4013-9ded-062f40176b8f] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:54:33.248820 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-7985e5e3-c019-4f22-a1d8-92aa4709b0d3 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:33.249635 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-7985e5e3-c019-4f22-a1d8-92aa4709b0d3 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:33.250130 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-7985e5e3-c019-4f22-a1d8-92aa4709b0d3 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:33.251294 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-7985e5e3-c019-4f22-a1d8-92aa4709b0d3 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:33.252169 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-7985e5e3-c019-4f22-a1d8-92aa4709b0d3 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:33.253637 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-7985e5e3-c019-4f22-a1d8-92aa4709b0d3 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:33.262198 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG dbcounter [-] [125242] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=125242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:54:33.539338 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-7985e5e3-c019-4f22-a1d8-92aa4709b0d3 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5150c06020594efe957359f641eba5da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a0813bae074cd2aa552be82abe8493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:54:33.552031 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-7985e5e3-c019-4f22-a1d8-92aa4709b0d3 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] 10.222.0.36 "GET /compute/v2.1/servers/cb269dd0-b5af-4013-9ded-062f40176b8f" status: 200 len: 1736 microversion: 2.1 time: 0.322684 Oct 15 13:54:33.553165 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 351/680] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:54:33 2022] GET /compute/v2.1/servers/cb269dd0-b5af-4013-9ded-062f40176b8f => generated 1736 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 13:54:34.594018 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-2e9aa079-a74c-437c-9696-36dc9a0a3dcc tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:54:34.595169 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-2e9aa079-a74c-437c-9696-36dc9a0a3dcc tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] [instance: cb269dd0-b5af-4013-9ded-062f40176b8f] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:54:34.602777 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-2e9aa079-a74c-437c-9696-36dc9a0a3dcc tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:34.603495 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-2e9aa079-a74c-437c-9696-36dc9a0a3dcc tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:34.604061 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-2e9aa079-a74c-437c-9696-36dc9a0a3dcc tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:34.605225 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-2e9aa079-a74c-437c-9696-36dc9a0a3dcc tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:34.606107 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-2e9aa079-a74c-437c-9696-36dc9a0a3dcc tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:34.606669 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-2e9aa079-a74c-437c-9696-36dc9a0a3dcc tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:34.679687 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [req-ce020b53-b27b-4200-b92b-d9afb1f79dc6 req-15b40e69-1630-4748-8fbe-1562b4fe2921 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9209310f-9812-4e8e-9a64-a46690948204", "tag": "35cb3e4c-0e68-4b14-9bc8-fb35d5b7a493"}]} {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 13:54:34.690412 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [req-ce020b53-b27b-4200-b92b-d9afb1f79dc6 req-15b40e69-1630-4748-8fbe-1562b4fe2921 service nova] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:34.690902 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [req-ce020b53-b27b-4200-b92b-d9afb1f79dc6 req-15b40e69-1630-4748-8fbe-1562b4fe2921 service nova] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:34.691342 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [req-ce020b53-b27b-4200-b92b-d9afb1f79dc6 req-15b40e69-1630-4748-8fbe-1562b4fe2921 service nova] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:34.706374 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.compute.server_external_events [req-ce020b53-b27b-4200-b92b-d9afb1f79dc6 req-15b40e69-1630-4748-8fbe-1562b4fe2921 service nova] Creating event network-changed:35cb3e4c-0e68-4b14-9bc8-fb35d5b7a493 for instance 9209310f-9812-4e8e-9a64-a46690948204 on hv-cinder-86149 Oct 15 13:54:34.715437 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [req-ce020b53-b27b-4200-b92b-d9afb1f79dc6 req-15b40e69-1630-4748-8fbe-1562b4fe2921 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.137467 Oct 15 13:54:34.718352 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 330/681] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 15 13:54:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 15 13:54:34.798111 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-2e9aa079-a74c-437c-9696-36dc9a0a3dcc tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5150c06020594efe957359f641eba5da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a0813bae074cd2aa552be82abe8493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:54:34.807551 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-2e9aa079-a74c-437c-9696-36dc9a0a3dcc tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] 10.222.0.36 "GET /compute/v2.1/servers/cb269dd0-b5af-4013-9ded-062f40176b8f" status: 200 len: 1736 microversion: 2.1 time: 0.217632 Oct 15 13:54:34.808223 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 352/682] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:54:34 2022] GET /compute/v2.1/servers/cb269dd0-b5af-4013-9ded-062f40176b8f => generated 1736 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:54:35.143472 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-48526487-d28a-499e-9dff-9e96f1e4b6dd tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:54:35.144505 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-48526487-d28a-499e-9dff-9e96f1e4b6dd tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] [instance: d6ce134b-a723-453b-8847-b0725e969e89] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:54:35.155185 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-48526487-d28a-499e-9dff-9e96f1e4b6dd tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:35.156084 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-48526487-d28a-499e-9dff-9e96f1e4b6dd tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:35.156838 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-48526487-d28a-499e-9dff-9e96f1e4b6dd tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:35.158332 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-48526487-d28a-499e-9dff-9e96f1e4b6dd tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:35.159236 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-48526487-d28a-499e-9dff-9e96f1e4b6dd tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:35.160036 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-48526487-d28a-499e-9dff-9e96f1e4b6dd tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:35.204460 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-48526487-d28a-499e-9dff-9e96f1e4b6dd tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] [instance: d6ce134b-a723-453b-8847-b0725e969e89] Going to try to terminate instance {{(pid=125243) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 15 13:54:35.327609 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-48526487-d28a-499e-9dff-9e96f1e4b6dd tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] 10.222.0.36 "DELETE /compute/v2.1/servers/d6ce134b-a723-453b-8847-b0725e969e89" status: 204 len: 0 microversion: 2.1 time: 0.191453 Oct 15 13:54:35.328302 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 331/683] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 15 13:54:35 2022] DELETE /compute/v2.1/servers/d6ce134b-a723-453b-8847-b0725e969e89 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 15 13:54:35.344646 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-a6dbffb3-9750-47c2-98b0-0b3efad6117e tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:54:35.345616 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-a6dbffb3-9750-47c2-98b0-0b3efad6117e tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] [instance: d6ce134b-a723-453b-8847-b0725e969e89] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:54:35.352607 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-a6dbffb3-9750-47c2-98b0-0b3efad6117e tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:35.353411 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-a6dbffb3-9750-47c2-98b0-0b3efad6117e tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:35.354024 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-a6dbffb3-9750-47c2-98b0-0b3efad6117e tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:35.355322 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-a6dbffb3-9750-47c2-98b0-0b3efad6117e tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:35.356001 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-a6dbffb3-9750-47c2-98b0-0b3efad6117e tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:35.356602 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-a6dbffb3-9750-47c2-98b0-0b3efad6117e tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:35.566321 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-a6dbffb3-9750-47c2-98b0-0b3efad6117e tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707bd577eee14892990367f396270f7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '190914cc865b4003ab4b735d937e130d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:54:35.574764 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-a6dbffb3-9750-47c2-98b0-0b3efad6117e tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] 10.222.0.36 "GET /compute/v2.1/servers/d6ce134b-a723-453b-8847-b0725e969e89" status: 200 len: 1515 microversion: 2.1 time: 0.234590 Oct 15 13:54:35.575373 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 353/684] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:54:35 2022] GET /compute/v2.1/servers/d6ce134b-a723-453b-8847-b0725e969e89 => generated 1515 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:54:35.833820 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-4fd86672-c82b-4e2d-9a31-6251f01c1a0c tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:54:35.834713 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-4fd86672-c82b-4e2d-9a31-6251f01c1a0c tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] [instance: cb269dd0-b5af-4013-9ded-062f40176b8f] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:54:35.841435 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-4fd86672-c82b-4e2d-9a31-6251f01c1a0c tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:35.841945 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-4fd86672-c82b-4e2d-9a31-6251f01c1a0c tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:35.842368 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-4fd86672-c82b-4e2d-9a31-6251f01c1a0c tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:35.843061 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-4fd86672-c82b-4e2d-9a31-6251f01c1a0c tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:35.843567 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-4fd86672-c82b-4e2d-9a31-6251f01c1a0c tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:35.844216 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-4fd86672-c82b-4e2d-9a31-6251f01c1a0c tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:36.013623 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-4fd86672-c82b-4e2d-9a31-6251f01c1a0c tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5150c06020594efe957359f641eba5da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a0813bae074cd2aa552be82abe8493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:54:36.023519 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-4fd86672-c82b-4e2d-9a31-6251f01c1a0c tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] 10.222.0.36 "GET /compute/v2.1/servers/cb269dd0-b5af-4013-9ded-062f40176b8f" status: 200 len: 1736 microversion: 2.1 time: 0.194682 Oct 15 13:54:36.024165 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 332/685] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:54:35 2022] GET /compute/v2.1/servers/cb269dd0-b5af-4013-9ded-062f40176b8f => generated 1736 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:54:36.599618 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-d51b7069-5555-412e-a45b-d79d8b79e68c tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:54:36.600298 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-d51b7069-5555-412e-a45b-d79d8b79e68c tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] [instance: d6ce134b-a723-453b-8847-b0725e969e89] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:54:36.607672 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-d51b7069-5555-412e-a45b-d79d8b79e68c tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:36.608206 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-d51b7069-5555-412e-a45b-d79d8b79e68c tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:36.608725 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-d51b7069-5555-412e-a45b-d79d8b79e68c tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:36.609483 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-d51b7069-5555-412e-a45b-d79d8b79e68c tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:36.609906 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-d51b7069-5555-412e-a45b-d79d8b79e68c tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:36.610324 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-d51b7069-5555-412e-a45b-d79d8b79e68c tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:36.763671 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-d51b7069-5555-412e-a45b-d79d8b79e68c tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707bd577eee14892990367f396270f7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '190914cc865b4003ab4b735d937e130d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:54:36.772607 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-d51b7069-5555-412e-a45b-d79d8b79e68c tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] 10.222.0.36 "GET /compute/v2.1/servers/d6ce134b-a723-453b-8847-b0725e969e89" status: 200 len: 1515 microversion: 2.1 time: 0.177239 Oct 15 13:54:36.773702 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 354/686] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:54:36 2022] GET /compute/v2.1/servers/d6ce134b-a723-453b-8847-b0725e969e89 => generated 1515 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:54:37.047775 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-3fd2fa3b-7c39-4e10-9f6d-cdb9b5247189 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:54:37.048493 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-3fd2fa3b-7c39-4e10-9f6d-cdb9b5247189 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] [instance: cb269dd0-b5af-4013-9ded-062f40176b8f] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:54:37.055990 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-3fd2fa3b-7c39-4e10-9f6d-cdb9b5247189 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:37.056487 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-3fd2fa3b-7c39-4e10-9f6d-cdb9b5247189 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:37.056917 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-3fd2fa3b-7c39-4e10-9f6d-cdb9b5247189 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:37.057627 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-3fd2fa3b-7c39-4e10-9f6d-cdb9b5247189 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:37.058067 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-3fd2fa3b-7c39-4e10-9f6d-cdb9b5247189 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:37.058490 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-3fd2fa3b-7c39-4e10-9f6d-cdb9b5247189 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:37.294287 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-3fd2fa3b-7c39-4e10-9f6d-cdb9b5247189 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5150c06020594efe957359f641eba5da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a0813bae074cd2aa552be82abe8493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:54:37.303733 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-3fd2fa3b-7c39-4e10-9f6d-cdb9b5247189 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] 10.222.0.36 "GET /compute/v2.1/servers/cb269dd0-b5af-4013-9ded-062f40176b8f" status: 200 len: 1736 microversion: 2.1 time: 0.259838 Oct 15 13:54:37.304487 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 333/687] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:54:37 2022] GET /compute/v2.1/servers/cb269dd0-b5af-4013-9ded-062f40176b8f => generated 1736 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:54:37.800940 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-e1ae8742-0f9d-4ff6-abed-a3c277a90446 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:54:37.801808 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-e1ae8742-0f9d-4ff6-abed-a3c277a90446 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] [instance: d6ce134b-a723-453b-8847-b0725e969e89] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:54:37.809107 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-e1ae8742-0f9d-4ff6-abed-a3c277a90446 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:37.809614 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-e1ae8742-0f9d-4ff6-abed-a3c277a90446 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:37.810055 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-e1ae8742-0f9d-4ff6-abed-a3c277a90446 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:37.810779 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-e1ae8742-0f9d-4ff6-abed-a3c277a90446 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:37.811243 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-e1ae8742-0f9d-4ff6-abed-a3c277a90446 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:37.811691 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-e1ae8742-0f9d-4ff6-abed-a3c277a90446 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:37.990703 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-e1ae8742-0f9d-4ff6-abed-a3c277a90446 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707bd577eee14892990367f396270f7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '190914cc865b4003ab4b735d937e130d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:54:37.999177 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-e1ae8742-0f9d-4ff6-abed-a3c277a90446 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] 10.222.0.36 "GET /compute/v2.1/servers/d6ce134b-a723-453b-8847-b0725e969e89" status: 200 len: 1515 microversion: 2.1 time: 0.202213 Oct 15 13:54:37.999795 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 355/688] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:54:37 2022] GET /compute/v2.1/servers/d6ce134b-a723-453b-8847-b0725e969e89 => generated 1515 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 13:54:38.331012 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-91cae09e-0536-4180-803f-485218464ec3 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:54:38.332393 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-91cae09e-0536-4180-803f-485218464ec3 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] [instance: cb269dd0-b5af-4013-9ded-062f40176b8f] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:54:38.343733 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-91cae09e-0536-4180-803f-485218464ec3 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:38.344803 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-91cae09e-0536-4180-803f-485218464ec3 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:38.345720 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-91cae09e-0536-4180-803f-485218464ec3 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:38.347994 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-91cae09e-0536-4180-803f-485218464ec3 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:38.348922 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-91cae09e-0536-4180-803f-485218464ec3 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:38.349901 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-91cae09e-0536-4180-803f-485218464ec3 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:38.783767 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-91cae09e-0536-4180-803f-485218464ec3 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5150c06020594efe957359f641eba5da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a0813bae074cd2aa552be82abe8493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:54:38.796029 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-91cae09e-0536-4180-803f-485218464ec3 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] 10.222.0.36 "GET /compute/v2.1/servers/cb269dd0-b5af-4013-9ded-062f40176b8f" status: 200 len: 1716 microversion: 2.1 time: 0.472044 Oct 15 13:54:38.812423 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 334/689] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:54:38 2022] GET /compute/v2.1/servers/cb269dd0-b5af-4013-9ded-062f40176b8f => generated 1716 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:54:38.863098 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [req-65fed5ba-64a4-4c5f-96a1-86949206d9d8 req-23684a3f-2c19-4465-9ede-fbbecaea01af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6ce134b-a723-453b-8847-b0725e969e89", "name": "network-vif-deleted", "tag": "f1f1b2d4-39b0-458c-8883-41eaa4cbab9e"}]} {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 13:54:38.882038 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [req-65fed5ba-64a4-4c5f-96a1-86949206d9d8 req-23684a3f-2c19-4465-9ede-fbbecaea01af service nova] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:38.882613 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [req-65fed5ba-64a4-4c5f-96a1-86949206d9d8 req-23684a3f-2c19-4465-9ede-fbbecaea01af service nova] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:38.883019 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [req-65fed5ba-64a4-4c5f-96a1-86949206d9d8 req-23684a3f-2c19-4465-9ede-fbbecaea01af service nova] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:38.902680 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.compute.server_external_events [req-65fed5ba-64a4-4c5f-96a1-86949206d9d8 req-23684a3f-2c19-4465-9ede-fbbecaea01af service nova] Creating event network-vif-deleted:f1f1b2d4-39b0-458c-8883-41eaa4cbab9e for instance d6ce134b-a723-453b-8847-b0725e969e89 on hv-cinder-86149 Oct 15 13:54:38.903588 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [req-65fed5ba-64a4-4c5f-96a1-86949206d9d8 req-23684a3f-2c19-4465-9ede-fbbecaea01af service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126422 Oct 15 13:54:38.904561 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 356/690] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 15 13:54:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 13:54:38.911593 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-47de040e-99c5-4c57-ad30-4b8b838e224f tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:54:38.912283 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-47de040e-99c5-4c57-ad30-4b8b838e224f tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] [instance: cb269dd0-b5af-4013-9ded-062f40176b8f] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:54:38.918890 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-47de040e-99c5-4c57-ad30-4b8b838e224f tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:38.919388 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-47de040e-99c5-4c57-ad30-4b8b838e224f tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:38.919827 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-47de040e-99c5-4c57-ad30-4b8b838e224f tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:38.920599 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-47de040e-99c5-4c57-ad30-4b8b838e224f tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:38.921060 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-47de040e-99c5-4c57-ad30-4b8b838e224f tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:38.921490 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-47de040e-99c5-4c57-ad30-4b8b838e224f tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:39.026469 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-a79b8fec-bc55-4b63-ab9c-46eabfc2e9c3 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:54:39.027354 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-a79b8fec-bc55-4b63-ab9c-46eabfc2e9c3 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] [instance: d6ce134b-a723-453b-8847-b0725e969e89] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:54:39.036706 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-a79b8fec-bc55-4b63-ab9c-46eabfc2e9c3 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:39.037660 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-a79b8fec-bc55-4b63-ab9c-46eabfc2e9c3 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:39.038310 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-a79b8fec-bc55-4b63-ab9c-46eabfc2e9c3 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:39.039264 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-a79b8fec-bc55-4b63-ab9c-46eabfc2e9c3 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:39.039995 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-a79b8fec-bc55-4b63-ab9c-46eabfc2e9c3 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:39.040525 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-a79b8fec-bc55-4b63-ab9c-46eabfc2e9c3 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:39.082100 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-a79b8fec-bc55-4b63-ab9c-46eabfc2e9c3 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:39.082890 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-a79b8fec-bc55-4b63-ab9c-46eabfc2e9c3 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:39.083342 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-a79b8fec-bc55-4b63-ab9c-46eabfc2e9c3 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:39.083796 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.objects.instance [None req-a79b8fec-bc55-4b63-ab9c-46eabfc2e9c3 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Lazy-loading 'fault' on Instance uuid d6ce134b-a723-453b-8847-b0725e969e89 {{(pid=125242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 15 13:54:39.110521 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.wsgi [None req-47de040e-99c5-4c57-ad30-4b8b838e224f tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] HTTP exception thrown: Cannot 'detach_volume' instance cb269dd0-b5af-4013-9ded-062f40176b8f while it is in vm_state rescued Oct 15 13:54:39.114515 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-47de040e-99c5-4c57-ad30-4b8b838e224f tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Request method failure captured: Oct 15 13:54:39.114515 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: request: DELETE /compute/v2.1/servers/cb269dd0-b5af-4013-9ded-062f40176b8f/os-volume_attachments/e2bb581a-89d5-4d2f-bcba-23862333c27e HTTP/1.1 Oct 15 13:54:39.114515 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: Accept: application/json Oct 15 13:54:39.114515 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: Accept-Encoding: identity Oct 15 13:54:39.114515 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: Connection: close Oct 15 13:54:39.114515 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: Content-Length: 0 Oct 15 13:54:39.114515 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: Content-Type: application/json Oct 15 13:54:39.114515 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: Host: 10.222.0.36 Oct 15 13:54:39.114515 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: Openstack-System-Scope: None Oct 15 13:54:39.114515 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: User-Agent: python-urllib3/1.26.12 Oct 15 13:54:39.114515 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Auth-Token: gAAAAABjSrpDCbLnTEW_xEPAEWkhuHsRghFnNiYiSlFqABBnErC6h60c64D-HBU-sQLJ5OEFDKVHgv-ufGo5DM3852LBGobRbu9Cvywx7lBbDmHNFrYQMi7AZajfH_h200LKqYKwyZ50VzbOvILBgFaEam8UeQ6PXpFFptes7s3dL6W33wOCdG0 Oct 15 13:54:39.114515 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Domain-Id: None Oct 15 13:54:39.114515 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Domain-Name: None Oct 15 13:54:39.114515 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Identity-Status: Confirmed Oct 15 13:54:39.114515 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Is-Admin-Project: True Oct 15 13:54:39.114515 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Project-Domain-Id: default Oct 15 13:54:39.114515 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Project-Domain-Name: Default Oct 15 13:54:39.114515 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Project-Id: 09a0813bae074cd2aa552be82abe8493 Oct 15 13:54:39.114515 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1946714780 Oct 15 13:54:39.114515 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Role: member,reader Oct 15 13:54:39.114515 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Roles: member,reader Oct 15 13:54:39.117652 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_09a0813bae074cd2aa552be82abe8493", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/09a0813bae074cd2aa552be82abe8493"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/09a0813bae074cd2aa552be82abe8493"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/09a0813bae074cd2aa552be82abe8493"}]}] Oct 15 13:54:39.117652 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1946714780 Oct 15 13:54:39.117652 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Tenant-Id: 09a0813bae074cd2aa552be82abe8493 Oct 15 13:54:39.117652 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1946714780 Oct 15 13:54:39.117652 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-User: tempest-ServerRescueNegativeTestJSON-1946714780-project Oct 15 13:54:39.117652 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-User-Domain-Id: default Oct 15 13:54:39.117652 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-User-Domain-Name: Default Oct 15 13:54:39.117652 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-User-Id: 5150c06020594efe957359f641eba5da Oct 15 13:54:39.117652 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1946714780-project Oct 15 13:54:39.117652 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: method: > Oct 15 13:54:39.117652 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: exception: Cannot 'detach_volume' instance cb269dd0-b5af-4013-9ded-062f40176b8f while it is in vm_state rescued Oct 15 13:54:39.119437 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: action_args: {'server_id': 'cb269dd0-b5af-4013-9ded-062f40176b8f', 'id': 'e2bb581a-89d5-4d2f-bcba-23862333c27e'} Oct 15 13:54:39.119437 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 15 13:54:39.119437 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 13:54:39.119437 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Oct 15 13:54:39.119437 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Oct 15 13:54:39.119437 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 15 13:54:39.119437 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 15 13:54:39.119437 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 15 13:54:39.119437 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 15 13:54:39.119437 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance cb269dd0-b5af-4013-9ded-062f40176b8f in vm_state rescued. Cannot detach_volume while the instance is in this state. Oct 15 13:54:39.119437 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Oct 15 13:54:39.119437 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 13:54:39.119437 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Oct 15 13:54:39.119437 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 13:54:39.119437 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 13:54:39.119437 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 13:54:39.119437 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 15 13:54:39.119437 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 15 13:54:39.119437 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 15 13:54:39.119437 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 15 13:54:39.122373 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Oct 15 13:54:39.122373 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 15 13:54:39.122373 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 15 13:54:39.122373 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 15 13:54:39.122373 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance cb269dd0-b5af-4013-9ded-062f40176b8f while it is in vm_state rescued Oct 15 13:54:39.122373 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Oct 15 13:54:39.122373 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 13:54:39.122373 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Oct 15 13:54:39.122373 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 13:54:39.122373 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 13:54:39.122373 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 13:54:39.122373 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 15 13:54:39.122373 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 15 13:54:39.122373 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance cb269dd0-b5af-4013-9ded-062f40176b8f while it is in vm_state rescued Oct 15 13:54:39.122373 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Oct 15 13:54:39.122373 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-47de040e-99c5-4c57-ad30-4b8b838e224f tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Returning 409 to user: Cannot 'detach_volume' instance cb269dd0-b5af-4013-9ded-062f40176b8f while it is in vm_state rescued {{(pid=125243) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 15 13:54:39.124667 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-47de040e-99c5-4c57-ad30-4b8b838e224f tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] 10.222.0.36 "DELETE /compute/v2.1/servers/cb269dd0-b5af-4013-9ded-062f40176b8f/os-volume_attachments/e2bb581a-89d5-4d2f-bcba-23862333c27e" status: 409 len: 152 microversion: 2.1 time: 0.213585 Oct 15 13:54:39.124667 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 335/691] 10.222.0.36 () {58 vars in 1416 bytes} [Sat Oct 15 13:54:38 2022] DELETE /compute/v2.1/servers/cb269dd0-b5af-4013-9ded-062f40176b8f/os-volume_attachments/e2bb581a-89d5-4d2f-bcba-23862333c27e => generated 152 bytes in 221 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 15 13:54:39.134072 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-c8e03ed6-6a5a-499a-89a9-027ad72e0f68 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 13:54:39.134817 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-c8e03ed6-6a5a-499a-89a9-027ad72e0f68 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] [instance: cb269dd0-b5af-4013-9ded-062f40176b8f] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:54:39.146581 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-a79b8fec-bc55-4b63-ab9c-46eabfc2e9c3 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707bd577eee14892990367f396270f7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '190914cc865b4003ab4b735d937e130d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:54:39.149178 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-c8e03ed6-6a5a-499a-89a9-027ad72e0f68 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:39.149881 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-c8e03ed6-6a5a-499a-89a9-027ad72e0f68 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:39.150552 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-c8e03ed6-6a5a-499a-89a9-027ad72e0f68 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:39.151977 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-c8e03ed6-6a5a-499a-89a9-027ad72e0f68 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:39.152754 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-c8e03ed6-6a5a-499a-89a9-027ad72e0f68 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:39.153451 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-c8e03ed6-6a5a-499a-89a9-027ad72e0f68 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:39.162328 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-a79b8fec-bc55-4b63-ab9c-46eabfc2e9c3 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] 10.222.0.36 "GET /compute/v2.1/servers/d6ce134b-a723-453b-8847-b0725e969e89" status: 200 len: 1309 microversion: 2.1 time: 0.141385 Oct 15 13:54:39.163251 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 357/692] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:54:39 2022] GET /compute/v2.1/servers/d6ce134b-a723-453b-8847-b0725e969e89 => generated 1309 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 13:54:39.255393 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-c8e03ed6-6a5a-499a-89a9-027ad72e0f68 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] 10.222.0.36 "POST /compute/v2.1/servers/cb269dd0-b5af-4013-9ded-062f40176b8f/action" status: 202 len: 0 microversion: 2.1 time: 0.127577 Oct 15 13:54:39.256554 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 336/693] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 15 13:54:39 2022] POST /compute/v2.1/servers/cb269dd0-b5af-4013-9ded-062f40176b8f/action => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 15 13:54:39.267200 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-e1324e9f-1765-4910-afaf-e7955f6dc18d tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:54:39.270063 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-e1324e9f-1765-4910-afaf-e7955f6dc18d tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] [instance: cb269dd0-b5af-4013-9ded-062f40176b8f] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:54:39.279943 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-e1324e9f-1765-4910-afaf-e7955f6dc18d tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:39.280912 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-e1324e9f-1765-4910-afaf-e7955f6dc18d tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:39.282652 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-e1324e9f-1765-4910-afaf-e7955f6dc18d tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:39.284355 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-e1324e9f-1765-4910-afaf-e7955f6dc18d tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:39.285024 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-e1324e9f-1765-4910-afaf-e7955f6dc18d tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:39.285742 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-e1324e9f-1765-4910-afaf-e7955f6dc18d tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:39.553006 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-e1324e9f-1765-4910-afaf-e7955f6dc18d tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5150c06020594efe957359f641eba5da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a0813bae074cd2aa552be82abe8493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:54:39.564063 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-e1324e9f-1765-4910-afaf-e7955f6dc18d tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] 10.222.0.36 "GET /compute/v2.1/servers/cb269dd0-b5af-4013-9ded-062f40176b8f" status: 200 len: 1724 microversion: 2.1 time: 0.301809 Oct 15 13:54:39.564838 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 358/694] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:54:39 2022] GET /compute/v2.1/servers/cb269dd0-b5af-4013-9ded-062f40176b8f => generated 1724 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:54:40.190053 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-882a1735-023f-4f58-8086-2de546eb1520 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:54:40.192178 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-882a1735-023f-4f58-8086-2de546eb1520 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] [instance: d6ce134b-a723-453b-8847-b0725e969e89] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:54:40.199132 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-882a1735-023f-4f58-8086-2de546eb1520 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:40.199632 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-882a1735-023f-4f58-8086-2de546eb1520 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:40.200125 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-882a1735-023f-4f58-8086-2de546eb1520 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:40.201056 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-882a1735-023f-4f58-8086-2de546eb1520 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:40.201522 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-882a1735-023f-4f58-8086-2de546eb1520 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:40.201952 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-882a1735-023f-4f58-8086-2de546eb1520 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:40.219297 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.wsgi [None req-882a1735-023f-4f58-8086-2de546eb1520 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] HTTP exception thrown: Instance d6ce134b-a723-453b-8847-b0725e969e89 could not be found. Oct 15 13:54:40.221493 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-882a1735-023f-4f58-8086-2de546eb1520 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Request method failure captured: Oct 15 13:54:40.221493 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: request: GET /compute/v2.1/servers/d6ce134b-a723-453b-8847-b0725e969e89 HTTP/1.1 Oct 15 13:54:40.221493 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: Accept: application/json Oct 15 13:54:40.221493 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: Accept-Encoding: identity Oct 15 13:54:40.221493 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: Connection: close Oct 15 13:54:40.221493 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: Content-Length: 0 Oct 15 13:54:40.221493 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: Content-Type: application/json Oct 15 13:54:40.221493 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: Host: 10.222.0.36 Oct 15 13:54:40.221493 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: Openstack-System-Scope: None Oct 15 13:54:40.221493 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: User-Agent: python-urllib3/1.26.12 Oct 15 13:54:40.221493 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Auth-Token: gAAAAABjSrtAcNRuyJaICcZUTSLwxAs0kySI_X5nKRm6aYNoS4dR6dHXxvlq5mZjwQcqO3Z-3cXTbMyfvUh8C_lkoHtE3D4tjToHwAq643Fu6RdCv_Q9QZxO07oe3mT-ta1zSbFMEVv46ATsOjCgZ7AqQHUxb-fI2LeDEUQkCCyhNoZKvfm-214 Oct 15 13:54:40.221493 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Domain-Id: None Oct 15 13:54:40.221493 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Domain-Name: None Oct 15 13:54:40.221493 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Identity-Status: Confirmed Oct 15 13:54:40.221493 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Is-Admin-Project: True Oct 15 13:54:40.221493 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Project-Domain-Id: default Oct 15 13:54:40.221493 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Project-Domain-Name: Default Oct 15 13:54:40.221493 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Project-Id: 190914cc865b4003ab4b735d937e130d Oct 15 13:54:40.221493 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1694965695 Oct 15 13:54:40.221493 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Role: member,reader Oct 15 13:54:40.221493 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Roles: member,reader Oct 15 13:54:40.223009 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_190914cc865b4003ab4b735d937e130d", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/190914cc865b4003ab4b735d937e130d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/190914cc865b4003ab4b735d937e130d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/190914cc865b4003ab4b735d937e130d"}]}] Oct 15 13:54:40.223009 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Tenant: tempest-VolumesSnapshotTestJSON-1694965695 Oct 15 13:54:40.223009 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Tenant-Id: 190914cc865b4003ab4b735d937e130d Oct 15 13:54:40.223009 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1694965695 Oct 15 13:54:40.223009 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-User: tempest-VolumesSnapshotTestJSON-1694965695-project Oct 15 13:54:40.223009 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-User-Domain-Id: default Oct 15 13:54:40.223009 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-User-Domain-Name: Default Oct 15 13:54:40.223009 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-User-Id: 707bd577eee14892990367f396270f7b Oct 15 13:54:40.223009 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-User-Name: tempest-VolumesSnapshotTestJSON-1694965695-project Oct 15 13:54:40.223009 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: method: > Oct 15 13:54:40.223009 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: exception: Instance d6ce134b-a723-453b-8847-b0725e969e89 could not be found. Oct 15 13:54:40.223009 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: action_args: {'id': 'd6ce134b-a723-453b-8847-b0725e969e89'} Oct 15 13:54:40.223955 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 15 13:54:40.223955 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 13:54:40.223955 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 15 13:54:40.223955 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 15 13:54:40.223955 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 15 13:54:40.223955 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 15 13:54:40.223955 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 15 13:54:40.223955 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 15 13:54:40.223955 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 15 13:54:40.223955 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 15 13:54:40.223955 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6ce134b-a723-453b-8847-b0725e969e89 could not be found. Oct 15 13:54:40.223955 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Oct 15 13:54:40.223955 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 13:54:40.223955 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Oct 15 13:54:40.223955 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 13:54:40.223955 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 13:54:40.223955 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 13:54:40.223955 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 15 13:54:40.223955 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 15 13:54:40.223955 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 15 13:54:40.225583 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 15 13:54:40.225583 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 15 13:54:40.225583 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 15 13:54:40.225583 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 15 13:54:40.225583 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 15 13:54:40.225583 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 15 13:54:40.225583 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 15 13:54:40.225583 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6ce134b-a723-453b-8847-b0725e969e89 could not be found. Oct 15 13:54:40.225583 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Oct 15 13:54:40.225583 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 13:54:40.225583 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Oct 15 13:54:40.225583 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 13:54:40.225583 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 13:54:40.225583 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 13:54:40.225583 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 15 13:54:40.225583 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 15 13:54:40.225583 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6ce134b-a723-453b-8847-b0725e969e89 could not be found. Oct 15 13:54:40.225583 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Oct 15 13:54:40.226791 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-882a1735-023f-4f58-8086-2de546eb1520 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Returning 404 to user: Instance d6ce134b-a723-453b-8847-b0725e969e89 could not be found. {{(pid=125243) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 15 13:54:40.226791 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-882a1735-023f-4f58-8086-2de546eb1520 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] 10.222.0.36 "GET /compute/v2.1/servers/d6ce134b-a723-453b-8847-b0725e969e89" status: 404 len: 111 microversion: 2.1 time: 0.039737 Oct 15 13:54:40.227606 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 337/695] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:54:40 2022] GET /compute/v2.1/servers/d6ce134b-a723-453b-8847-b0725e969e89 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 15 13:54:40.590790 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-5c435ba2-7185-4fc9-908c-2ab8844ec9b5 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:54:40.591799 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-5c435ba2-7185-4fc9-908c-2ab8844ec9b5 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] [instance: cb269dd0-b5af-4013-9ded-062f40176b8f] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:54:40.599824 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-5c435ba2-7185-4fc9-908c-2ab8844ec9b5 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:40.600491 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-5c435ba2-7185-4fc9-908c-2ab8844ec9b5 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:40.601062 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-5c435ba2-7185-4fc9-908c-2ab8844ec9b5 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:40.601897 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-5c435ba2-7185-4fc9-908c-2ab8844ec9b5 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:40.602453 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-5c435ba2-7185-4fc9-908c-2ab8844ec9b5 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:40.602976 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-5c435ba2-7185-4fc9-908c-2ab8844ec9b5 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:40.777290 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-5c435ba2-7185-4fc9-908c-2ab8844ec9b5 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5150c06020594efe957359f641eba5da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a0813bae074cd2aa552be82abe8493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:54:40.787362 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-5c435ba2-7185-4fc9-908c-2ab8844ec9b5 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] 10.222.0.36 "GET /compute/v2.1/servers/cb269dd0-b5af-4013-9ded-062f40176b8f" status: 200 len: 1724 microversion: 2.1 time: 0.201134 Oct 15 13:54:40.788003 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 359/696] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:54:40 2022] GET /compute/v2.1/servers/cb269dd0-b5af-4013-9ded-062f40176b8f => generated 1724 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:54:41.825359 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-fe8d58b5-c34a-426e-bb9f-ee77d29345ea tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:54:41.826136 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-fe8d58b5-c34a-426e-bb9f-ee77d29345ea tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] [instance: cb269dd0-b5af-4013-9ded-062f40176b8f] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:54:41.832955 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-fe8d58b5-c34a-426e-bb9f-ee77d29345ea tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:41.833465 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-fe8d58b5-c34a-426e-bb9f-ee77d29345ea tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:41.833867 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-fe8d58b5-c34a-426e-bb9f-ee77d29345ea tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:41.834638 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-fe8d58b5-c34a-426e-bb9f-ee77d29345ea tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:41.835089 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-fe8d58b5-c34a-426e-bb9f-ee77d29345ea tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:41.835490 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-fe8d58b5-c34a-426e-bb9f-ee77d29345ea tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:41.990615 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-fe8d58b5-c34a-426e-bb9f-ee77d29345ea tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5150c06020594efe957359f641eba5da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a0813bae074cd2aa552be82abe8493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:54:41.999304 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-fe8d58b5-c34a-426e-bb9f-ee77d29345ea tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] 10.222.0.36 "GET /compute/v2.1/servers/cb269dd0-b5af-4013-9ded-062f40176b8f" status: 200 len: 1724 microversion: 2.1 time: 0.178013 Oct 15 13:54:41.999901 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 338/697] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:54:41 2022] GET /compute/v2.1/servers/cb269dd0-b5af-4013-9ded-062f40176b8f => generated 1724 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:54:43.026372 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-1097fc9a-ec77-496a-b6b0-3975c7588314 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:54:43.027536 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-1097fc9a-ec77-496a-b6b0-3975c7588314 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] [instance: cb269dd0-b5af-4013-9ded-062f40176b8f] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:54:43.031905 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG dbcounter [-] [125242] Writing DB stats nova_api:SELECT=62 {{(pid=125242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:54:43.041247 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-1097fc9a-ec77-496a-b6b0-3975c7588314 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:43.042089 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-1097fc9a-ec77-496a-b6b0-3975c7588314 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:43.042871 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-1097fc9a-ec77-496a-b6b0-3975c7588314 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:43.044057 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-1097fc9a-ec77-496a-b6b0-3975c7588314 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:43.044885 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-1097fc9a-ec77-496a-b6b0-3975c7588314 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:43.045646 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-1097fc9a-ec77-496a-b6b0-3975c7588314 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:43.197022 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-1097fc9a-ec77-496a-b6b0-3975c7588314 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5150c06020594efe957359f641eba5da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a0813bae074cd2aa552be82abe8493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:54:43.206497 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-1097fc9a-ec77-496a-b6b0-3975c7588314 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] 10.222.0.36 "GET /compute/v2.1/servers/cb269dd0-b5af-4013-9ded-062f40176b8f" status: 200 len: 1724 microversion: 2.1 time: 0.186653 Oct 15 13:54:43.208085 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 360/698] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:54:43 2022] GET /compute/v2.1/servers/cb269dd0-b5af-4013-9ded-062f40176b8f => generated 1724 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:54:44.234844 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-6307bbe3-262a-49e9-8af6-f041ed107cd1 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:54:44.235844 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-6307bbe3-262a-49e9-8af6-f041ed107cd1 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] [instance: cb269dd0-b5af-4013-9ded-062f40176b8f] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:54:44.246771 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-6307bbe3-262a-49e9-8af6-f041ed107cd1 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:44.247639 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-6307bbe3-262a-49e9-8af6-f041ed107cd1 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:44.248441 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-6307bbe3-262a-49e9-8af6-f041ed107cd1 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:44.249684 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-6307bbe3-262a-49e9-8af6-f041ed107cd1 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:44.250479 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-6307bbe3-262a-49e9-8af6-f041ed107cd1 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:44.251224 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-6307bbe3-262a-49e9-8af6-f041ed107cd1 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:44.431758 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-6307bbe3-262a-49e9-8af6-f041ed107cd1 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5150c06020594efe957359f641eba5da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a0813bae074cd2aa552be82abe8493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:54:44.449726 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-6307bbe3-262a-49e9-8af6-f041ed107cd1 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] 10.222.0.36 "GET /compute/v2.1/servers/cb269dd0-b5af-4013-9ded-062f40176b8f" status: 200 len: 1724 microversion: 2.1 time: 0.222437 Oct 15 13:54:44.450805 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 339/699] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:54:44 2022] GET /compute/v2.1/servers/cb269dd0-b5af-4013-9ded-062f40176b8f => generated 1724 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:54:45.490737 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-cb08be27-1e1e-47af-8f65-a9382f751af8 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:54:45.491507 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-cb08be27-1e1e-47af-8f65-a9382f751af8 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] [instance: cb269dd0-b5af-4013-9ded-062f40176b8f] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:54:45.499039 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-cb08be27-1e1e-47af-8f65-a9382f751af8 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:45.499547 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-cb08be27-1e1e-47af-8f65-a9382f751af8 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:45.500034 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-cb08be27-1e1e-47af-8f65-a9382f751af8 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:45.500766 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-cb08be27-1e1e-47af-8f65-a9382f751af8 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:45.501229 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-cb08be27-1e1e-47af-8f65-a9382f751af8 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:45.501661 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-cb08be27-1e1e-47af-8f65-a9382f751af8 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:45.705892 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-cb08be27-1e1e-47af-8f65-a9382f751af8 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5150c06020594efe957359f641eba5da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a0813bae074cd2aa552be82abe8493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:54:45.714900 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-cb08be27-1e1e-47af-8f65-a9382f751af8 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] 10.222.0.36 "GET /compute/v2.1/servers/cb269dd0-b5af-4013-9ded-062f40176b8f" status: 200 len: 1724 microversion: 2.1 time: 0.229071 Oct 15 13:54:45.715509 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 361/700] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:54:45 2022] GET /compute/v2.1/servers/cb269dd0-b5af-4013-9ded-062f40176b8f => generated 1724 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:54:46.376650 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-72dbdadf-5663-4eaa-b613-529d9fa2fa08 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:54:46.377802 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-72dbdadf-5663-4eaa-b613-529d9fa2fa08 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] [instance: 40d67d09-379e-4c12-b36c-21edf3b23e45] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:54:46.385414 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-72dbdadf-5663-4eaa-b613-529d9fa2fa08 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:46.385907 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-72dbdadf-5663-4eaa-b613-529d9fa2fa08 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:46.386346 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-72dbdadf-5663-4eaa-b613-529d9fa2fa08 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:46.387068 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-72dbdadf-5663-4eaa-b613-529d9fa2fa08 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:46.387521 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-72dbdadf-5663-4eaa-b613-529d9fa2fa08 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:46.387975 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-72dbdadf-5663-4eaa-b613-529d9fa2fa08 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:46.481793 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.objects.instance [None req-72dbdadf-5663-4eaa-b613-529d9fa2fa08 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lazy-loading 'services' on Instance uuid 40d67d09-379e-4c12-b36c-21edf3b23e45 {{(pid=125243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 15 13:54:46.618010 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-72dbdadf-5663-4eaa-b613-529d9fa2fa08 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] 10.222.0.36 "DELETE /compute/v2.1/servers/40d67d09-379e-4c12-b36c-21edf3b23e45/os-volume_attachments/831ba96d-8071-44a9-b3a9-1e54b4af94bb" status: 202 len: 0 microversion: 2.1 time: 0.399859 Oct 15 13:54:46.618622 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 340/701] 10.222.0.36 () {58 vars in 1416 bytes} [Sat Oct 15 13:54:46 2022] DELETE /compute/v2.1/servers/40d67d09-379e-4c12-b36c-21edf3b23e45/os-volume_attachments/831ba96d-8071-44a9-b3a9-1e54b4af94bb => generated 0 bytes in 401 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 15 13:54:46.742825 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-e74965be-0ecc-4b4d-bc5e-353c64cd7f01 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:54:46.743796 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-e74965be-0ecc-4b4d-bc5e-353c64cd7f01 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] [instance: cb269dd0-b5af-4013-9ded-062f40176b8f] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:54:46.754533 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-e74965be-0ecc-4b4d-bc5e-353c64cd7f01 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:46.755159 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-e74965be-0ecc-4b4d-bc5e-353c64cd7f01 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:46.755609 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-e74965be-0ecc-4b4d-bc5e-353c64cd7f01 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:46.756450 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-e74965be-0ecc-4b4d-bc5e-353c64cd7f01 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:46.756863 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-e74965be-0ecc-4b4d-bc5e-353c64cd7f01 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:46.757295 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-e74965be-0ecc-4b4d-bc5e-353c64cd7f01 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:46.916104 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-e74965be-0ecc-4b4d-bc5e-353c64cd7f01 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5150c06020594efe957359f641eba5da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a0813bae074cd2aa552be82abe8493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:54:46.925317 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-e74965be-0ecc-4b4d-bc5e-353c64cd7f01 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] 10.222.0.36 "GET /compute/v2.1/servers/cb269dd0-b5af-4013-9ded-062f40176b8f" status: 200 len: 1724 microversion: 2.1 time: 0.188490 Oct 15 13:54:46.926150 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 362/702] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:54:46 2022] GET /compute/v2.1/servers/cb269dd0-b5af-4013-9ded-062f40176b8f => generated 1724 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:54:47.952237 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-538fcbb4-472a-4293-bb5b-e80193ddbe9b tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:54:47.952843 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-538fcbb4-472a-4293-bb5b-e80193ddbe9b tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] [instance: cb269dd0-b5af-4013-9ded-062f40176b8f] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:54:47.960078 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-538fcbb4-472a-4293-bb5b-e80193ddbe9b tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:47.960587 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-538fcbb4-472a-4293-bb5b-e80193ddbe9b tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:47.961008 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-538fcbb4-472a-4293-bb5b-e80193ddbe9b tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:47.961719 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-538fcbb4-472a-4293-bb5b-e80193ddbe9b tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:47.962209 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-538fcbb4-472a-4293-bb5b-e80193ddbe9b tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:47.962626 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-538fcbb4-472a-4293-bb5b-e80193ddbe9b tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:47.967563 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG dbcounter [-] [125243] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=125243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:54:48.145555 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-538fcbb4-472a-4293-bb5b-e80193ddbe9b tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5150c06020594efe957359f641eba5da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a0813bae074cd2aa552be82abe8493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:54:48.154405 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-538fcbb4-472a-4293-bb5b-e80193ddbe9b tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] 10.222.0.36 "GET /compute/v2.1/servers/cb269dd0-b5af-4013-9ded-062f40176b8f" status: 200 len: 1730 microversion: 2.1 time: 0.207351 Oct 15 13:54:48.154992 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 341/703] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:54:47 2022] GET /compute/v2.1/servers/cb269dd0-b5af-4013-9ded-062f40176b8f => generated 1730 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 13:54:48.179707 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-a87214b7-95f5-42cf-822c-ea189a248e6f tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:54:48.180634 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-a87214b7-95f5-42cf-822c-ea189a248e6f tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] [instance: cb269dd0-b5af-4013-9ded-062f40176b8f] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:54:48.188289 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-a87214b7-95f5-42cf-822c-ea189a248e6f tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:48.188790 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-a87214b7-95f5-42cf-822c-ea189a248e6f tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:48.189780 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-a87214b7-95f5-42cf-822c-ea189a248e6f tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:48.190098 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-a87214b7-95f5-42cf-822c-ea189a248e6f tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:48.190389 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-a87214b7-95f5-42cf-822c-ea189a248e6f tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:48.191257 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-a87214b7-95f5-42cf-822c-ea189a248e6f tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:48.290341 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-a87214b7-95f5-42cf-822c-ea189a248e6f tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] 10.222.0.36 "GET /compute/v2.1/servers/cb269dd0-b5af-4013-9ded-062f40176b8f/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.116255 Oct 15 13:54:48.290973 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 363/704] 10.222.0.36 () {58 vars in 1275 bytes} [Sat Oct 15 13:54:48 2022] GET /compute/v2.1/servers/cb269dd0-b5af-4013-9ded-062f40176b8f/os-interface => generated 285 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 13:54:49.624236 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [req-fe8b7dc2-82a5-4270-a153-c243393174ac req-225e90ec-10ad-49a3-9166-7ff329b106c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb269dd0-b5af-4013-9ded-062f40176b8f", "tag": "4fc36f1c-5dfc-463e-b40a-40955077b6d2"}]} {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 13:54:49.639449 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [req-fe8b7dc2-82a5-4270-a153-c243393174ac req-225e90ec-10ad-49a3-9166-7ff329b106c6 service nova] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:49.656715 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [req-fe8b7dc2-82a5-4270-a153-c243393174ac req-225e90ec-10ad-49a3-9166-7ff329b106c6 service nova] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:49.662439 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [req-fe8b7dc2-82a5-4270-a153-c243393174ac req-225e90ec-10ad-49a3-9166-7ff329b106c6 service nova] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:49.676515 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.compute.server_external_events [req-fe8b7dc2-82a5-4270-a153-c243393174ac req-225e90ec-10ad-49a3-9166-7ff329b106c6 service nova] Creating event network-changed:4fc36f1c-5dfc-463e-b40a-40955077b6d2 for instance cb269dd0-b5af-4013-9ded-062f40176b8f on hv-cinder-86149 Oct 15 13:54:49.681918 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [req-fe8b7dc2-82a5-4270-a153-c243393174ac req-225e90ec-10ad-49a3-9166-7ff329b106c6 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062294 Oct 15 13:54:49.682747 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 342/705] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 15 13:54:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 13:54:51.705136 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [req-2bf5eb4b-42b3-40b1-8622-c8a45771cf34 req-198bbafd-abac-4136-9c92-a9001670a94e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb269dd0-b5af-4013-9ded-062f40176b8f", "tag": "4fc36f1c-5dfc-463e-b40a-40955077b6d2"}]} {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 13:54:51.720763 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [req-2bf5eb4b-42b3-40b1-8622-c8a45771cf34 req-198bbafd-abac-4136-9c92-a9001670a94e service nova] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:51.721562 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [req-2bf5eb4b-42b3-40b1-8622-c8a45771cf34 req-198bbafd-abac-4136-9c92-a9001670a94e service nova] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:51.722256 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [req-2bf5eb4b-42b3-40b1-8622-c8a45771cf34 req-198bbafd-abac-4136-9c92-a9001670a94e service nova] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:51.735267 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.compute.server_external_events [req-2bf5eb4b-42b3-40b1-8622-c8a45771cf34 req-198bbafd-abac-4136-9c92-a9001670a94e service nova] Creating event network-changed:4fc36f1c-5dfc-463e-b40a-40955077b6d2 for instance cb269dd0-b5af-4013-9ded-062f40176b8f on hv-cinder-86149 Oct 15 13:54:51.743549 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [req-2bf5eb4b-42b3-40b1-8622-c8a45771cf34 req-198bbafd-abac-4136-9c92-a9001670a94e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044885 Oct 15 13:54:51.750758 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 364/706] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 15 13:54:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 13:54:52.431108 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-6c09f753-2c8a-4071-860c-ddd0b51e70c5 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1965974498", "imageRef": "26e64909-1cae-49ca-af5e-adea40c062d7", "flavorRef": "452", "networks": [{"uuid": "fbb63af8-320e-494a-a4ee-414e6707c733"}]}} {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 13:54:52.456691 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG dbcounter [-] [125243] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1 {{(pid=125243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:54:52.512667 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.network.neutron [None req-6c09f753-2c8a-4071-860c-ddd0b51e70c5 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] validate_networks() for [('fbb63af8-320e-494a-a4ee-414e6707c733', None, None, None, None, None)] {{(pid=125243) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 15 13:54:53.087433 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.virt.hardware [None req-6c09f753-2c8a-4071-860c-ddd0b51e70c5 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Flavor limits 0:0:0 {{(pid=125243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 15 13:54:53.087853 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.virt.hardware [None req-6c09f753-2c8a-4071-860c-ddd0b51e70c5 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Image limits 0:0:0 {{(pid=125243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 15 13:54:53.088350 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.virt.hardware [None req-6c09f753-2c8a-4071-860c-ddd0b51e70c5 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Flavor pref 0:0:0 {{(pid=125243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 15 13:54:53.088753 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.virt.hardware [None req-6c09f753-2c8a-4071-860c-ddd0b51e70c5 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Image pref 0:0:0 {{(pid=125243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 15 13:54:53.089210 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.virt.hardware [None req-6c09f753-2c8a-4071-860c-ddd0b51e70c5 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 15 13:54:53.099626 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-6c09f753-2c8a-4071-860c-ddd0b51e70c5 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:53.100150 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-6c09f753-2c8a-4071-860c-ddd0b51e70c5 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:53.100608 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-6c09f753-2c8a-4071-860c-ddd0b51e70c5 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:53.101341 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-6c09f753-2c8a-4071-860c-ddd0b51e70c5 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:53.101800 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-6c09f753-2c8a-4071-860c-ddd0b51e70c5 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:53.102218 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-6c09f753-2c8a-4071-860c-ddd0b51e70c5 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:53.134107 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.quota [None req-6c09f753-2c8a-4071-860c-ddd0b51e70c5 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Getting quotas for project 190914cc865b4003ab4b735d937e130d. Resources: {'cores', 'ram', 'instances'} {{(pid=125243) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 15 13:54:53.139193 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.quota [None req-6c09f753-2c8a-4071-860c-ddd0b51e70c5 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Getting quotas for user 707bd577eee14892990367f396270f7b and project 190914cc865b4003ab4b735d937e130d. Resources: {'cores', 'ram', 'instances'} {{(pid=125243) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 15 13:54:53.142060 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-34ee3cd5-62e6-497a-8828-1f1c9fd8922b tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 13:54:53.152091 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-34ee3cd5-62e6-497a-8828-1f1c9fd8922b tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:53.152789 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-34ee3cd5-62e6-497a-8828-1f1c9fd8922b tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:53.153391 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-34ee3cd5-62e6-497a-8828-1f1c9fd8922b tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:53.160934 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-6c09f753-2c8a-4071-860c-ddd0b51e70c5 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Going to run 1 instances... {{(pid=125243) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 15 13:54:53.163823 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-6c09f753-2c8a-4071-860c-ddd0b51e70c5 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] [instance: d9999e18-9454-480d-bdce-c193d7fb40b4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='26e64909-1cae-49ca-af5e-adea40c062d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125243) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 15 13:54:53.185320 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-34ee3cd5-62e6-497a-8828-1f1c9fd8922b tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] [instance: 40d67d09-379e-4c12-b36c-21edf3b23e45] Going to try to stop instance {{(pid=125242) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 15 13:54:53.233171 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-6c09f753-2c8a-4071-860c-ddd0b51e70c5 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.811502 Oct 15 13:54:53.235085 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 343/707] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 15 13:54:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 815 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 15 13:54:53.250192 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-84541ad1-5220-4cca-acf4-33d5904e4e52 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:54:53.250837 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-84541ad1-5220-4cca-acf4-33d5904e4e52 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] [instance: d9999e18-9454-480d-bdce-c193d7fb40b4] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:54:53.260469 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-34ee3cd5-62e6-497a-8828-1f1c9fd8922b tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] 10.222.0.36 "POST /compute/v2.1/servers/40d67d09-379e-4c12-b36c-21edf3b23e45/action" status: 202 len: 0 microversion: 2.1 time: 0.123052 Oct 15 13:54:53.261561 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 365/708] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 15 13:54:53 2022] POST /compute/v2.1/servers/40d67d09-379e-4c12-b36c-21edf3b23e45/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 15 13:54:53.282768 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-fb6f58cb-5773-4d83-a5c7-9fc635e9b56c tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:54:53.284079 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-fb6f58cb-5773-4d83-a5c7-9fc635e9b56c tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] [instance: 40d67d09-379e-4c12-b36c-21edf3b23e45] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:54:53.292290 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-fb6f58cb-5773-4d83-a5c7-9fc635e9b56c tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:53.292806 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-fb6f58cb-5773-4d83-a5c7-9fc635e9b56c tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:53.293299 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-fb6f58cb-5773-4d83-a5c7-9fc635e9b56c tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:53.293956 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-fb6f58cb-5773-4d83-a5c7-9fc635e9b56c tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:53.294563 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-fb6f58cb-5773-4d83-a5c7-9fc635e9b56c tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:53.294993 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-fb6f58cb-5773-4d83-a5c7-9fc635e9b56c tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:53.401775 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-84541ad1-5220-4cca-acf4-33d5904e4e52 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707bd577eee14892990367f396270f7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '190914cc865b4003ab4b735d937e130d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:54:53.419866 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-84541ad1-5220-4cca-acf4-33d5904e4e52 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] 10.222.0.36 "GET /compute/v2.1/servers/d9999e18-9454-480d-bdce-c193d7fb40b4" status: 200 len: 1219 microversion: 2.1 time: 0.176871 Oct 15 13:54:53.420838 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 344/709] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:54:53 2022] GET /compute/v2.1/servers/d9999e18-9454-480d-bdce-c193d7fb40b4 => generated 1219 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:54:53.528381 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-fb6f58cb-5773-4d83-a5c7-9fc635e9b56c tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583cce1547144e11978f20a3193ceba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f8b5024a194f70a9f7689ac44ab07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:54:53.536840 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-fb6f58cb-5773-4d83-a5c7-9fc635e9b56c tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] 10.222.0.36 "GET /compute/v2.1/servers/40d67d09-379e-4c12-b36c-21edf3b23e45" status: 200 len: 1679 microversion: 2.1 time: 0.261341 Oct 15 13:54:53.539934 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 366/710] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:54:53 2022] GET /compute/v2.1/servers/40d67d09-379e-4c12-b36c-21edf3b23e45 => generated 1679 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:54:54.450800 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-9f39e317-80b4-4058-b503-e619ac455a62 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:54:54.451382 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-9f39e317-80b4-4058-b503-e619ac455a62 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] [instance: d9999e18-9454-480d-bdce-c193d7fb40b4] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:54:54.459533 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-9f39e317-80b4-4058-b503-e619ac455a62 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:54.460194 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-9f39e317-80b4-4058-b503-e619ac455a62 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:54.460659 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-9f39e317-80b4-4058-b503-e619ac455a62 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:54.461366 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-9f39e317-80b4-4058-b503-e619ac455a62 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:54.461803 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-9f39e317-80b4-4058-b503-e619ac455a62 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:54.462256 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-9f39e317-80b4-4058-b503-e619ac455a62 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:54.544482 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-9f39e317-80b4-4058-b503-e619ac455a62 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707bd577eee14892990367f396270f7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '190914cc865b4003ab4b735d937e130d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:54:54.553039 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-9f39e317-80b4-4058-b503-e619ac455a62 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] 10.222.0.36 "GET /compute/v2.1/servers/d9999e18-9454-480d-bdce-c193d7fb40b4" status: 200 len: 1271 microversion: 2.1 time: 0.106537 Oct 15 13:54:54.553620 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 345/711] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:54:54 2022] GET /compute/v2.1/servers/d9999e18-9454-480d-bdce-c193d7fb40b4 => generated 1271 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:54:54.561466 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-05fc19a2-6905-4a11-ad2a-ada94e8ffe31 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:54:54.562078 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-05fc19a2-6905-4a11-ad2a-ada94e8ffe31 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] [instance: 40d67d09-379e-4c12-b36c-21edf3b23e45] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:54:54.569120 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-05fc19a2-6905-4a11-ad2a-ada94e8ffe31 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:54.569621 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-05fc19a2-6905-4a11-ad2a-ada94e8ffe31 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:54.570058 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-05fc19a2-6905-4a11-ad2a-ada94e8ffe31 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:54.570775 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-05fc19a2-6905-4a11-ad2a-ada94e8ffe31 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:54.571232 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-05fc19a2-6905-4a11-ad2a-ada94e8ffe31 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:54.571662 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-05fc19a2-6905-4a11-ad2a-ada94e8ffe31 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:54.720505 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-05fc19a2-6905-4a11-ad2a-ada94e8ffe31 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583cce1547144e11978f20a3193ceba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f8b5024a194f70a9f7689ac44ab07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:54:54.728863 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-05fc19a2-6905-4a11-ad2a-ada94e8ffe31 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] 10.222.0.36 "GET /compute/v2.1/servers/40d67d09-379e-4c12-b36c-21edf3b23e45" status: 200 len: 1679 microversion: 2.1 time: 0.171255 Oct 15 13:54:54.729790 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 367/712] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:54:54 2022] GET /compute/v2.1/servers/40d67d09-379e-4c12-b36c-21edf3b23e45 => generated 1679 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:54:55.576695 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-3989f870-2114-4822-ab03-3f236d135be8 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:54:55.577294 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-3989f870-2114-4822-ab03-3f236d135be8 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] [instance: d9999e18-9454-480d-bdce-c193d7fb40b4] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:54:55.584511 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-3989f870-2114-4822-ab03-3f236d135be8 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:55.584990 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-3989f870-2114-4822-ab03-3f236d135be8 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:55.585621 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-3989f870-2114-4822-ab03-3f236d135be8 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:55.586354 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-3989f870-2114-4822-ab03-3f236d135be8 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:55.586796 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-3989f870-2114-4822-ab03-3f236d135be8 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:55.587212 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-3989f870-2114-4822-ab03-3f236d135be8 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:55.755167 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-87d511e2-fb74-4387-9055-4026df457479 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:54:55.756253 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-87d511e2-fb74-4387-9055-4026df457479 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] [instance: 40d67d09-379e-4c12-b36c-21edf3b23e45] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:54:55.768260 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-87d511e2-fb74-4387-9055-4026df457479 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:55.769173 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-87d511e2-fb74-4387-9055-4026df457479 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:55.769970 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-87d511e2-fb74-4387-9055-4026df457479 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:55.771284 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-87d511e2-fb74-4387-9055-4026df457479 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:55.772181 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-87d511e2-fb74-4387-9055-4026df457479 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:55.772989 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-87d511e2-fb74-4387-9055-4026df457479 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:55.781696 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG dbcounter [-] [125242] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:54:55.851782 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-3989f870-2114-4822-ab03-3f236d135be8 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707bd577eee14892990367f396270f7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '190914cc865b4003ab4b735d937e130d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:54:55.864863 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-3989f870-2114-4822-ab03-3f236d135be8 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] 10.222.0.36 "GET /compute/v2.1/servers/d9999e18-9454-480d-bdce-c193d7fb40b4" status: 200 len: 1319 microversion: 2.1 time: 0.291884 Oct 15 13:54:55.865483 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 346/713] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:54:55 2022] GET /compute/v2.1/servers/d9999e18-9454-480d-bdce-c193d7fb40b4 => generated 1319 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:54:56.161074 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-87d511e2-fb74-4387-9055-4026df457479 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583cce1547144e11978f20a3193ceba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f8b5024a194f70a9f7689ac44ab07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:54:56.169413 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-87d511e2-fb74-4387-9055-4026df457479 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] 10.222.0.36 "GET /compute/v2.1/servers/40d67d09-379e-4c12-b36c-21edf3b23e45" status: 200 len: 1679 microversion: 2.1 time: 0.420374 Oct 15 13:54:56.170006 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 368/714] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:54:55 2022] GET /compute/v2.1/servers/40d67d09-379e-4c12-b36c-21edf3b23e45 => generated 1679 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:54:56.461193 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [req-09fd4f99-c5cc-4fa3-94e1-89b6af0e34c4 req-a2297693-347d-4376-82cc-59cefd98e579 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9999e18-9454-480d-bdce-c193d7fb40b4", "tag": "06855a5f-f48f-4c3a-af82-e6a857966964"}]} {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 13:54:56.475241 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [req-09fd4f99-c5cc-4fa3-94e1-89b6af0e34c4 req-a2297693-347d-4376-82cc-59cefd98e579 service nova] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:56.475714 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [req-09fd4f99-c5cc-4fa3-94e1-89b6af0e34c4 req-a2297693-347d-4376-82cc-59cefd98e579 service nova] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:56.477116 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [req-09fd4f99-c5cc-4fa3-94e1-89b6af0e34c4 req-a2297693-347d-4376-82cc-59cefd98e579 service nova] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:56.490924 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.compute.server_external_events [req-09fd4f99-c5cc-4fa3-94e1-89b6af0e34c4 req-a2297693-347d-4376-82cc-59cefd98e579 service nova] Creating event network-changed:06855a5f-f48f-4c3a-af82-e6a857966964 for instance d9999e18-9454-480d-bdce-c193d7fb40b4 on hv-cinder-86149 Oct 15 13:54:56.498229 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [req-09fd4f99-c5cc-4fa3-94e1-89b6af0e34c4 req-a2297693-347d-4376-82cc-59cefd98e579 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040971 Oct 15 13:54:56.498863 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 347/715] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 15 13:54:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 13:54:56.890360 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-59d438f7-a305-483d-b21b-fd6681b23a71 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:54:56.891904 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-59d438f7-a305-483d-b21b-fd6681b23a71 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] [instance: d9999e18-9454-480d-bdce-c193d7fb40b4] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:54:56.899371 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-59d438f7-a305-483d-b21b-fd6681b23a71 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:56.899903 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-59d438f7-a305-483d-b21b-fd6681b23a71 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:56.900345 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-59d438f7-a305-483d-b21b-fd6681b23a71 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:56.901050 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-59d438f7-a305-483d-b21b-fd6681b23a71 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:56.901683 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-59d438f7-a305-483d-b21b-fd6681b23a71 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:56.902119 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-59d438f7-a305-483d-b21b-fd6681b23a71 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:57.135283 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-59d438f7-a305-483d-b21b-fd6681b23a71 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707bd577eee14892990367f396270f7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '190914cc865b4003ab4b735d937e130d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:54:57.149059 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-59d438f7-a305-483d-b21b-fd6681b23a71 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] 10.222.0.36 "GET /compute/v2.1/servers/d9999e18-9454-480d-bdce-c193d7fb40b4" status: 200 len: 1319 microversion: 2.1 time: 0.263667 Oct 15 13:54:57.150200 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 369/716] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:54:56 2022] GET /compute/v2.1/servers/d9999e18-9454-480d-bdce-c193d7fb40b4 => generated 1319 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:54:57.195171 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-5415dcbd-1e7a-4c4a-9c32-0a9fc0564ce5 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:54:57.195944 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-5415dcbd-1e7a-4c4a-9c32-0a9fc0564ce5 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] [instance: 40d67d09-379e-4c12-b36c-21edf3b23e45] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:54:57.203793 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-5415dcbd-1e7a-4c4a-9c32-0a9fc0564ce5 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:57.204314 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-5415dcbd-1e7a-4c4a-9c32-0a9fc0564ce5 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:57.204729 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-5415dcbd-1e7a-4c4a-9c32-0a9fc0564ce5 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:57.205523 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-5415dcbd-1e7a-4c4a-9c32-0a9fc0564ce5 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:57.205970 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-5415dcbd-1e7a-4c4a-9c32-0a9fc0564ce5 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:57.206603 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-5415dcbd-1e7a-4c4a-9c32-0a9fc0564ce5 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:57.379190 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-5415dcbd-1e7a-4c4a-9c32-0a9fc0564ce5 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583cce1547144e11978f20a3193ceba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f8b5024a194f70a9f7689ac44ab07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:54:57.387308 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-5415dcbd-1e7a-4c4a-9c32-0a9fc0564ce5 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] 10.222.0.36 "GET /compute/v2.1/servers/40d67d09-379e-4c12-b36c-21edf3b23e45" status: 200 len: 1679 microversion: 2.1 time: 0.197163 Oct 15 13:54:57.387918 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 348/717] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:54:57 2022] GET /compute/v2.1/servers/40d67d09-379e-4c12-b36c-21edf3b23e45 => generated 1679 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:54:58.177555 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-c2a7b87b-7f05-4c1c-86de-cd4be2b799b6 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:54:58.178165 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-c2a7b87b-7f05-4c1c-86de-cd4be2b799b6 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] [instance: d9999e18-9454-480d-bdce-c193d7fb40b4] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:54:58.185157 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-c2a7b87b-7f05-4c1c-86de-cd4be2b799b6 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:58.185645 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-c2a7b87b-7f05-4c1c-86de-cd4be2b799b6 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:58.186088 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-c2a7b87b-7f05-4c1c-86de-cd4be2b799b6 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:58.186797 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-c2a7b87b-7f05-4c1c-86de-cd4be2b799b6 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:58.187248 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-c2a7b87b-7f05-4c1c-86de-cd4be2b799b6 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:58.187682 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-c2a7b87b-7f05-4c1c-86de-cd4be2b799b6 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:58.329612 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-c2a7b87b-7f05-4c1c-86de-cd4be2b799b6 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707bd577eee14892990367f396270f7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '190914cc865b4003ab4b735d937e130d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:54:58.338033 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-c2a7b87b-7f05-4c1c-86de-cd4be2b799b6 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] 10.222.0.36 "GET /compute/v2.1/servers/d9999e18-9454-480d-bdce-c193d7fb40b4" status: 200 len: 1319 microversion: 2.1 time: 0.165263 Oct 15 13:54:58.338601 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 370/718] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:54:58 2022] GET /compute/v2.1/servers/d9999e18-9454-480d-bdce-c193d7fb40b4 => generated 1319 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:54:58.411620 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-9515955e-1979-4825-820a-b2387c4119e7 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:54:58.412255 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-9515955e-1979-4825-820a-b2387c4119e7 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] [instance: 40d67d09-379e-4c12-b36c-21edf3b23e45] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:54:58.418996 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-9515955e-1979-4825-820a-b2387c4119e7 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:58.419508 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-9515955e-1979-4825-820a-b2387c4119e7 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:58.419976 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-9515955e-1979-4825-820a-b2387c4119e7 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:58.420670 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-9515955e-1979-4825-820a-b2387c4119e7 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:58.421122 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-9515955e-1979-4825-820a-b2387c4119e7 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:58.421543 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-9515955e-1979-4825-820a-b2387c4119e7 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:58.566300 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-9515955e-1979-4825-820a-b2387c4119e7 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583cce1547144e11978f20a3193ceba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f8b5024a194f70a9f7689ac44ab07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:54:58.574411 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-9515955e-1979-4825-820a-b2387c4119e7 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] 10.222.0.36 "GET /compute/v2.1/servers/40d67d09-379e-4c12-b36c-21edf3b23e45" status: 200 len: 1679 microversion: 2.1 time: 0.167180 Oct 15 13:54:58.574978 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 349/719] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:54:58 2022] GET /compute/v2.1/servers/40d67d09-379e-4c12-b36c-21edf3b23e45 => generated 1679 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:54:59.362194 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-5696a3ae-3b2a-4b2d-a303-b692c48348b4 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:54:59.362922 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-5696a3ae-3b2a-4b2d-a303-b692c48348b4 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] [instance: d9999e18-9454-480d-bdce-c193d7fb40b4] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:54:59.370123 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-5696a3ae-3b2a-4b2d-a303-b692c48348b4 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:59.370620 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-5696a3ae-3b2a-4b2d-a303-b692c48348b4 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:59.371055 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-5696a3ae-3b2a-4b2d-a303-b692c48348b4 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:59.371793 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-5696a3ae-3b2a-4b2d-a303-b692c48348b4 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:59.372263 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-5696a3ae-3b2a-4b2d-a303-b692c48348b4 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:59.372690 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-5696a3ae-3b2a-4b2d-a303-b692c48348b4 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:59.510859 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-5696a3ae-3b2a-4b2d-a303-b692c48348b4 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707bd577eee14892990367f396270f7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '190914cc865b4003ab4b735d937e130d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:54:59.519282 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-5696a3ae-3b2a-4b2d-a303-b692c48348b4 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] 10.222.0.36 "GET /compute/v2.1/servers/d9999e18-9454-480d-bdce-c193d7fb40b4" status: 200 len: 1319 microversion: 2.1 time: 0.161351 Oct 15 13:54:59.519973 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 371/720] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:54:59 2022] GET /compute/v2.1/servers/d9999e18-9454-480d-bdce-c193d7fb40b4 => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:54:59.598883 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-978e122b-3da6-40e6-bcff-3d69872fc885 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:54:59.599511 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-978e122b-3da6-40e6-bcff-3d69872fc885 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] [instance: 40d67d09-379e-4c12-b36c-21edf3b23e45] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:54:59.606775 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-978e122b-3da6-40e6-bcff-3d69872fc885 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:59.607255 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-978e122b-3da6-40e6-bcff-3d69872fc885 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:59.607683 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-978e122b-3da6-40e6-bcff-3d69872fc885 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:59.608419 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-978e122b-3da6-40e6-bcff-3d69872fc885 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:54:59.608866 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-978e122b-3da6-40e6-bcff-3d69872fc885 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:54:59.609283 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-978e122b-3da6-40e6-bcff-3d69872fc885 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:54:59.752306 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-978e122b-3da6-40e6-bcff-3d69872fc885 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583cce1547144e11978f20a3193ceba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f8b5024a194f70a9f7689ac44ab07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:54:59.760581 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-978e122b-3da6-40e6-bcff-3d69872fc885 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] 10.222.0.36 "GET /compute/v2.1/servers/40d67d09-379e-4c12-b36c-21edf3b23e45" status: 200 len: 1679 microversion: 2.1 time: 0.165922 Oct 15 13:54:59.761163 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 350/721] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:54:59 2022] GET /compute/v2.1/servers/40d67d09-379e-4c12-b36c-21edf3b23e45 => generated 1679 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:55:00.541960 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-997b8e38-ea5c-493e-b61c-ee0654edd416 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:55:00.542576 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-997b8e38-ea5c-493e-b61c-ee0654edd416 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] [instance: d9999e18-9454-480d-bdce-c193d7fb40b4] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:55:00.551166 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-997b8e38-ea5c-493e-b61c-ee0654edd416 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:55:00.552068 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-997b8e38-ea5c-493e-b61c-ee0654edd416 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:55:00.552538 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-997b8e38-ea5c-493e-b61c-ee0654edd416 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:55:00.553271 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-997b8e38-ea5c-493e-b61c-ee0654edd416 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:55:00.553725 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-997b8e38-ea5c-493e-b61c-ee0654edd416 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:55:00.554144 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-997b8e38-ea5c-493e-b61c-ee0654edd416 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:55:00.785102 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-437c17ce-3ed4-4c8b-9544-9ae51d5c7411 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:55:00.786471 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-437c17ce-3ed4-4c8b-9544-9ae51d5c7411 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] [instance: 40d67d09-379e-4c12-b36c-21edf3b23e45] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:55:00.793981 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-437c17ce-3ed4-4c8b-9544-9ae51d5c7411 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:55:00.794537 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-437c17ce-3ed4-4c8b-9544-9ae51d5c7411 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:55:00.794984 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-437c17ce-3ed4-4c8b-9544-9ae51d5c7411 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:55:00.795737 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-437c17ce-3ed4-4c8b-9544-9ae51d5c7411 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:55:00.796230 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-437c17ce-3ed4-4c8b-9544-9ae51d5c7411 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:55:00.796651 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-437c17ce-3ed4-4c8b-9544-9ae51d5c7411 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:55:00.800897 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-997b8e38-ea5c-493e-b61c-ee0654edd416 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707bd577eee14892990367f396270f7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '190914cc865b4003ab4b735d937e130d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:55:00.810273 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-997b8e38-ea5c-493e-b61c-ee0654edd416 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] 10.222.0.36 "GET /compute/v2.1/servers/d9999e18-9454-480d-bdce-c193d7fb40b4" status: 200 len: 1319 microversion: 2.1 time: 0.272441 Oct 15 13:55:00.811356 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 372/722] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:55:00 2022] GET /compute/v2.1/servers/d9999e18-9454-480d-bdce-c193d7fb40b4 => generated 1319 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:55:00.999533 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-437c17ce-3ed4-4c8b-9544-9ae51d5c7411 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583cce1547144e11978f20a3193ceba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f8b5024a194f70a9f7689ac44ab07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:55:01.009463 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-437c17ce-3ed4-4c8b-9544-9ae51d5c7411 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] 10.222.0.36 "GET /compute/v2.1/servers/40d67d09-379e-4c12-b36c-21edf3b23e45" status: 200 len: 1679 microversion: 2.1 time: 0.228453 Oct 15 13:55:01.010041 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 351/723] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:55:00 2022] GET /compute/v2.1/servers/40d67d09-379e-4c12-b36c-21edf3b23e45 => generated 1679 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:55:01.834463 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-c82b29d6-a867-4f7f-bc65-3ed021aa50fe tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:55:01.835081 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-c82b29d6-a867-4f7f-bc65-3ed021aa50fe tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] [instance: d9999e18-9454-480d-bdce-c193d7fb40b4] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:55:01.841987 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-c82b29d6-a867-4f7f-bc65-3ed021aa50fe tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:55:01.842455 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-c82b29d6-a867-4f7f-bc65-3ed021aa50fe tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:55:01.842893 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-c82b29d6-a867-4f7f-bc65-3ed021aa50fe tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:55:01.843623 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-c82b29d6-a867-4f7f-bc65-3ed021aa50fe tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:55:01.844102 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-c82b29d6-a867-4f7f-bc65-3ed021aa50fe tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:55:01.844524 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-c82b29d6-a867-4f7f-bc65-3ed021aa50fe tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:55:01.990759 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-c82b29d6-a867-4f7f-bc65-3ed021aa50fe tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707bd577eee14892990367f396270f7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '190914cc865b4003ab4b735d937e130d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:55:01.999008 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-c82b29d6-a867-4f7f-bc65-3ed021aa50fe tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] 10.222.0.36 "GET /compute/v2.1/servers/d9999e18-9454-480d-bdce-c193d7fb40b4" status: 200 len: 1319 microversion: 2.1 time: 0.168747 Oct 15 13:55:01.999583 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 373/724] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:55:01 2022] GET /compute/v2.1/servers/d9999e18-9454-480d-bdce-c193d7fb40b4 => generated 1319 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:55:02.033038 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-dc6ed093-fc6c-4834-8747-3c35f1c3dfe0 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:55:02.033644 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-dc6ed093-fc6c-4834-8747-3c35f1c3dfe0 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] [instance: 40d67d09-379e-4c12-b36c-21edf3b23e45] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:55:02.040719 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-dc6ed093-fc6c-4834-8747-3c35f1c3dfe0 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:55:02.041215 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-dc6ed093-fc6c-4834-8747-3c35f1c3dfe0 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:55:02.041655 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-dc6ed093-fc6c-4834-8747-3c35f1c3dfe0 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:55:02.042402 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-dc6ed093-fc6c-4834-8747-3c35f1c3dfe0 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:55:02.042862 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-dc6ed093-fc6c-4834-8747-3c35f1c3dfe0 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:55:02.043286 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-dc6ed093-fc6c-4834-8747-3c35f1c3dfe0 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:55:02.180056 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-dc6ed093-fc6c-4834-8747-3c35f1c3dfe0 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583cce1547144e11978f20a3193ceba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f8b5024a194f70a9f7689ac44ab07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:55:02.188042 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-dc6ed093-fc6c-4834-8747-3c35f1c3dfe0 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] 10.222.0.36 "GET /compute/v2.1/servers/40d67d09-379e-4c12-b36c-21edf3b23e45" status: 200 len: 1679 microversion: 2.1 time: 0.158847 Oct 15 13:55:02.188763 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 352/725] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:55:02 2022] GET /compute/v2.1/servers/40d67d09-379e-4c12-b36c-21edf3b23e45 => generated 1679 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 13:55:02.951827 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [req-8456d585-f880-406b-8875-ccec9d087be9 req-76896799-8a22-4f36-b5b4-5a3b0ea28651 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9999e18-9454-480d-bdce-c193d7fb40b4", "name": "network-vif-plugged", "status": "completed", "tag": "06855a5f-f48f-4c3a-af82-e6a857966964"}]} {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 13:55:02.963238 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [req-8456d585-f880-406b-8875-ccec9d087be9 req-76896799-8a22-4f36-b5b4-5a3b0ea28651 service nova] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:55:02.963839 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [req-8456d585-f880-406b-8875-ccec9d087be9 req-76896799-8a22-4f36-b5b4-5a3b0ea28651 service nova] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:55:02.964301 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [req-8456d585-f880-406b-8875-ccec9d087be9 req-76896799-8a22-4f36-b5b4-5a3b0ea28651 service nova] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:55:02.977746 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.compute.server_external_events [req-8456d585-f880-406b-8875-ccec9d087be9 req-76896799-8a22-4f36-b5b4-5a3b0ea28651 service nova] Creating event network-vif-plugged:06855a5f-f48f-4c3a-af82-e6a857966964 for instance d9999e18-9454-480d-bdce-c193d7fb40b4 on hv-cinder-86149 Oct 15 13:55:02.984003 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [req-8456d585-f880-406b-8875-ccec9d087be9 req-76896799-8a22-4f36-b5b4-5a3b0ea28651 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126659 Oct 15 13:55:02.984706 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 374/726] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 15 13:55:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 15 13:55:03.026974 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-a9148eac-529c-437f-9e27-0f162e9b20bc tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:55:03.027698 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-a9148eac-529c-437f-9e27-0f162e9b20bc tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] [instance: d9999e18-9454-480d-bdce-c193d7fb40b4] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:55:03.034824 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-a9148eac-529c-437f-9e27-0f162e9b20bc tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:55:03.035614 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-a9148eac-529c-437f-9e27-0f162e9b20bc tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:55:03.036565 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-a9148eac-529c-437f-9e27-0f162e9b20bc tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:55:03.037379 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-a9148eac-529c-437f-9e27-0f162e9b20bc tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:55:03.037841 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-a9148eac-529c-437f-9e27-0f162e9b20bc tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:55:03.038261 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-a9148eac-529c-437f-9e27-0f162e9b20bc tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:55:03.113035 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG dbcounter [-] [125243] Writing DB stats nova_cell0:SELECT=2 {{(pid=125243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:55:03.213998 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-101d748e-3278-448a-9e5d-6584a55ff559 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:55:03.214860 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-101d748e-3278-448a-9e5d-6584a55ff559 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] [instance: 40d67d09-379e-4c12-b36c-21edf3b23e45] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:55:03.221684 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-101d748e-3278-448a-9e5d-6584a55ff559 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:55:03.222172 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-101d748e-3278-448a-9e5d-6584a55ff559 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:55:03.222606 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-101d748e-3278-448a-9e5d-6584a55ff559 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:55:03.223318 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-101d748e-3278-448a-9e5d-6584a55ff559 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:55:03.224016 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-101d748e-3278-448a-9e5d-6584a55ff559 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:55:03.224445 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-101d748e-3278-448a-9e5d-6584a55ff559 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:55:03.249280 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-a9148eac-529c-437f-9e27-0f162e9b20bc tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707bd577eee14892990367f396270f7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '190914cc865b4003ab4b735d937e130d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:55:03.259957 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-a9148eac-529c-437f-9e27-0f162e9b20bc tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] 10.222.0.36 "GET /compute/v2.1/servers/d9999e18-9454-480d-bdce-c193d7fb40b4" status: 200 len: 1319 microversion: 2.1 time: 0.240729 Oct 15 13:55:03.267778 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 353/727] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:55:03 2022] GET /compute/v2.1/servers/d9999e18-9454-480d-bdce-c193d7fb40b4 => generated 1319 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:55:03.381550 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-101d748e-3278-448a-9e5d-6584a55ff559 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583cce1547144e11978f20a3193ceba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f8b5024a194f70a9f7689ac44ab07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:55:03.390065 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-101d748e-3278-448a-9e5d-6584a55ff559 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] 10.222.0.36 "GET /compute/v2.1/servers/40d67d09-379e-4c12-b36c-21edf3b23e45" status: 200 len: 1679 microversion: 2.1 time: 0.180588 Oct 15 13:55:03.390658 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 375/728] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:55:03 2022] GET /compute/v2.1/servers/40d67d09-379e-4c12-b36c-21edf3b23e45 => generated 1679 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:55:04.284155 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-b041b504-e49a-47e1-8bdc-9d86a29ea385 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:55:04.284781 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-b041b504-e49a-47e1-8bdc-9d86a29ea385 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] [instance: d9999e18-9454-480d-bdce-c193d7fb40b4] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:55:04.286827 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG dbcounter [-] [125243] Writing DB stats nova_cell0:SELECT=8 {{(pid=125243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:55:04.293313 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-b041b504-e49a-47e1-8bdc-9d86a29ea385 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:55:04.293796 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-b041b504-e49a-47e1-8bdc-9d86a29ea385 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:55:04.294230 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-b041b504-e49a-47e1-8bdc-9d86a29ea385 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:55:04.294920 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-b041b504-e49a-47e1-8bdc-9d86a29ea385 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:55:04.295369 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-b041b504-e49a-47e1-8bdc-9d86a29ea385 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:55:04.295786 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-b041b504-e49a-47e1-8bdc-9d86a29ea385 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:55:04.414346 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-d86d6079-6be6-43c8-b434-fb83b5797451 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:55:04.414972 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-d86d6079-6be6-43c8-b434-fb83b5797451 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] [instance: 40d67d09-379e-4c12-b36c-21edf3b23e45] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:55:04.422283 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-d86d6079-6be6-43c8-b434-fb83b5797451 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:55:04.422783 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-d86d6079-6be6-43c8-b434-fb83b5797451 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:55:04.423231 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-d86d6079-6be6-43c8-b434-fb83b5797451 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:55:04.423998 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-d86d6079-6be6-43c8-b434-fb83b5797451 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:55:04.424462 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-d86d6079-6be6-43c8-b434-fb83b5797451 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:55:04.424890 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-d86d6079-6be6-43c8-b434-fb83b5797451 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:55:04.445380 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-b041b504-e49a-47e1-8bdc-9d86a29ea385 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707bd577eee14892990367f396270f7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '190914cc865b4003ab4b735d937e130d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:55:04.455768 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-b041b504-e49a-47e1-8bdc-9d86a29ea385 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] 10.222.0.36 "GET /compute/v2.1/servers/d9999e18-9454-480d-bdce-c193d7fb40b4" status: 200 len: 1319 microversion: 2.1 time: 0.175561 Oct 15 13:55:04.456548 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 354/729] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:55:04 2022] GET /compute/v2.1/servers/d9999e18-9454-480d-bdce-c193d7fb40b4 => generated 1319 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:55:04.563924 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-d86d6079-6be6-43c8-b434-fb83b5797451 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583cce1547144e11978f20a3193ceba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f8b5024a194f70a9f7689ac44ab07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:55:04.573775 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-d86d6079-6be6-43c8-b434-fb83b5797451 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] 10.222.0.36 "GET /compute/v2.1/servers/40d67d09-379e-4c12-b36c-21edf3b23e45" status: 200 len: 1656 microversion: 2.1 time: 0.163951 Oct 15 13:55:04.574372 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 376/730] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:55:04 2022] GET /compute/v2.1/servers/40d67d09-379e-4c12-b36c-21edf3b23e45 => generated 1656 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 13:55:04.599144 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-b2783571-3c99-4f82-82b8-416a911db909 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 13:55:04.605914 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-b2783571-3c99-4f82-82b8-416a911db909 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:55:04.606404 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-b2783571-3c99-4f82-82b8-416a911db909 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:55:04.606840 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-b2783571-3c99-4f82-82b8-416a911db909 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:55:04.630412 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-b2783571-3c99-4f82-82b8-416a911db909 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] [instance: 40d67d09-379e-4c12-b36c-21edf3b23e45] Going to try to start instance {{(pid=125243) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 15 13:55:04.682615 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-b2783571-3c99-4f82-82b8-416a911db909 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] 10.222.0.36 "POST /compute/v2.1/servers/40d67d09-379e-4c12-b36c-21edf3b23e45/action" status: 202 len: 0 microversion: 2.1 time: 0.088885 Oct 15 13:55:04.683228 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 355/731] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 15 13:55:04 2022] POST /compute/v2.1/servers/40d67d09-379e-4c12-b36c-21edf3b23e45/action => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 15 13:55:04.691496 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-58ed3d1b-052e-4d0c-b71a-bc5bf3f961bf tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:55:04.692202 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-58ed3d1b-052e-4d0c-b71a-bc5bf3f961bf tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] [instance: 40d67d09-379e-4c12-b36c-21edf3b23e45] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:55:04.698865 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-58ed3d1b-052e-4d0c-b71a-bc5bf3f961bf tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:55:04.699358 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-58ed3d1b-052e-4d0c-b71a-bc5bf3f961bf tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:55:04.699790 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-58ed3d1b-052e-4d0c-b71a-bc5bf3f961bf tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:55:04.700544 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-58ed3d1b-052e-4d0c-b71a-bc5bf3f961bf tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:55:04.700987 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-58ed3d1b-052e-4d0c-b71a-bc5bf3f961bf tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:55:04.701403 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-58ed3d1b-052e-4d0c-b71a-bc5bf3f961bf tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:55:04.883620 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-58ed3d1b-052e-4d0c-b71a-bc5bf3f961bf tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583cce1547144e11978f20a3193ceba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f8b5024a194f70a9f7689ac44ab07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:55:04.898475 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-58ed3d1b-052e-4d0c-b71a-bc5bf3f961bf tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] 10.222.0.36 "GET /compute/v2.1/servers/40d67d09-379e-4c12-b36c-21edf3b23e45" status: 200 len: 1665 microversion: 2.1 time: 0.210458 Oct 15 13:55:04.899525 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 377/732] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:55:04 2022] GET /compute/v2.1/servers/40d67d09-379e-4c12-b36c-21edf3b23e45 => generated 1665 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 13:55:05.482808 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-73176c81-ecc0-4977-b009-edac938dc369 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:55:05.483790 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-73176c81-ecc0-4977-b009-edac938dc369 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] [instance: d9999e18-9454-480d-bdce-c193d7fb40b4] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:55:05.492637 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-73176c81-ecc0-4977-b009-edac938dc369 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:55:05.493318 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-73176c81-ecc0-4977-b009-edac938dc369 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:55:05.493749 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-73176c81-ecc0-4977-b009-edac938dc369 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:55:05.496158 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-73176c81-ecc0-4977-b009-edac938dc369 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:55:05.496158 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-73176c81-ecc0-4977-b009-edac938dc369 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:55:05.496158 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-73176c81-ecc0-4977-b009-edac938dc369 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:55:05.717677 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-73176c81-ecc0-4977-b009-edac938dc369 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707bd577eee14892990367f396270f7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '190914cc865b4003ab4b735d937e130d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:55:05.726293 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-73176c81-ecc0-4977-b009-edac938dc369 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] 10.222.0.36 "GET /compute/v2.1/servers/d9999e18-9454-480d-bdce-c193d7fb40b4" status: 200 len: 1509 microversion: 2.1 time: 0.249458 Oct 15 13:55:05.726887 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 356/733] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:55:05 2022] GET /compute/v2.1/servers/d9999e18-9454-480d-bdce-c193d7fb40b4 => generated 1509 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:55:05.750468 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-577204a9-ef2b-4ba9-b6a8-104693f0b343 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2295895c-64e8-466d-a04d-e4609bdb6048", "device": "/dev/sdb"}} {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 13:55:05.752867 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-577204a9-ef2b-4ba9-b6a8-104693f0b343 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] [instance: d9999e18-9454-480d-bdce-c193d7fb40b4] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:55:05.759491 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-577204a9-ef2b-4ba9-b6a8-104693f0b343 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:55:05.760008 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-577204a9-ef2b-4ba9-b6a8-104693f0b343 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:55:05.760441 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-577204a9-ef2b-4ba9-b6a8-104693f0b343 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:55:05.761139 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-577204a9-ef2b-4ba9-b6a8-104693f0b343 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:55:05.761651 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-577204a9-ef2b-4ba9-b6a8-104693f0b343 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:55:05.762072 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-577204a9-ef2b-4ba9-b6a8-104693f0b343 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:55:05.924217 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-e81f371d-58f1-448b-9de0-8bb38b8de4f5 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:55:05.924874 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-e81f371d-58f1-448b-9de0-8bb38b8de4f5 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] [instance: 40d67d09-379e-4c12-b36c-21edf3b23e45] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:55:05.938056 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-e81f371d-58f1-448b-9de0-8bb38b8de4f5 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:55:05.938563 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-e81f371d-58f1-448b-9de0-8bb38b8de4f5 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:55:05.939024 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-e81f371d-58f1-448b-9de0-8bb38b8de4f5 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:55:05.939735 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-e81f371d-58f1-448b-9de0-8bb38b8de4f5 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:55:05.940221 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-e81f371d-58f1-448b-9de0-8bb38b8de4f5 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:55:05.940624 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-e81f371d-58f1-448b-9de0-8bb38b8de4f5 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:55:06.088395 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-577204a9-ef2b-4ba9-b6a8-104693f0b343 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] 10.222.0.36 "POST /compute/v2.1/servers/d9999e18-9454-480d-bdce-c193d7fb40b4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.342032 Oct 15 13:55:06.092860 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 378/734] 10.222.0.36 () {60 vars in 1323 bytes} [Sat Oct 15 13:55:05 2022] POST /compute/v2.1/servers/d9999e18-9454-480d-bdce-c193d7fb40b4/os-volume_attachments => generated 194 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 15 13:55:06.110254 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-e81f371d-58f1-448b-9de0-8bb38b8de4f5 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583cce1547144e11978f20a3193ceba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f8b5024a194f70a9f7689ac44ab07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:55:06.119327 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-e81f371d-58f1-448b-9de0-8bb38b8de4f5 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] 10.222.0.36 "GET /compute/v2.1/servers/40d67d09-379e-4c12-b36c-21edf3b23e45" status: 200 len: 1665 microversion: 2.1 time: 0.199127 Oct 15 13:55:06.119936 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 357/735] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:55:05 2022] GET /compute/v2.1/servers/40d67d09-379e-4c12-b36c-21edf3b23e45 => generated 1665 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:55:07.148624 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-9d0f7db2-dd69-4073-ab28-1cbe5c5a7d14 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:55:07.149318 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-9d0f7db2-dd69-4073-ab28-1cbe5c5a7d14 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] [instance: 40d67d09-379e-4c12-b36c-21edf3b23e45] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:55:07.161457 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-9d0f7db2-dd69-4073-ab28-1cbe5c5a7d14 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:55:07.161953 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-9d0f7db2-dd69-4073-ab28-1cbe5c5a7d14 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:55:07.162411 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-9d0f7db2-dd69-4073-ab28-1cbe5c5a7d14 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:55:07.163124 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-9d0f7db2-dd69-4073-ab28-1cbe5c5a7d14 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:55:07.163577 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-9d0f7db2-dd69-4073-ab28-1cbe5c5a7d14 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:55:07.164060 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-9d0f7db2-dd69-4073-ab28-1cbe5c5a7d14 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:55:07.303716 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-9d0f7db2-dd69-4073-ab28-1cbe5c5a7d14 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583cce1547144e11978f20a3193ceba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f8b5024a194f70a9f7689ac44ab07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:55:07.312259 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-9d0f7db2-dd69-4073-ab28-1cbe5c5a7d14 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] 10.222.0.36 "GET /compute/v2.1/servers/40d67d09-379e-4c12-b36c-21edf3b23e45" status: 200 len: 1669 microversion: 2.1 time: 0.170700 Oct 15 13:55:07.312874 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 379/736] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:55:07 2022] GET /compute/v2.1/servers/40d67d09-379e-4c12-b36c-21edf3b23e45 => generated 1669 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:55:28.741240 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-89bb72a3-981f-4149-8857-8bf838529964 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:55:28.741837 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-89bb72a3-981f-4149-8857-8bf838529964 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] [instance: d9999e18-9454-480d-bdce-c193d7fb40b4] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:55:28.745139 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG dbcounter [-] [125243] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=3 {{(pid=125243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:55:28.745798 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG dbcounter [-] [125243] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:55:28.750562 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-89bb72a3-981f-4149-8857-8bf838529964 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:55:28.754330 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-89bb72a3-981f-4149-8857-8bf838529964 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:55:28.754777 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-89bb72a3-981f-4149-8857-8bf838529964 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:55:28.755514 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-89bb72a3-981f-4149-8857-8bf838529964 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:55:28.755994 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-89bb72a3-981f-4149-8857-8bf838529964 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:55:28.756419 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-89bb72a3-981f-4149-8857-8bf838529964 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:55:28.863701 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.objects.instance [None req-89bb72a3-981f-4149-8857-8bf838529964 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Lazy-loading 'services' on Instance uuid d9999e18-9454-480d-bdce-c193d7fb40b4 {{(pid=125243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 15 13:55:28.958023 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-89bb72a3-981f-4149-8857-8bf838529964 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] 10.222.0.36 "DELETE /compute/v2.1/servers/d9999e18-9454-480d-bdce-c193d7fb40b4/os-volume_attachments/2295895c-64e8-466d-a04d-e4609bdb6048" status: 202 len: 0 microversion: 2.1 time: 0.220774 Oct 15 13:55:28.959550 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 358/737] 10.222.0.36 () {58 vars in 1416 bytes} [Sat Oct 15 13:55:28 2022] DELETE /compute/v2.1/servers/d9999e18-9454-480d-bdce-c193d7fb40b4/os-volume_attachments/2295895c-64e8-466d-a04d-e4609bdb6048 => generated 0 bytes in 223 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 15 13:55:31.168194 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-b7197627-1d4e-477e-bec5-ba4968f3b213 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:55:31.168780 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-b7197627-1d4e-477e-bec5-ba4968f3b213 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] [instance: d9999e18-9454-480d-bdce-c193d7fb40b4] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:55:31.171445 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG dbcounter [-] [125242] Writing DB stats nova_api:SELECT=39 {{(pid=125242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:55:31.172119 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG dbcounter [-] [125242] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:55:31.177862 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-b7197627-1d4e-477e-bec5-ba4968f3b213 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:55:31.178352 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-b7197627-1d4e-477e-bec5-ba4968f3b213 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:55:31.178792 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-b7197627-1d4e-477e-bec5-ba4968f3b213 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:55:31.179491 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-b7197627-1d4e-477e-bec5-ba4968f3b213 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:55:31.179951 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-b7197627-1d4e-477e-bec5-ba4968f3b213 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:55:31.180395 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-b7197627-1d4e-477e-bec5-ba4968f3b213 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:55:31.207256 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-b7197627-1d4e-477e-bec5-ba4968f3b213 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] [instance: d9999e18-9454-480d-bdce-c193d7fb40b4] Going to try to terminate instance {{(pid=125242) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 15 13:55:31.292353 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-b7197627-1d4e-477e-bec5-ba4968f3b213 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] 10.222.0.36 "DELETE /compute/v2.1/servers/d9999e18-9454-480d-bdce-c193d7fb40b4" status: 204 len: 0 microversion: 2.1 time: 0.127836 Oct 15 13:55:31.292947 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 380/738] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 15 13:55:31 2022] DELETE /compute/v2.1/servers/d9999e18-9454-480d-bdce-c193d7fb40b4 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 15 13:55:31.302719 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-1038aa47-2119-44d7-bade-bd95b46daab2 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:55:31.303476 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-1038aa47-2119-44d7-bade-bd95b46daab2 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] [instance: d9999e18-9454-480d-bdce-c193d7fb40b4] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:55:31.310268 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-1038aa47-2119-44d7-bade-bd95b46daab2 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:55:31.310753 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-1038aa47-2119-44d7-bade-bd95b46daab2 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:55:31.311184 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-1038aa47-2119-44d7-bade-bd95b46daab2 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:55:31.311862 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-1038aa47-2119-44d7-bade-bd95b46daab2 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:55:31.312331 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-1038aa47-2119-44d7-bade-bd95b46daab2 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:55:31.312752 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-1038aa47-2119-44d7-bade-bd95b46daab2 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:55:31.455031 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-1038aa47-2119-44d7-bade-bd95b46daab2 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707bd577eee14892990367f396270f7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '190914cc865b4003ab4b735d937e130d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:55:31.463124 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-1038aa47-2119-44d7-bade-bd95b46daab2 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] 10.222.0.36 "GET /compute/v2.1/servers/d9999e18-9454-480d-bdce-c193d7fb40b4" status: 200 len: 1515 microversion: 2.1 time: 0.165441 Oct 15 13:55:31.463702 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 359/739] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:55:31 2022] GET /compute/v2.1/servers/d9999e18-9454-480d-bdce-c193d7fb40b4 => generated 1515 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:55:32.491326 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-3268ea6d-e78e-42e6-ac60-6caf0da4a58a tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:55:32.492320 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-3268ea6d-e78e-42e6-ac60-6caf0da4a58a tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] [instance: d9999e18-9454-480d-bdce-c193d7fb40b4] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:55:32.499577 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-3268ea6d-e78e-42e6-ac60-6caf0da4a58a tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:55:32.500146 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-3268ea6d-e78e-42e6-ac60-6caf0da4a58a tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:55:32.500561 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-3268ea6d-e78e-42e6-ac60-6caf0da4a58a tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:55:32.501286 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-3268ea6d-e78e-42e6-ac60-6caf0da4a58a tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:55:32.501746 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-3268ea6d-e78e-42e6-ac60-6caf0da4a58a tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:55:32.502154 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-3268ea6d-e78e-42e6-ac60-6caf0da4a58a tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:55:32.648262 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-3268ea6d-e78e-42e6-ac60-6caf0da4a58a tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707bd577eee14892990367f396270f7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '190914cc865b4003ab4b735d937e130d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:55:32.656590 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-3268ea6d-e78e-42e6-ac60-6caf0da4a58a tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] 10.222.0.36 "GET /compute/v2.1/servers/d9999e18-9454-480d-bdce-c193d7fb40b4" status: 200 len: 1515 microversion: 2.1 time: 0.172050 Oct 15 13:55:32.657159 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 381/740] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:55:32 2022] GET /compute/v2.1/servers/d9999e18-9454-480d-bdce-c193d7fb40b4 => generated 1515 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 13:55:33.679749 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-17986957-afcf-4533-b6b4-c674d17e76da tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:55:33.680396 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-17986957-afcf-4533-b6b4-c674d17e76da tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] [instance: d9999e18-9454-480d-bdce-c193d7fb40b4] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:55:33.686958 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-17986957-afcf-4533-b6b4-c674d17e76da tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:55:33.687448 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-17986957-afcf-4533-b6b4-c674d17e76da tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:55:33.687920 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-17986957-afcf-4533-b6b4-c674d17e76da tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:55:33.688632 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-17986957-afcf-4533-b6b4-c674d17e76da tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:55:33.689095 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-17986957-afcf-4533-b6b4-c674d17e76da tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:55:33.689493 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-17986957-afcf-4533-b6b4-c674d17e76da tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:55:33.887350 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-17986957-afcf-4533-b6b4-c674d17e76da tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707bd577eee14892990367f396270f7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '190914cc865b4003ab4b735d937e130d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:55:33.896965 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-17986957-afcf-4533-b6b4-c674d17e76da tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] 10.222.0.36 "GET /compute/v2.1/servers/d9999e18-9454-480d-bdce-c193d7fb40b4" status: 200 len: 1515 microversion: 2.1 time: 0.221145 Oct 15 13:55:33.897557 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 360/741] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:55:33 2022] GET /compute/v2.1/servers/d9999e18-9454-480d-bdce-c193d7fb40b4 => generated 1515 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:55:34.111489 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [req-76d08ed3-7de1-47a2-86cb-9df2a13696d1 req-825eb1ca-be63-4f07-a8c2-7acd90d79292 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9999e18-9454-480d-bdce-c193d7fb40b4", "name": "network-vif-deleted", "tag": "06855a5f-f48f-4c3a-af82-e6a857966964"}]} {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 13:55:34.122287 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [req-76d08ed3-7de1-47a2-86cb-9df2a13696d1 req-825eb1ca-be63-4f07-a8c2-7acd90d79292 service nova] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:55:34.122774 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [req-76d08ed3-7de1-47a2-86cb-9df2a13696d1 req-825eb1ca-be63-4f07-a8c2-7acd90d79292 service nova] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:55:34.123561 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [req-76d08ed3-7de1-47a2-86cb-9df2a13696d1 req-825eb1ca-be63-4f07-a8c2-7acd90d79292 service nova] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:55:34.135455 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.compute.server_external_events [req-76d08ed3-7de1-47a2-86cb-9df2a13696d1 req-825eb1ca-be63-4f07-a8c2-7acd90d79292 service nova] Creating event network-vif-deleted:06855a5f-f48f-4c3a-af82-e6a857966964 for instance d9999e18-9454-480d-bdce-c193d7fb40b4 on hv-cinder-86149 Oct 15 13:55:34.140378 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [req-76d08ed3-7de1-47a2-86cb-9df2a13696d1 req-825eb1ca-be63-4f07-a8c2-7acd90d79292 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032839 Oct 15 13:55:34.140975 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 382/742] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 15 13:55:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 13:55:34.921710 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-b417ac91-1200-4071-8dbf-d665e175dbd8 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:55:34.922431 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-b417ac91-1200-4071-8dbf-d665e175dbd8 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] [instance: d9999e18-9454-480d-bdce-c193d7fb40b4] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:55:34.932077 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-b417ac91-1200-4071-8dbf-d665e175dbd8 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:55:34.932595 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-b417ac91-1200-4071-8dbf-d665e175dbd8 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:55:34.933022 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-b417ac91-1200-4071-8dbf-d665e175dbd8 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:55:34.934335 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-b417ac91-1200-4071-8dbf-d665e175dbd8 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:55:34.934335 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-b417ac91-1200-4071-8dbf-d665e175dbd8 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:55:34.934772 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-b417ac91-1200-4071-8dbf-d665e175dbd8 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:55:34.969990 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-b417ac91-1200-4071-8dbf-d665e175dbd8 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:55:34.970477 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-b417ac91-1200-4071-8dbf-d665e175dbd8 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:55:34.971048 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-b417ac91-1200-4071-8dbf-d665e175dbd8 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:55:34.971582 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.objects.instance [None req-b417ac91-1200-4071-8dbf-d665e175dbd8 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Lazy-loading 'fault' on Instance uuid d9999e18-9454-480d-bdce-c193d7fb40b4 {{(pid=125243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 15 13:55:35.015687 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-b417ac91-1200-4071-8dbf-d665e175dbd8 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707bd577eee14892990367f396270f7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '190914cc865b4003ab4b735d937e130d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:55:35.023019 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-b417ac91-1200-4071-8dbf-d665e175dbd8 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] 10.222.0.36 "GET /compute/v2.1/servers/d9999e18-9454-480d-bdce-c193d7fb40b4" status: 200 len: 1309 microversion: 2.1 time: 0.105288 Oct 15 13:55:35.023584 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 361/743] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:55:34 2022] GET /compute/v2.1/servers/d9999e18-9454-480d-bdce-c193d7fb40b4 => generated 1309 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:55:36.044222 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 15 13:55:36.044824 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Sat Oct 15 13:55:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d9999e18-9454-480d-bdce-c193d7fb40b4 (ip 10.222.0.36) !!! Oct 15 13:55:36.049262 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-e6510974-44a8-48be-b701-e14bf016aa31 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:55:36.049951 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-e6510974-44a8-48be-b701-e14bf016aa31 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] [instance: d9999e18-9454-480d-bdce-c193d7fb40b4] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:55:36.058043 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-e6510974-44a8-48be-b701-e14bf016aa31 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:55:36.058701 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-e6510974-44a8-48be-b701-e14bf016aa31 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:55:36.059142 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-e6510974-44a8-48be-b701-e14bf016aa31 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:55:36.059835 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-e6510974-44a8-48be-b701-e14bf016aa31 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:55:36.060315 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-e6510974-44a8-48be-b701-e14bf016aa31 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:55:36.060915 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-e6510974-44a8-48be-b701-e14bf016aa31 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:55:36.076182 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.wsgi [None req-e6510974-44a8-48be-b701-e14bf016aa31 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] HTTP exception thrown: Instance d9999e18-9454-480d-bdce-c193d7fb40b4 could not be found. Oct 15 13:55:36.077872 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-e6510974-44a8-48be-b701-e14bf016aa31 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Request method failure captured: Oct 15 13:55:36.077872 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: request: GET /compute/v2.1/servers/d9999e18-9454-480d-bdce-c193d7fb40b4 HTTP/1.1 Oct 15 13:55:36.077872 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Accept: application/json Oct 15 13:55:36.077872 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Accept-Encoding: identity Oct 15 13:55:36.077872 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Connection: close Oct 15 13:55:36.077872 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Content-Length: 0 Oct 15 13:55:36.077872 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Content-Type: application/json Oct 15 13:55:36.077872 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Host: 10.222.0.36 Oct 15 13:55:36.077872 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Openstack-System-Scope: None Oct 15 13:55:36.077872 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: User-Agent: python-urllib3/1.26.12 Oct 15 13:55:36.077872 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Auth-Token: gAAAAABjSrtAcNRuyJaICcZUTSLwxAs0kySI_X5nKRm6aYNoS4dR6dHXxvlq5mZjwQcqO3Z-3cXTbMyfvUh8C_lkoHtE3D4tjToHwAq643Fu6RdCv_Q9QZxO07oe3mT-ta1zSbFMEVv46ATsOjCgZ7AqQHUxb-fI2LeDEUQkCCyhNoZKvfm-214 Oct 15 13:55:36.077872 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Domain-Id: None Oct 15 13:55:36.077872 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Domain-Name: None Oct 15 13:55:36.077872 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Identity-Status: Confirmed Oct 15 13:55:36.077872 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Is-Admin-Project: True Oct 15 13:55:36.077872 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Project-Domain-Id: default Oct 15 13:55:36.077872 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Project-Domain-Name: Default Oct 15 13:55:36.077872 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Project-Id: 190914cc865b4003ab4b735d937e130d Oct 15 13:55:36.077872 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1694965695 Oct 15 13:55:36.077872 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Role: member,reader Oct 15 13:55:36.077872 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Roles: member,reader Oct 15 13:55:36.079527 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_190914cc865b4003ab4b735d937e130d", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/190914cc865b4003ab4b735d937e130d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/190914cc865b4003ab4b735d937e130d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/190914cc865b4003ab4b735d937e130d"}]}] Oct 15 13:55:36.079527 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Tenant: tempest-VolumesSnapshotTestJSON-1694965695 Oct 15 13:55:36.079527 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Tenant-Id: 190914cc865b4003ab4b735d937e130d Oct 15 13:55:36.079527 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1694965695 Oct 15 13:55:36.079527 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-User: tempest-VolumesSnapshotTestJSON-1694965695-project Oct 15 13:55:36.079527 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-User-Domain-Id: default Oct 15 13:55:36.079527 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-User-Domain-Name: Default Oct 15 13:55:36.079527 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-User-Id: 707bd577eee14892990367f396270f7b Oct 15 13:55:36.079527 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-User-Name: tempest-VolumesSnapshotTestJSON-1694965695-project Oct 15 13:55:36.079527 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: method: > Oct 15 13:55:36.079527 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: exception: Instance d9999e18-9454-480d-bdce-c193d7fb40b4 could not be found. Oct 15 13:55:36.079527 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: action_args: {'id': 'd9999e18-9454-480d-bdce-c193d7fb40b4'} Oct 15 13:55:36.080425 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 15 13:55:36.080425 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 13:55:36.080425 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 15 13:55:36.080425 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 15 13:55:36.080425 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 15 13:55:36.080425 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 15 13:55:36.080425 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 15 13:55:36.080425 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 15 13:55:36.080425 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 15 13:55:36.080425 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 15 13:55:36.080425 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d9999e18-9454-480d-bdce-c193d7fb40b4 could not be found. Oct 15 13:55:36.080425 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Oct 15 13:55:36.080425 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 13:55:36.080425 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Oct 15 13:55:36.080425 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 13:55:36.080425 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 13:55:36.080425 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 13:55:36.080425 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 15 13:55:36.080425 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 15 13:55:36.080425 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 15 13:55:36.081905 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 15 13:55:36.081905 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 15 13:55:36.081905 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 15 13:55:36.081905 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 15 13:55:36.081905 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 15 13:55:36.081905 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 15 13:55:36.081905 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 15 13:55:36.081905 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9999e18-9454-480d-bdce-c193d7fb40b4 could not be found. Oct 15 13:55:36.081905 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Oct 15 13:55:36.081905 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 13:55:36.081905 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Oct 15 13:55:36.081905 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 13:55:36.081905 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 13:55:36.081905 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 13:55:36.081905 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 15 13:55:36.081905 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 15 13:55:36.081905 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9999e18-9454-480d-bdce-c193d7fb40b4 could not be found. Oct 15 13:55:36.081905 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Oct 15 13:55:36.083130 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-e6510974-44a8-48be-b701-e14bf016aa31 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] Returning 404 to user: Instance d9999e18-9454-480d-bdce-c193d7fb40b4 could not be found. {{(pid=125242) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 15 13:55:36.083130 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-e6510974-44a8-48be-b701-e14bf016aa31 tempest-VolumesSnapshotTestJSON-1694965695 tempest-VolumesSnapshotTestJSON-1694965695-project] 10.222.0.36 "GET /compute/v2.1/servers/d9999e18-9454-480d-bdce-c193d7fb40b4" status: 404 len: 111 microversion: 2.1 time: 0.036157 Oct 15 13:55:36.083130 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 383/744] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:55:36 2022] GET /compute/v2.1/servers/d9999e18-9454-480d-bdce-c193d7fb40b4 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 15 13:55:46.358386 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-163c8346-f2c1-4c06-b4c8-e0f21ec9e5f3 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 13:55:46.360803 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-163c8346-f2c1-4c06-b4c8-e0f21ec9e5f3 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] [instance: 6490290c-19e1-49db-9190-3b945ece5145] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:55:46.363578 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG dbcounter [-] [125243] Writing DB stats nova_api:SELECT=10 {{(pid=125243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:55:46.364275 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG dbcounter [-] [125243] Writing DB stats nova_cell1:SELECT=29,nova_cell1:INSERT=1 {{(pid=125243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:55:46.370909 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-163c8346-f2c1-4c06-b4c8-e0f21ec9e5f3 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:55:46.371408 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-163c8346-f2c1-4c06-b4c8-e0f21ec9e5f3 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:55:46.371938 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-163c8346-f2c1-4c06-b4c8-e0f21ec9e5f3 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:55:46.372665 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-163c8346-f2c1-4c06-b4c8-e0f21ec9e5f3 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:55:46.373145 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-163c8346-f2c1-4c06-b4c8-e0f21ec9e5f3 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:55:46.373575 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-163c8346-f2c1-4c06-b4c8-e0f21ec9e5f3 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:55:46.462854 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-163c8346-f2c1-4c06-b4c8-e0f21ec9e5f3 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] 10.222.0.36 "POST /compute/v2.1/servers/6490290c-19e1-49db-9190-3b945ece5145/action" status: 202 len: 0 microversion: 2.1 time: 0.108654 Oct 15 13:55:46.463580 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 362/745] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 15 13:55:46 2022] POST /compute/v2.1/servers/6490290c-19e1-49db-9190-3b945ece5145/action => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 15 13:55:46.472323 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-2ce8f604-a150-4d5e-9b75-3348e8da1f8c tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:55:46.473212 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-2ce8f604-a150-4d5e-9b75-3348e8da1f8c tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] [instance: 6490290c-19e1-49db-9190-3b945ece5145] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:55:46.475592 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG dbcounter [-] [125242] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=125242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:55:46.476699 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG dbcounter [-] [125242] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:55:46.483543 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-2ce8f604-a150-4d5e-9b75-3348e8da1f8c tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:55:46.484081 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-2ce8f604-a150-4d5e-9b75-3348e8da1f8c tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:55:46.484521 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-2ce8f604-a150-4d5e-9b75-3348e8da1f8c tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:55:46.485237 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-2ce8f604-a150-4d5e-9b75-3348e8da1f8c tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:55:46.485688 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-2ce8f604-a150-4d5e-9b75-3348e8da1f8c tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:55:46.486109 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-2ce8f604-a150-4d5e-9b75-3348e8da1f8c tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:55:46.655569 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-2ce8f604-a150-4d5e-9b75-3348e8da1f8c tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83c1c8fce04c57a685de883344b7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e752c3aef55649ea98ec1a2f3607c27f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:55:46.668563 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-2ce8f604-a150-4d5e-9b75-3348e8da1f8c tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] 10.222.0.36 "GET /compute/v2.1/servers/6490290c-19e1-49db-9190-3b945ece5145" status: 200 len: 1753 microversion: 2.1 time: 0.200210 Oct 15 13:55:46.669627 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 384/746] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:55:46 2022] GET /compute/v2.1/servers/6490290c-19e1-49db-9190-3b945ece5145 => generated 1753 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:55:47.697401 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-0921d4bf-4b9e-4b73-9d92-629c3d329951 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:55:47.698082 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-0921d4bf-4b9e-4b73-9d92-629c3d329951 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] [instance: 6490290c-19e1-49db-9190-3b945ece5145] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:55:47.705133 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-0921d4bf-4b9e-4b73-9d92-629c3d329951 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:55:47.705629 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-0921d4bf-4b9e-4b73-9d92-629c3d329951 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:55:47.706066 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-0921d4bf-4b9e-4b73-9d92-629c3d329951 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:55:47.706794 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-0921d4bf-4b9e-4b73-9d92-629c3d329951 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:55:47.707231 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-0921d4bf-4b9e-4b73-9d92-629c3d329951 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:55:47.707647 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-0921d4bf-4b9e-4b73-9d92-629c3d329951 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:55:47.889518 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-0921d4bf-4b9e-4b73-9d92-629c3d329951 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83c1c8fce04c57a685de883344b7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e752c3aef55649ea98ec1a2f3607c27f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:55:47.899456 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-0921d4bf-4b9e-4b73-9d92-629c3d329951 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] 10.222.0.36 "GET /compute/v2.1/servers/6490290c-19e1-49db-9190-3b945ece5145" status: 200 len: 1753 microversion: 2.1 time: 0.206644 Oct 15 13:55:47.900225 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 363/747] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:55:47 2022] GET /compute/v2.1/servers/6490290c-19e1-49db-9190-3b945ece5145 => generated 1753 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:55:48.925999 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-567908b8-1635-4237-97f1-e6493478569d tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:55:48.926599 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-567908b8-1635-4237-97f1-e6493478569d tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] [instance: 6490290c-19e1-49db-9190-3b945ece5145] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:55:48.937479 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-567908b8-1635-4237-97f1-e6493478569d tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:55:48.938142 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-567908b8-1635-4237-97f1-e6493478569d tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:55:48.938642 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-567908b8-1635-4237-97f1-e6493478569d tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:55:48.939617 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-567908b8-1635-4237-97f1-e6493478569d tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:55:48.940154 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-567908b8-1635-4237-97f1-e6493478569d tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:55:48.940689 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-567908b8-1635-4237-97f1-e6493478569d tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:55:49.097691 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-567908b8-1635-4237-97f1-e6493478569d tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83c1c8fce04c57a685de883344b7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e752c3aef55649ea98ec1a2f3607c27f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:55:49.107079 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-567908b8-1635-4237-97f1-e6493478569d tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] 10.222.0.36 "GET /compute/v2.1/servers/6490290c-19e1-49db-9190-3b945ece5145" status: 200 len: 1753 microversion: 2.1 time: 0.186992 Oct 15 13:55:49.107656 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 385/748] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:55:48 2022] GET /compute/v2.1/servers/6490290c-19e1-49db-9190-3b945ece5145 => generated 1753 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:55:50.130733 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-1ee5f74d-63dd-4318-a8d9-15d43b0ee616 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:55:50.131559 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-1ee5f74d-63dd-4318-a8d9-15d43b0ee616 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] [instance: 6490290c-19e1-49db-9190-3b945ece5145] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:55:50.138957 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-1ee5f74d-63dd-4318-a8d9-15d43b0ee616 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:55:50.139459 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-1ee5f74d-63dd-4318-a8d9-15d43b0ee616 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:55:50.139917 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-1ee5f74d-63dd-4318-a8d9-15d43b0ee616 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:55:50.140635 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-1ee5f74d-63dd-4318-a8d9-15d43b0ee616 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:55:50.141169 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-1ee5f74d-63dd-4318-a8d9-15d43b0ee616 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:55:50.141519 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-1ee5f74d-63dd-4318-a8d9-15d43b0ee616 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:55:50.316718 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-1ee5f74d-63dd-4318-a8d9-15d43b0ee616 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83c1c8fce04c57a685de883344b7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e752c3aef55649ea98ec1a2f3607c27f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:55:50.326575 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-1ee5f74d-63dd-4318-a8d9-15d43b0ee616 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] 10.222.0.36 "GET /compute/v2.1/servers/6490290c-19e1-49db-9190-3b945ece5145" status: 200 len: 1753 microversion: 2.1 time: 0.199754 Oct 15 13:55:50.327175 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 364/749] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:55:50 2022] GET /compute/v2.1/servers/6490290c-19e1-49db-9190-3b945ece5145 => generated 1753 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:55:51.324401 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-64d73a29-5a87-4190-987f-1b9904df60ce tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:55:51.325011 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-64d73a29-5a87-4190-987f-1b9904df60ce tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 5fc359cf-ff2c-4189-b058-31eb3c97568c] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:55:51.331971 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-64d73a29-5a87-4190-987f-1b9904df60ce tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:55:51.332534 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-64d73a29-5a87-4190-987f-1b9904df60ce tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:55:51.332952 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-64d73a29-5a87-4190-987f-1b9904df60ce tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:55:51.333643 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-64d73a29-5a87-4190-987f-1b9904df60ce tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:55:51.334099 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-64d73a29-5a87-4190-987f-1b9904df60ce tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:55:51.334520 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-64d73a29-5a87-4190-987f-1b9904df60ce tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:55:51.354593 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-9e9ca2f8-f124-4f49-a7cf-fe9d0877920f tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:55:51.356282 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-9e9ca2f8-f124-4f49-a7cf-fe9d0877920f tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] [instance: 6490290c-19e1-49db-9190-3b945ece5145] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:55:51.363149 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-9e9ca2f8-f124-4f49-a7cf-fe9d0877920f tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:55:51.363679 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-9e9ca2f8-f124-4f49-a7cf-fe9d0877920f tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:55:51.364144 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-9e9ca2f8-f124-4f49-a7cf-fe9d0877920f tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:55:51.364895 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-9e9ca2f8-f124-4f49-a7cf-fe9d0877920f tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:55:51.365357 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-9e9ca2f8-f124-4f49-a7cf-fe9d0877920f tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:55:51.365775 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-9e9ca2f8-f124-4f49-a7cf-fe9d0877920f tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:55:51.375387 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-64d73a29-5a87-4190-987f-1b9904df60ce tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c/os-volume_attachments/466e41c7-9eb5-4c51-92bf-2cfacefaa5dd" status: 200 len: 194 microversion: 2.20 time: 0.055331 Oct 15 13:55:51.378663 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 386/750] 10.222.0.36 () {60 vars in 1454 bytes} [Sat Oct 15 13:55:51 2022] GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c/os-volume_attachments/466e41c7-9eb5-4c51-92bf-2cfacefaa5dd => generated 194 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 13:55:51.458851 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-5772780f-0312-41c7-9446-b25fc29c0bf5 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:55:51.459358 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-5772780f-0312-41c7-9446-b25fc29c0bf5 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 5fc359cf-ff2c-4189-b058-31eb3c97568c] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:55:51.466485 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-5772780f-0312-41c7-9446-b25fc29c0bf5 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:55:51.466986 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-5772780f-0312-41c7-9446-b25fc29c0bf5 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:55:51.467431 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-5772780f-0312-41c7-9446-b25fc29c0bf5 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:55:51.468187 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-5772780f-0312-41c7-9446-b25fc29c0bf5 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:55:51.468648 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-5772780f-0312-41c7-9446-b25fc29c0bf5 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:55:51.469241 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-5772780f-0312-41c7-9446-b25fc29c0bf5 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:55:51.534763 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-9e9ca2f8-f124-4f49-a7cf-fe9d0877920f tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83c1c8fce04c57a685de883344b7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e752c3aef55649ea98ec1a2f3607c27f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:55:51.543635 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-9e9ca2f8-f124-4f49-a7cf-fe9d0877920f tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] 10.222.0.36 "GET /compute/v2.1/servers/6490290c-19e1-49db-9190-3b945ece5145" status: 200 len: 1758 microversion: 2.1 time: 0.193232 Oct 15 13:55:51.544274 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 365/751] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:55:51 2022] GET /compute/v2.1/servers/6490290c-19e1-49db-9190-3b945ece5145 => generated 1758 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:55:51.565786 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.objects.instance [None req-5772780f-0312-41c7-9446-b25fc29c0bf5 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lazy-loading 'services' on Instance uuid 5fc359cf-ff2c-4189-b058-31eb3c97568c {{(pid=125242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 15 13:55:51.645823 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-5772780f-0312-41c7-9446-b25fc29c0bf5 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "DELETE /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c/os-volume_attachments/466e41c7-9eb5-4c51-92bf-2cfacefaa5dd" status: 202 len: 0 microversion: 2.20 time: 0.190759 Oct 15 13:55:51.646471 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 387/752] 10.222.0.36 () {60 vars in 1457 bytes} [Sat Oct 15 13:55:51 2022] DELETE /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c/os-volume_attachments/466e41c7-9eb5-4c51-92bf-2cfacefaa5dd => generated 0 bytes in 192 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 15 13:55:51.656436 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-a4e3062a-e1aa-4750-88b9-82077f2eb805 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:55:51.658718 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-a4e3062a-e1aa-4750-88b9-82077f2eb805 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 5fc359cf-ff2c-4189-b058-31eb3c97568c] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:55:51.665666 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-a4e3062a-e1aa-4750-88b9-82077f2eb805 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:55:51.666324 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-a4e3062a-e1aa-4750-88b9-82077f2eb805 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:55:51.666762 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-a4e3062a-e1aa-4750-88b9-82077f2eb805 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:55:51.667480 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-a4e3062a-e1aa-4750-88b9-82077f2eb805 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:55:51.667959 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-a4e3062a-e1aa-4750-88b9-82077f2eb805 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:55:51.668389 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-a4e3062a-e1aa-4750-88b9-82077f2eb805 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:55:51.704042 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-a4e3062a-e1aa-4750-88b9-82077f2eb805 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051954 Oct 15 13:55:51.704619 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 366/753] 10.222.0.36 () {60 vars in 1343 bytes} [Sat Oct 15 13:55:51 2022] GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 13:55:52.569945 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-95753938-c46c-4e51-9e03-955d68c21024 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:55:52.570735 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-95753938-c46c-4e51-9e03-955d68c21024 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] [instance: 6490290c-19e1-49db-9190-3b945ece5145] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:55:52.577325 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-95753938-c46c-4e51-9e03-955d68c21024 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:55:52.577827 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-95753938-c46c-4e51-9e03-955d68c21024 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:55:52.578263 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-95753938-c46c-4e51-9e03-955d68c21024 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:55:52.579290 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-95753938-c46c-4e51-9e03-955d68c21024 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:55:52.579601 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-95753938-c46c-4e51-9e03-955d68c21024 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:55:52.580070 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-95753938-c46c-4e51-9e03-955d68c21024 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:55:52.720896 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-ceabf71b-2efd-46af-bc3b-9ebbcfe24e3e tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:55:52.724540 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-ceabf71b-2efd-46af-bc3b-9ebbcfe24e3e tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 5fc359cf-ff2c-4189-b058-31eb3c97568c] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:55:52.732927 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-ceabf71b-2efd-46af-bc3b-9ebbcfe24e3e tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:55:52.733413 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-ceabf71b-2efd-46af-bc3b-9ebbcfe24e3e tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:55:52.733847 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-ceabf71b-2efd-46af-bc3b-9ebbcfe24e3e tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:55:52.734555 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-ceabf71b-2efd-46af-bc3b-9ebbcfe24e3e tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:55:52.734996 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-ceabf71b-2efd-46af-bc3b-9ebbcfe24e3e tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:55:52.735464 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-ceabf71b-2efd-46af-bc3b-9ebbcfe24e3e tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:55:52.769240 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-ceabf71b-2efd-46af-bc3b-9ebbcfe24e3e tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.054052 Oct 15 13:55:52.769835 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 367/754] 10.222.0.36 () {60 vars in 1343 bytes} [Sat Oct 15 13:55:52 2022] GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 13:55:52.845443 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-d71ba631-0838-4d2e-92f9-0c6c657b98f5 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:55:52.846080 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-d71ba631-0838-4d2e-92f9-0c6c657b98f5 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 5fc359cf-ff2c-4189-b058-31eb3c97568c] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:55:52.858011 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-d71ba631-0838-4d2e-92f9-0c6c657b98f5 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:55:52.858889 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-d71ba631-0838-4d2e-92f9-0c6c657b98f5 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:55:52.859554 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-d71ba631-0838-4d2e-92f9-0c6c657b98f5 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:55:52.860359 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-d71ba631-0838-4d2e-92f9-0c6c657b98f5 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:55:52.860852 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-d71ba631-0838-4d2e-92f9-0c6c657b98f5 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:55:52.861319 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-d71ba631-0838-4d2e-92f9-0c6c657b98f5 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:55:52.881887 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-95753938-c46c-4e51-9e03-955d68c21024 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83c1c8fce04c57a685de883344b7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e752c3aef55649ea98ec1a2f3607c27f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:55:52.892223 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-95753938-c46c-4e51-9e03-955d68c21024 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] 10.222.0.36 "GET /compute/v2.1/servers/6490290c-19e1-49db-9190-3b945ece5145" status: 200 len: 1758 microversion: 2.1 time: 0.327067 Oct 15 13:55:52.893076 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 388/755] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:55:52 2022] GET /compute/v2.1/servers/6490290c-19e1-49db-9190-3b945ece5145 => generated 1758 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:55:52.894365 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-d71ba631-0838-4d2e-92f9-0c6c657b98f5 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 5fc359cf-ff2c-4189-b058-31eb3c97568c] Going to try to terminate instance {{(pid=125243) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 15 13:55:52.981935 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-d71ba631-0838-4d2e-92f9-0c6c657b98f5 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "DELETE /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c" status: 204 len: 0 microversion: 2.20 time: 0.140793 Oct 15 13:55:52.986212 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 368/756] 10.222.0.36 () {60 vars in 1280 bytes} [Sat Oct 15 13:55:52 2022] DELETE /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 15 13:55:52.996300 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-72c2f546-1e7f-4f8f-9eca-d69fa9391830 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:55:52.997398 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-72c2f546-1e7f-4f8f-9eca-d69fa9391830 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 5fc359cf-ff2c-4189-b058-31eb3c97568c] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:55:53.007343 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-72c2f546-1e7f-4f8f-9eca-d69fa9391830 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:55:53.008331 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-72c2f546-1e7f-4f8f-9eca-d69fa9391830 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:55:53.009130 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-72c2f546-1e7f-4f8f-9eca-d69fa9391830 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:55:53.010457 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-72c2f546-1e7f-4f8f-9eca-d69fa9391830 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:55:53.011767 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-72c2f546-1e7f-4f8f-9eca-d69fa9391830 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:55:53.012428 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-72c2f546-1e7f-4f8f-9eca-d69fa9391830 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:55:53.173953 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-72c2f546-1e7f-4f8f-9eca-d69fa9391830 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:55:53.183335 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-72c2f546-1e7f-4f8f-9eca-d69fa9391830 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:55:53.184843 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-72c2f546-1e7f-4f8f-9eca-d69fa9391830 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:55:53.186051 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-72c2f546-1e7f-4f8f-9eca-d69fa9391830 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c" status: 200 len: 1723 microversion: 2.20 time: 0.197070 Oct 15 13:55:53.186641 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 389/757] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:55:52 2022] GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c => generated 1723 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 13:55:53.917005 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-e2d8d996-5149-4b66-9c2a-fb6e6b5fba20 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:55:53.917810 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-e2d8d996-5149-4b66-9c2a-fb6e6b5fba20 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] [instance: 6490290c-19e1-49db-9190-3b945ece5145] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:55:53.931643 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-e2d8d996-5149-4b66-9c2a-fb6e6b5fba20 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:55:53.931643 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-e2d8d996-5149-4b66-9c2a-fb6e6b5fba20 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:55:53.931643 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-e2d8d996-5149-4b66-9c2a-fb6e6b5fba20 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:55:53.931643 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-e2d8d996-5149-4b66-9c2a-fb6e6b5fba20 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:55:53.932176 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-e2d8d996-5149-4b66-9c2a-fb6e6b5fba20 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:55:53.932176 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-e2d8d996-5149-4b66-9c2a-fb6e6b5fba20 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:55:54.092260 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-e2d8d996-5149-4b66-9c2a-fb6e6b5fba20 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83c1c8fce04c57a685de883344b7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e752c3aef55649ea98ec1a2f3607c27f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:55:54.101013 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-e2d8d996-5149-4b66-9c2a-fb6e6b5fba20 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] 10.222.0.36 "GET /compute/v2.1/servers/6490290c-19e1-49db-9190-3b945ece5145" status: 200 len: 1758 microversion: 2.1 time: 0.188385 Oct 15 13:55:54.101594 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 369/758] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:55:53 2022] GET /compute/v2.1/servers/6490290c-19e1-49db-9190-3b945ece5145 => generated 1758 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:55:54.214867 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-6c94ac4b-a13e-40ad-b1e3-10a07ec506e1 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:55:54.215564 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-6c94ac4b-a13e-40ad-b1e3-10a07ec506e1 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 5fc359cf-ff2c-4189-b058-31eb3c97568c] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:55:54.224557 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-6c94ac4b-a13e-40ad-b1e3-10a07ec506e1 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:55:54.225054 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-6c94ac4b-a13e-40ad-b1e3-10a07ec506e1 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:55:54.225547 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-6c94ac4b-a13e-40ad-b1e3-10a07ec506e1 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:55:54.226896 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-6c94ac4b-a13e-40ad-b1e3-10a07ec506e1 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:55:54.226896 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-6c94ac4b-a13e-40ad-b1e3-10a07ec506e1 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:55:54.227321 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-6c94ac4b-a13e-40ad-b1e3-10a07ec506e1 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:55:54.367001 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-6c94ac4b-a13e-40ad-b1e3-10a07ec506e1 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:55:54.379295 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-6c94ac4b-a13e-40ad-b1e3-10a07ec506e1 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:55:54.382129 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-6c94ac4b-a13e-40ad-b1e3-10a07ec506e1 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:55:54.384375 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-6c94ac4b-a13e-40ad-b1e3-10a07ec506e1 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c" status: 200 len: 1723 microversion: 2.20 time: 0.175216 Oct 15 13:55:54.385372 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 390/759] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:55:54 2022] GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c => generated 1723 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 13:55:55.130304 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-b2458761-4e1f-4727-8546-d097ff94f371 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:55:55.132718 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-b2458761-4e1f-4727-8546-d097ff94f371 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] [instance: 6490290c-19e1-49db-9190-3b945ece5145] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:55:55.145159 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-b2458761-4e1f-4727-8546-d097ff94f371 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:55:55.146055 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-b2458761-4e1f-4727-8546-d097ff94f371 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:55:55.146793 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-b2458761-4e1f-4727-8546-d097ff94f371 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:55:55.147849 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-b2458761-4e1f-4727-8546-d097ff94f371 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:55:55.148410 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-b2458761-4e1f-4727-8546-d097ff94f371 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:55:55.148894 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-b2458761-4e1f-4727-8546-d097ff94f371 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:55:55.414021 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-b2458761-4e1f-4727-8546-d097ff94f371 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83c1c8fce04c57a685de883344b7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e752c3aef55649ea98ec1a2f3607c27f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:55:55.423410 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-b2458761-4e1f-4727-8546-d097ff94f371 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] 10.222.0.36 "GET /compute/v2.1/servers/6490290c-19e1-49db-9190-3b945ece5145" status: 200 len: 1758 microversion: 2.1 time: 0.301201 Oct 15 13:55:55.424349 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 370/760] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:55:55 2022] GET /compute/v2.1/servers/6490290c-19e1-49db-9190-3b945ece5145 => generated 1758 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:55:55.431546 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-59a9419f-37f4-47a7-affa-7921db68e50a tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:55:55.432401 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-59a9419f-37f4-47a7-affa-7921db68e50a tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 5fc359cf-ff2c-4189-b058-31eb3c97568c] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:55:55.439747 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-59a9419f-37f4-47a7-affa-7921db68e50a tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:55:55.440265 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-59a9419f-37f4-47a7-affa-7921db68e50a tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:55:55.440701 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-59a9419f-37f4-47a7-affa-7921db68e50a tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:55:55.441423 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-59a9419f-37f4-47a7-affa-7921db68e50a tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:55:55.441875 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-59a9419f-37f4-47a7-affa-7921db68e50a tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:55:55.442292 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-59a9419f-37f4-47a7-affa-7921db68e50a tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:55:55.953067 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-59a9419f-37f4-47a7-affa-7921db68e50a tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:55:55.962764 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-59a9419f-37f4-47a7-affa-7921db68e50a tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:55:55.964352 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-59a9419f-37f4-47a7-affa-7921db68e50a tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:55:55.965591 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-59a9419f-37f4-47a7-affa-7921db68e50a tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c" status: 200 len: 1723 microversion: 2.20 time: 0.544367 Oct 15 13:55:55.966174 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 391/761] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:55:55 2022] GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c => generated 1723 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 15 13:55:56.447962 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-801ec3b1-2dab-4d40-bc32-4d68a137566f tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:55:56.448962 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-801ec3b1-2dab-4d40-bc32-4d68a137566f tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] [instance: 6490290c-19e1-49db-9190-3b945ece5145] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:55:56.456314 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-801ec3b1-2dab-4d40-bc32-4d68a137566f tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:55:56.456820 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-801ec3b1-2dab-4d40-bc32-4d68a137566f tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:55:56.457256 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-801ec3b1-2dab-4d40-bc32-4d68a137566f tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:55:56.457962 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-801ec3b1-2dab-4d40-bc32-4d68a137566f tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:55:56.458442 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-801ec3b1-2dab-4d40-bc32-4d68a137566f tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:55:56.459122 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-801ec3b1-2dab-4d40-bc32-4d68a137566f tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:55:56.605610 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [req-a242e959-5926-47ba-a5cb-d498b173d476 req-365fe7e1-5ac6-41a0-b6e6-4a9bc3808744 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5fc359cf-ff2c-4189-b058-31eb3c97568c", "name": "network-vif-deleted", "tag": "5a131939-5800-4807-b2cc-42f66041598f"}]} {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 13:55:56.623484 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [req-a242e959-5926-47ba-a5cb-d498b173d476 req-365fe7e1-5ac6-41a0-b6e6-4a9bc3808744 service nova] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:55:56.624628 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [req-a242e959-5926-47ba-a5cb-d498b173d476 req-365fe7e1-5ac6-41a0-b6e6-4a9bc3808744 service nova] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:55:56.625324 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [req-a242e959-5926-47ba-a5cb-d498b173d476 req-365fe7e1-5ac6-41a0-b6e6-4a9bc3808744 service nova] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:55:56.657718 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.compute.server_external_events [req-a242e959-5926-47ba-a5cb-d498b173d476 req-365fe7e1-5ac6-41a0-b6e6-4a9bc3808744 service nova] Creating event network-vif-deleted:5a131939-5800-4807-b2cc-42f66041598f for instance 5fc359cf-ff2c-4189-b058-31eb3c97568c on hv-cinder-86149 Oct 15 13:55:56.665166 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [req-a242e959-5926-47ba-a5cb-d498b173d476 req-365fe7e1-5ac6-41a0-b6e6-4a9bc3808744 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068666 Oct 15 13:55:56.666588 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 392/762] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 15 13:55:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 13:55:56.705931 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-801ec3b1-2dab-4d40-bc32-4d68a137566f tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83c1c8fce04c57a685de883344b7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e752c3aef55649ea98ec1a2f3607c27f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:55:56.715991 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-801ec3b1-2dab-4d40-bc32-4d68a137566f tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] 10.222.0.36 "GET /compute/v2.1/servers/6490290c-19e1-49db-9190-3b945ece5145" status: 200 len: 1758 microversion: 2.1 time: 0.271955 Oct 15 13:55:56.717355 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 371/763] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:55:56 2022] GET /compute/v2.1/servers/6490290c-19e1-49db-9190-3b945ece5145 => generated 1758 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:55:57.007635 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-d44c327a-5692-4d50-9dec-50fe4decd7a3 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:55:57.008949 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-d44c327a-5692-4d50-9dec-50fe4decd7a3 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 5fc359cf-ff2c-4189-b058-31eb3c97568c] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:55:57.021676 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-d44c327a-5692-4d50-9dec-50fe4decd7a3 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:55:57.022547 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-d44c327a-5692-4d50-9dec-50fe4decd7a3 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:55:57.023320 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-d44c327a-5692-4d50-9dec-50fe4decd7a3 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:55:57.024418 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-d44c327a-5692-4d50-9dec-50fe4decd7a3 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:55:57.025359 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-d44c327a-5692-4d50-9dec-50fe4decd7a3 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:55:57.026138 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-d44c327a-5692-4d50-9dec-50fe4decd7a3 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:55:57.065072 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-d44c327a-5692-4d50-9dec-50fe4decd7a3 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:55:57.065926 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-d44c327a-5692-4d50-9dec-50fe4decd7a3 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:55:57.066380 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-d44c327a-5692-4d50-9dec-50fe4decd7a3 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:55:57.066840 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.objects.instance [None req-d44c327a-5692-4d50-9dec-50fe4decd7a3 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lazy-loading 'fault' on Instance uuid 5fc359cf-ff2c-4189-b058-31eb3c97568c {{(pid=125242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 15 13:55:57.115222 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-d44c327a-5692-4d50-9dec-50fe4decd7a3 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:55:57.124088 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-d44c327a-5692-4d50-9dec-50fe4decd7a3 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:55:57.125836 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-d44c327a-5692-4d50-9dec-50fe4decd7a3 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:55:57.127017 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-d44c327a-5692-4d50-9dec-50fe4decd7a3 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c" status: 200 len: 1370 microversion: 2.20 time: 0.127908 Oct 15 13:55:57.127575 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 393/764] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:55:56 2022] GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c => generated 1370 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 13:55:57.744698 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-7b0f92b8-fc9a-41fe-a034-efa52cfc7a4e tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:55:57.745673 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-7b0f92b8-fc9a-41fe-a034-efa52cfc7a4e tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] [instance: 6490290c-19e1-49db-9190-3b945ece5145] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:55:57.756384 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-7b0f92b8-fc9a-41fe-a034-efa52cfc7a4e tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:55:57.756875 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-7b0f92b8-fc9a-41fe-a034-efa52cfc7a4e tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:55:57.757311 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-7b0f92b8-fc9a-41fe-a034-efa52cfc7a4e tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:55:57.758016 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-7b0f92b8-fc9a-41fe-a034-efa52cfc7a4e tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:55:57.758461 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-7b0f92b8-fc9a-41fe-a034-efa52cfc7a4e tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:55:57.758912 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-7b0f92b8-fc9a-41fe-a034-efa52cfc7a4e tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:55:57.921166 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-7b0f92b8-fc9a-41fe-a034-efa52cfc7a4e tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83c1c8fce04c57a685de883344b7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e752c3aef55649ea98ec1a2f3607c27f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:55:57.929624 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-7b0f92b8-fc9a-41fe-a034-efa52cfc7a4e tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] 10.222.0.36 "GET /compute/v2.1/servers/6490290c-19e1-49db-9190-3b945ece5145" status: 200 len: 1758 microversion: 2.1 time: 0.192901 Oct 15 13:55:57.930225 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 372/765] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:55:57 2022] GET /compute/v2.1/servers/6490290c-19e1-49db-9190-3b945ece5145 => generated 1758 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:55:58.154267 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-ec8e8101-a754-49bf-8995-471613c4dcb6 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:55:58.154886 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-ec8e8101-a754-49bf-8995-471613c4dcb6 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 5fc359cf-ff2c-4189-b058-31eb3c97568c] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:55:58.163932 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-ec8e8101-a754-49bf-8995-471613c4dcb6 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:55:58.164667 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-ec8e8101-a754-49bf-8995-471613c4dcb6 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:55:58.165110 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-ec8e8101-a754-49bf-8995-471613c4dcb6 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:55:58.165830 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-ec8e8101-a754-49bf-8995-471613c4dcb6 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:55:58.166292 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-ec8e8101-a754-49bf-8995-471613c4dcb6 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:55:58.166757 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-ec8e8101-a754-49bf-8995-471613c4dcb6 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:55:58.183178 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.wsgi [None req-ec8e8101-a754-49bf-8995-471613c4dcb6 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] HTTP exception thrown: Instance 5fc359cf-ff2c-4189-b058-31eb3c97568c could not be found. Oct 15 13:55:58.185711 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-ec8e8101-a754-49bf-8995-471613c4dcb6 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Request method failure captured: Oct 15 13:55:58.185711 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: request: GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c HTTP/1.1 Oct 15 13:55:58.185711 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Accept: application/json Oct 15 13:55:58.185711 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Accept-Encoding: identity Oct 15 13:55:58.185711 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Connection: close Oct 15 13:55:58.185711 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Content-Length: 0 Oct 15 13:55:58.185711 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Content-Type: application/json Oct 15 13:55:58.185711 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Host: 10.222.0.36 Oct 15 13:55:58.185711 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Openstack-System-Scope: None Oct 15 13:55:58.185711 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: User-Agent: python-urllib3/1.26.12 Oct 15 13:55:58.185711 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Auth-Token: gAAAAABjSrpKuKb3IqHLdZJ6pMSEoA5wd3Ry1Iv3xTxY-nJ-qM_4H41e6Ag5Y_41ZxyWKZPJHiMXN4UTAXdOMVnxdod4Wr_wYL9b_buf36HM_-Yh_8XW59l6M4LUV0zyUdmJ3lSGAqN0sBtqIM4joATYkHuuvSeWK0imRkzVD_m_9znabaYKBY8 Oct 15 13:55:58.185711 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Domain-Id: None Oct 15 13:55:58.185711 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Domain-Name: None Oct 15 13:55:58.185711 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Identity-Status: Confirmed Oct 15 13:55:58.185711 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Is-Admin-Project: True Oct 15 13:55:58.185711 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Openstack-Nova-Api-Version: 2.20 Oct 15 13:55:58.185711 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Project-Domain-Id: default Oct 15 13:55:58.185711 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Project-Domain-Name: Default Oct 15 13:55:58.185711 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Project-Id: aabf1193b43040948317be442c5c16f7 Oct 15 13:55:58.185711 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-204887899 Oct 15 13:55:58.185711 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Role: member,reader Oct 15 13:55:58.185711 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Roles: member,reader Oct 15 13:55:58.187515 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_aabf1193b43040948317be442c5c16f7", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/aabf1193b43040948317be442c5c16f7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/aabf1193b43040948317be442c5c16f7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/aabf1193b43040948317be442c5c16f7"}]}] Oct 15 13:55:58.187515 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Tenant: tempest-AttachVolumeShelveTestJSON-204887899 Oct 15 13:55:58.187515 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Tenant-Id: aabf1193b43040948317be442c5c16f7 Oct 15 13:55:58.187515 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-204887899 Oct 15 13:55:58.187515 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-User: tempest-AttachVolumeShelveTestJSON-204887899-project Oct 15 13:55:58.187515 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-User-Domain-Id: default Oct 15 13:55:58.187515 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-User-Domain-Name: Default Oct 15 13:55:58.187515 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-User-Id: 0b01e277944d4edcb8625ebf4544e340 Oct 15 13:55:58.187515 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-User-Name: tempest-AttachVolumeShelveTestJSON-204887899-project Oct 15 13:55:58.187515 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: method: > Oct 15 13:55:58.187515 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: exception: Instance 5fc359cf-ff2c-4189-b058-31eb3c97568c could not be found. Oct 15 13:55:58.187515 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: action_args: {'id': '5fc359cf-ff2c-4189-b058-31eb3c97568c'} Oct 15 13:55:58.188368 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 15 13:55:58.188368 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 13:55:58.188368 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 15 13:55:58.188368 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 15 13:55:58.188368 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 15 13:55:58.188368 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 15 13:55:58.188368 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 15 13:55:58.188368 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 15 13:55:58.188368 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 15 13:55:58.188368 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 15 13:55:58.188368 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5fc359cf-ff2c-4189-b058-31eb3c97568c could not be found. Oct 15 13:55:58.188368 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Oct 15 13:55:58.188368 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 13:55:58.188368 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Oct 15 13:55:58.188368 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 13:55:58.188368 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 13:55:58.188368 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 13:55:58.188368 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 15 13:55:58.188368 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 15 13:55:58.188368 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 15 13:55:58.189679 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 15 13:55:58.189679 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 15 13:55:58.189679 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 15 13:55:58.189679 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 15 13:55:58.189679 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 15 13:55:58.189679 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 15 13:55:58.189679 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 15 13:55:58.189679 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5fc359cf-ff2c-4189-b058-31eb3c97568c could not be found. Oct 15 13:55:58.189679 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Oct 15 13:55:58.189679 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 13:55:58.189679 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Oct 15 13:55:58.189679 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 13:55:58.189679 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 13:55:58.189679 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 13:55:58.189679 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 15 13:55:58.189679 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 15 13:55:58.189679 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5fc359cf-ff2c-4189-b058-31eb3c97568c could not be found. Oct 15 13:55:58.189679 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Oct 15 13:55:58.190994 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-ec8e8101-a754-49bf-8995-471613c4dcb6 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Returning 404 to user: Instance 5fc359cf-ff2c-4189-b058-31eb3c97568c could not be found. {{(pid=125242) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 15 13:55:58.190994 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-ec8e8101-a754-49bf-8995-471613c4dcb6 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c" status: 404 len: 111 microversion: 2.20 time: 0.038055 Oct 15 13:55:58.190994 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 394/766] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:55:58 2022] GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 15 13:55:58.198151 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-2766ab10-57bb-4611-bd9a-c067c0911fdb tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '.version_select at 0x7f1b5e321280>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:55:58.221011 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-2766ab10-57bb-4611-bd9a-c067c0911fdb tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-492973963" status: 204 len: 0 microversion: 2.20 time: 0.028168 Oct 15 13:55:58.221698 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 373/767] 10.222.0.36 () {60 vars in 1259 bytes} [Sat Oct 15 13:55:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-492973963 => generated 0 bytes in 30 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 15 13:55:58.952901 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-3c07e105-ce6a-49b6-b3ee-c4372e8f0e68 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:55:58.953513 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-3c07e105-ce6a-49b6-b3ee-c4372e8f0e68 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] [instance: 6490290c-19e1-49db-9190-3b945ece5145] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:55:58.960156 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-3c07e105-ce6a-49b6-b3ee-c4372e8f0e68 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:55:58.960649 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-3c07e105-ce6a-49b6-b3ee-c4372e8f0e68 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:55:58.961088 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-3c07e105-ce6a-49b6-b3ee-c4372e8f0e68 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:55:58.961788 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-3c07e105-ce6a-49b6-b3ee-c4372e8f0e68 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:55:58.962242 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-3c07e105-ce6a-49b6-b3ee-c4372e8f0e68 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:55:58.962670 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-3c07e105-ce6a-49b6-b3ee-c4372e8f0e68 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:55:58.975571 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-f5e3f1ee-7672-4071-ab70-1db90ef85b1f tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Action: 'create', calling method: .version_select at 0x7f1b5e2371f0>, body: {"keypair": {"name": "tempest-keypair-1216004390", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPfraKWFkVPYloUraaHzzkPc9w675G+bZIVso0cjs63B1+jKDTkp7/us0JMfc2L1QP5dP8wzAGj6cTUT/3U6Jx3jVaE8ZnYgTqcFydl/DjyP/ubQd535tVGsfqf8yVAueg=="}} {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 13:55:58.993144 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.quota [None req-f5e3f1ee-7672-4071-ab70-1db90ef85b1f tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Getting quotas for project aabf1193b43040948317be442c5c16f7. Resources: {'key_pairs'} {{(pid=125243) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 15 13:55:58.997126 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.quota [None req-f5e3f1ee-7672-4071-ab70-1db90ef85b1f tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Getting quotas for user 0b01e277944d4edcb8625ebf4544e340 and project aabf1193b43040948317be442c5c16f7. Resources: {'key_pairs'} {{(pid=125243) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 15 13:55:59.023283 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-f5e3f1ee-7672-4071-ab70-1db90ef85b1f tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.051614 Oct 15 13:55:59.024200 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 374/768] 10.222.0.36 () {62 vars in 1200 bytes} [Sat Oct 15 13:55:58 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 53 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Oct 15 13:55:59.123956 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-3c07e105-ce6a-49b6-b3ee-c4372e8f0e68 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83c1c8fce04c57a685de883344b7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e752c3aef55649ea98ec1a2f3607c27f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:55:59.133004 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-3c07e105-ce6a-49b6-b3ee-c4372e8f0e68 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] 10.222.0.36 "GET /compute/v2.1/servers/6490290c-19e1-49db-9190-3b945ece5145" status: 200 len: 1758 microversion: 2.1 time: 0.183985 Oct 15 13:55:59.133586 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 395/769] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:55:58 2022] GET /compute/v2.1/servers/6490290c-19e1-49db-9190-3b945ece5145 => generated 1758 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:56:00.164951 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-41843132-a40a-4bb9-9cd4-7a904305fccd tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:56:00.165867 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-41843132-a40a-4bb9-9cd4-7a904305fccd tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] [instance: 6490290c-19e1-49db-9190-3b945ece5145] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:56:00.173393 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-41843132-a40a-4bb9-9cd4-7a904305fccd tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:56:00.173812 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-41843132-a40a-4bb9-9cd4-7a904305fccd tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:56:00.174245 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-41843132-a40a-4bb9-9cd4-7a904305fccd tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:56:00.174944 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-41843132-a40a-4bb9-9cd4-7a904305fccd tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:56:00.175398 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-41843132-a40a-4bb9-9cd4-7a904305fccd tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:56:00.175825 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-41843132-a40a-4bb9-9cd4-7a904305fccd tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:56:00.340841 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-41843132-a40a-4bb9-9cd4-7a904305fccd tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83c1c8fce04c57a685de883344b7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e752c3aef55649ea98ec1a2f3607c27f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:56:00.349640 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-41843132-a40a-4bb9-9cd4-7a904305fccd tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] 10.222.0.36 "GET /compute/v2.1/servers/6490290c-19e1-49db-9190-3b945ece5145" status: 200 len: 1758 microversion: 2.1 time: 0.194432 Oct 15 13:56:00.350217 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 375/770] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:56:00 2022] GET /compute/v2.1/servers/6490290c-19e1-49db-9190-3b945ece5145 => generated 1758 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:56:00.368298 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-f6b86972-77cc-4af2-9385-cc8aec23f8be tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-2140097744", "imageRef": "26e64909-1cae-49ca-af5e-adea40c062d7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2be587d7-2a5c-4c32-9783-ff3a198697e5"}], "security_groups": [{"name": "tempest-securitygroup--1747956609"}], "key_name": "tempest-keypair-1216004390", "user_data": "}} {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 13:56:00.478243 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.network.neutron [None req-f6b86972-77cc-4af2-9385-cc8aec23f8be tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] validate_networks() for [('2be587d7-2a5c-4c32-9783-ff3a198697e5', None, None, None, None, None)] {{(pid=125242) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 15 13:56:00.926475 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.virt.hardware [None req-f6b86972-77cc-4af2-9385-cc8aec23f8be tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Flavor limits 0:0:0 {{(pid=125242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 15 13:56:00.927141 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.virt.hardware [None req-f6b86972-77cc-4af2-9385-cc8aec23f8be tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Image limits 0:0:0 {{(pid=125242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 15 13:56:00.927798 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.virt.hardware [None req-f6b86972-77cc-4af2-9385-cc8aec23f8be tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Flavor pref 0:0:0 {{(pid=125242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 15 13:56:00.928459 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.virt.hardware [None req-f6b86972-77cc-4af2-9385-cc8aec23f8be tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Image pref 0:0:0 {{(pid=125242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 15 13:56:00.929065 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.virt.hardware [None req-f6b86972-77cc-4af2-9385-cc8aec23f8be tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 15 13:56:00.942587 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-f6b86972-77cc-4af2-9385-cc8aec23f8be tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:56:00.943368 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-f6b86972-77cc-4af2-9385-cc8aec23f8be tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:56:00.944004 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-f6b86972-77cc-4af2-9385-cc8aec23f8be tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:56:00.944833 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-f6b86972-77cc-4af2-9385-cc8aec23f8be tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:56:00.945464 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-f6b86972-77cc-4af2-9385-cc8aec23f8be tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:56:00.946104 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-f6b86972-77cc-4af2-9385-cc8aec23f8be tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:56:00.964509 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.quota [None req-f6b86972-77cc-4af2-9385-cc8aec23f8be tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Getting quotas for project aabf1193b43040948317be442c5c16f7. Resources: {'cores', 'ram', 'instances'} {{(pid=125242) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 15 13:56:00.968661 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.quota [None req-f6b86972-77cc-4af2-9385-cc8aec23f8be tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Getting quotas for user 0b01e277944d4edcb8625ebf4544e340 and project aabf1193b43040948317be442c5c16f7. Resources: {'cores', 'ram', 'instances'} {{(pid=125242) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 15 13:56:00.979908 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-f6b86972-77cc-4af2-9385-cc8aec23f8be tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Going to run 1 instances... {{(pid=125242) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 15 13:56:00.982547 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-f6b86972-77cc-4af2-9385-cc8aec23f8be tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 161ef6e2-46fb-4c64-bbf0-c178886e0965] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='26e64909-1cae-49ca-af5e-adea40c062d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125242) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 15 13:56:01.033279 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-f6b86972-77cc-4af2-9385-cc8aec23f8be tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.669230 Oct 15 13:56:01.033835 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 396/771] 10.222.0.36 () {62 vars in 1188 bytes} [Sat Oct 15 13:56:00 2022] POST /compute/v2.1/servers => generated 402 bytes in 671 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 15 13:56:01.045496 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-ad546386-b7ed-4002-af1d-848e43ebbf23 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:56:01.046084 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-ad546386-b7ed-4002-af1d-848e43ebbf23 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 161ef6e2-46fb-4c64-bbf0-c178886e0965] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:56:01.101511 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-ad546386-b7ed-4002-af1d-848e43ebbf23 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:56:01.111072 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-ad546386-b7ed-4002-af1d-848e43ebbf23 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:56:01.112587 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-ad546386-b7ed-4002-af1d-848e43ebbf23 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:56:01.113737 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-ad546386-b7ed-4002-af1d-848e43ebbf23 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/161ef6e2-46fb-4c64-bbf0-c178886e0965" status: 200 len: 1282 microversion: 2.20 time: 0.072525 Oct 15 13:56:01.114257 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 376/772] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:56:01 2022] GET /compute/v2.1/servers/161ef6e2-46fb-4c64-bbf0-c178886e0965 => generated 1282 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 13:56:01.373982 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-321a803e-b29e-4c8d-8374-119d1e6d4c31 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:56:01.374611 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-321a803e-b29e-4c8d-8374-119d1e6d4c31 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] [instance: 6490290c-19e1-49db-9190-3b945ece5145] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:56:01.381134 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-321a803e-b29e-4c8d-8374-119d1e6d4c31 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:56:01.381634 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-321a803e-b29e-4c8d-8374-119d1e6d4c31 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:56:01.382073 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-321a803e-b29e-4c8d-8374-119d1e6d4c31 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:56:01.382778 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-321a803e-b29e-4c8d-8374-119d1e6d4c31 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:56:01.383441 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-321a803e-b29e-4c8d-8374-119d1e6d4c31 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:56:01.383842 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-321a803e-b29e-4c8d-8374-119d1e6d4c31 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:56:01.554468 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-321a803e-b29e-4c8d-8374-119d1e6d4c31 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83c1c8fce04c57a685de883344b7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e752c3aef55649ea98ec1a2f3607c27f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:56:01.563641 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-321a803e-b29e-4c8d-8374-119d1e6d4c31 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] 10.222.0.36 "GET /compute/v2.1/servers/6490290c-19e1-49db-9190-3b945ece5145" status: 200 len: 1758 microversion: 2.1 time: 0.194026 Oct 15 13:56:01.564266 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 397/773] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:56:01 2022] GET /compute/v2.1/servers/6490290c-19e1-49db-9190-3b945ece5145 => generated 1758 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:56:02.140532 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-69ec9d84-ee12-4881-abaf-a343483b28bd tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:56:02.141261 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-69ec9d84-ee12-4881-abaf-a343483b28bd tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 161ef6e2-46fb-4c64-bbf0-c178886e0965] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:56:02.149217 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-69ec9d84-ee12-4881-abaf-a343483b28bd tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:56:02.149704 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-69ec9d84-ee12-4881-abaf-a343483b28bd tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:56:02.150138 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-69ec9d84-ee12-4881-abaf-a343483b28bd tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:56:02.150836 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-69ec9d84-ee12-4881-abaf-a343483b28bd tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:56:02.151381 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-69ec9d84-ee12-4881-abaf-a343483b28bd tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:56:02.151861 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-69ec9d84-ee12-4881-abaf-a343483b28bd tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:56:02.227131 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-69ec9d84-ee12-4881-abaf-a343483b28bd tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:56:02.236214 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-69ec9d84-ee12-4881-abaf-a343483b28bd tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:56:02.237670 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-69ec9d84-ee12-4881-abaf-a343483b28bd tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:56:02.238762 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-69ec9d84-ee12-4881-abaf-a343483b28bd tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/161ef6e2-46fb-4c64-bbf0-c178886e0965" status: 200 len: 1334 microversion: 2.20 time: 0.104038 Oct 15 13:56:02.239331 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 377/774] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:56:02 2022] GET /compute/v2.1/servers/161ef6e2-46fb-4c64-bbf0-c178886e0965 => generated 1334 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 13:56:02.589494 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-ce913a1f-8917-493f-bc3b-9feace3bfff7 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:56:02.590485 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-ce913a1f-8917-493f-bc3b-9feace3bfff7 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] [instance: 6490290c-19e1-49db-9190-3b945ece5145] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:56:02.603498 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-ce913a1f-8917-493f-bc3b-9feace3bfff7 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:56:02.604628 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-ce913a1f-8917-493f-bc3b-9feace3bfff7 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:56:02.606298 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-ce913a1f-8917-493f-bc3b-9feace3bfff7 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:56:02.607555 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-ce913a1f-8917-493f-bc3b-9feace3bfff7 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:56:02.608856 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-ce913a1f-8917-493f-bc3b-9feace3bfff7 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:56:02.609517 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-ce913a1f-8917-493f-bc3b-9feace3bfff7 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:56:02.763463 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-ce913a1f-8917-493f-bc3b-9feace3bfff7 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83c1c8fce04c57a685de883344b7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e752c3aef55649ea98ec1a2f3607c27f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:56:02.771971 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-ce913a1f-8917-493f-bc3b-9feace3bfff7 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] 10.222.0.36 "GET /compute/v2.1/servers/6490290c-19e1-49db-9190-3b945ece5145" status: 200 len: 1761 microversion: 2.1 time: 0.186540 Oct 15 13:56:02.772561 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 398/775] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:56:02 2022] GET /compute/v2.1/servers/6490290c-19e1-49db-9190-3b945ece5145 => generated 1761 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:56:03.264606 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-90c1ffcd-26bd-4d87-956d-16a64fea6235 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:56:03.265210 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-90c1ffcd-26bd-4d87-956d-16a64fea6235 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 161ef6e2-46fb-4c64-bbf0-c178886e0965] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:56:03.271963 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-90c1ffcd-26bd-4d87-956d-16a64fea6235 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:56:03.272515 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-90c1ffcd-26bd-4d87-956d-16a64fea6235 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:56:03.272948 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-90c1ffcd-26bd-4d87-956d-16a64fea6235 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:56:03.273647 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-90c1ffcd-26bd-4d87-956d-16a64fea6235 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:56:03.274153 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-90c1ffcd-26bd-4d87-956d-16a64fea6235 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:56:03.275208 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-90c1ffcd-26bd-4d87-956d-16a64fea6235 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:56:03.350937 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-90c1ffcd-26bd-4d87-956d-16a64fea6235 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:56:03.354710 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG dbcounter [-] [125243] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:56:03.361088 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-90c1ffcd-26bd-4d87-956d-16a64fea6235 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:56:03.362523 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-90c1ffcd-26bd-4d87-956d-16a64fea6235 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:56:03.363637 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-90c1ffcd-26bd-4d87-956d-16a64fea6235 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/161ef6e2-46fb-4c64-bbf0-c178886e0965" status: 200 len: 1340 microversion: 2.20 time: 0.103329 Oct 15 13:56:03.364243 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 378/776] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:56:03 2022] GET /compute/v2.1/servers/161ef6e2-46fb-4c64-bbf0-c178886e0965 => generated 1340 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 13:56:04.393598 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-736c5fbe-3fb5-411d-a0a5-6327becbd157 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:56:04.394187 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-736c5fbe-3fb5-411d-a0a5-6327becbd157 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 161ef6e2-46fb-4c64-bbf0-c178886e0965] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:56:04.400985 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-736c5fbe-3fb5-411d-a0a5-6327becbd157 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:56:04.401475 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-736c5fbe-3fb5-411d-a0a5-6327becbd157 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:56:04.401902 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-736c5fbe-3fb5-411d-a0a5-6327becbd157 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:56:04.402639 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-736c5fbe-3fb5-411d-a0a5-6327becbd157 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:56:04.403087 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-736c5fbe-3fb5-411d-a0a5-6327becbd157 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:56:04.403497 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-736c5fbe-3fb5-411d-a0a5-6327becbd157 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:56:04.605024 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-736c5fbe-3fb5-411d-a0a5-6327becbd157 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:56:04.614956 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-736c5fbe-3fb5-411d-a0a5-6327becbd157 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:56:04.616752 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-736c5fbe-3fb5-411d-a0a5-6327becbd157 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:56:04.618282 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-736c5fbe-3fb5-411d-a0a5-6327becbd157 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/161ef6e2-46fb-4c64-bbf0-c178886e0965" status: 200 len: 1408 microversion: 2.20 time: 0.228647 Oct 15 13:56:04.618964 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 399/777] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:56:04 2022] GET /compute/v2.1/servers/161ef6e2-46fb-4c64-bbf0-c178886e0965 => generated 1408 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 13:56:04.642294 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [req-a6c92a45-be02-4b0c-ae80-c0d3bc1b6c9d req-4a20a976-8550-4811-849c-683f8a639b26 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "161ef6e2-46fb-4c64-bbf0-c178886e0965", "tag": "b7f79f6d-d3ad-4794-bbcd-8936f95ed2b8"}]} {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 13:56:04.662226 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [req-a6c92a45-be02-4b0c-ae80-c0d3bc1b6c9d req-4a20a976-8550-4811-849c-683f8a639b26 service nova] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:56:04.663356 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [req-a6c92a45-be02-4b0c-ae80-c0d3bc1b6c9d req-4a20a976-8550-4811-849c-683f8a639b26 service nova] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:56:04.664624 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [req-a6c92a45-be02-4b0c-ae80-c0d3bc1b6c9d req-4a20a976-8550-4811-849c-683f8a639b26 service nova] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:56:04.678097 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.compute.server_external_events [req-a6c92a45-be02-4b0c-ae80-c0d3bc1b6c9d req-4a20a976-8550-4811-849c-683f8a639b26 service nova] Creating event network-changed:b7f79f6d-d3ad-4794-bbcd-8936f95ed2b8 for instance 161ef6e2-46fb-4c64-bbf0-c178886e0965 on hv-cinder-86149 Oct 15 13:56:04.684133 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [req-a6c92a45-be02-4b0c-ae80-c0d3bc1b6c9d req-4a20a976-8550-4811-849c-683f8a639b26 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047159 Oct 15 13:56:04.684750 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 379/778] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 15 13:56:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 13:56:05.643804 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-e259db0e-475b-434c-b9ff-75ef05c6a083 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:56:05.644849 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-e259db0e-475b-434c-b9ff-75ef05c6a083 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 161ef6e2-46fb-4c64-bbf0-c178886e0965] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:56:05.652884 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-e259db0e-475b-434c-b9ff-75ef05c6a083 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:56:05.653382 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-e259db0e-475b-434c-b9ff-75ef05c6a083 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:56:05.653824 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-e259db0e-475b-434c-b9ff-75ef05c6a083 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:56:05.654541 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-e259db0e-475b-434c-b9ff-75ef05c6a083 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:56:05.654997 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-e259db0e-475b-434c-b9ff-75ef05c6a083 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:56:05.655431 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-e259db0e-475b-434c-b9ff-75ef05c6a083 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:56:05.801285 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-e259db0e-475b-434c-b9ff-75ef05c6a083 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:56:05.812668 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-e259db0e-475b-434c-b9ff-75ef05c6a083 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:56:05.814128 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-e259db0e-475b-434c-b9ff-75ef05c6a083 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:56:05.815259 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-e259db0e-475b-434c-b9ff-75ef05c6a083 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/161ef6e2-46fb-4c64-bbf0-c178886e0965" status: 200 len: 1408 microversion: 2.20 time: 0.175511 Oct 15 13:56:05.815819 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 400/779] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:56:05 2022] GET /compute/v2.1/servers/161ef6e2-46fb-4c64-bbf0-c178886e0965 => generated 1408 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 13:56:06.841248 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-9fab4cb1-fab7-4b9f-8f4c-d14c0869eedf tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:56:06.841947 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-9fab4cb1-fab7-4b9f-8f4c-d14c0869eedf tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 161ef6e2-46fb-4c64-bbf0-c178886e0965] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:56:06.849602 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-9fab4cb1-fab7-4b9f-8f4c-d14c0869eedf tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:56:06.850075 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-9fab4cb1-fab7-4b9f-8f4c-d14c0869eedf tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:56:06.850505 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-9fab4cb1-fab7-4b9f-8f4c-d14c0869eedf tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:56:06.851203 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-9fab4cb1-fab7-4b9f-8f4c-d14c0869eedf tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:56:06.851650 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-9fab4cb1-fab7-4b9f-8f4c-d14c0869eedf tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:56:06.852106 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-9fab4cb1-fab7-4b9f-8f4c-d14c0869eedf tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:56:06.987020 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-9fab4cb1-fab7-4b9f-8f4c-d14c0869eedf tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:56:06.995811 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-9fab4cb1-fab7-4b9f-8f4c-d14c0869eedf tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:56:06.997303 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-9fab4cb1-fab7-4b9f-8f4c-d14c0869eedf tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:56:06.998421 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-9fab4cb1-fab7-4b9f-8f4c-d14c0869eedf tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/161ef6e2-46fb-4c64-bbf0-c178886e0965" status: 200 len: 1408 microversion: 2.20 time: 0.161754 Oct 15 13:56:06.998995 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 380/780] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:56:06 2022] GET /compute/v2.1/servers/161ef6e2-46fb-4c64-bbf0-c178886e0965 => generated 1408 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 13:56:08.023935 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-e305a3f8-18e4-4f22-b5ba-f5f3fd08f72e tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:56:08.024552 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-e305a3f8-18e4-4f22-b5ba-f5f3fd08f72e tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 161ef6e2-46fb-4c64-bbf0-c178886e0965] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:56:08.031925 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-e305a3f8-18e4-4f22-b5ba-f5f3fd08f72e tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:56:08.032422 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-e305a3f8-18e4-4f22-b5ba-f5f3fd08f72e tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:56:08.032863 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-e305a3f8-18e4-4f22-b5ba-f5f3fd08f72e tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:56:08.033550 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-e305a3f8-18e4-4f22-b5ba-f5f3fd08f72e tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:56:08.033999 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-e305a3f8-18e4-4f22-b5ba-f5f3fd08f72e tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:56:08.034481 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-e305a3f8-18e4-4f22-b5ba-f5f3fd08f72e tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:56:08.053607 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG dbcounter [-] [125242] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=125242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:56:08.173924 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-e305a3f8-18e4-4f22-b5ba-f5f3fd08f72e tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:56:08.187052 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-e305a3f8-18e4-4f22-b5ba-f5f3fd08f72e tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:56:08.188559 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-e305a3f8-18e4-4f22-b5ba-f5f3fd08f72e tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:56:08.189685 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-e305a3f8-18e4-4f22-b5ba-f5f3fd08f72e tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/161ef6e2-46fb-4c64-bbf0-c178886e0965" status: 200 len: 1408 microversion: 2.20 time: 0.169934 Oct 15 13:56:08.190230 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 401/781] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:56:08 2022] GET /compute/v2.1/servers/161ef6e2-46fb-4c64-bbf0-c178886e0965 => generated 1408 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 15 13:56:09.214419 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-3620e472-ad04-43f8-8bec-934b83c0710d tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:56:09.215042 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-3620e472-ad04-43f8-8bec-934b83c0710d tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 161ef6e2-46fb-4c64-bbf0-c178886e0965] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:56:09.222319 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-3620e472-ad04-43f8-8bec-934b83c0710d tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:56:09.222806 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-3620e472-ad04-43f8-8bec-934b83c0710d tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:56:09.223240 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-3620e472-ad04-43f8-8bec-934b83c0710d tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:56:09.223971 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-3620e472-ad04-43f8-8bec-934b83c0710d tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:56:09.224416 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-3620e472-ad04-43f8-8bec-934b83c0710d tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:56:09.224836 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-3620e472-ad04-43f8-8bec-934b83c0710d tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:56:09.374888 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-3620e472-ad04-43f8-8bec-934b83c0710d tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:56:09.386443 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-3620e472-ad04-43f8-8bec-934b83c0710d tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:56:09.388986 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-3620e472-ad04-43f8-8bec-934b83c0710d tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:56:09.390082 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-3620e472-ad04-43f8-8bec-934b83c0710d tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/161ef6e2-46fb-4c64-bbf0-c178886e0965" status: 200 len: 1408 microversion: 2.20 time: 0.179699 Oct 15 13:56:09.390642 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 381/782] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:56:09 2022] GET /compute/v2.1/servers/161ef6e2-46fb-4c64-bbf0-c178886e0965 => generated 1408 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 15 13:56:10.416179 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-d5e0e0bc-68fe-4f3b-b1c3-127c8a604643 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:56:10.416760 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-d5e0e0bc-68fe-4f3b-b1c3-127c8a604643 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 161ef6e2-46fb-4c64-bbf0-c178886e0965] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:56:10.423702 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-d5e0e0bc-68fe-4f3b-b1c3-127c8a604643 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:56:10.424256 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-d5e0e0bc-68fe-4f3b-b1c3-127c8a604643 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:56:10.424677 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-d5e0e0bc-68fe-4f3b-b1c3-127c8a604643 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:56:10.425380 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-d5e0e0bc-68fe-4f3b-b1c3-127c8a604643 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:56:10.425830 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-d5e0e0bc-68fe-4f3b-b1c3-127c8a604643 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:56:10.426252 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-d5e0e0bc-68fe-4f3b-b1c3-127c8a604643 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:56:10.577307 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-d5e0e0bc-68fe-4f3b-b1c3-127c8a604643 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:56:10.586239 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-d5e0e0bc-68fe-4f3b-b1c3-127c8a604643 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:56:10.587689 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-d5e0e0bc-68fe-4f3b-b1c3-127c8a604643 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:56:10.588843 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-d5e0e0bc-68fe-4f3b-b1c3-127c8a604643 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/161ef6e2-46fb-4c64-bbf0-c178886e0965" status: 200 len: 1408 microversion: 2.20 time: 0.177314 Oct 15 13:56:10.589435 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 402/783] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:56:10 2022] GET /compute/v2.1/servers/161ef6e2-46fb-4c64-bbf0-c178886e0965 => generated 1408 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 13:56:11.162620 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [req-61451a02-c76b-49bc-9ce2-1a3a852fef19 req-2addb110-7ab0-4e41-bf95-8406019bc91c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "161ef6e2-46fb-4c64-bbf0-c178886e0965", "name": "network-vif-plugged", "status": "completed", "tag": "b7f79f6d-d3ad-4794-bbcd-8936f95ed2b8"}]} {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 13:56:11.169359 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG dbcounter [-] [125243] Writing DB stats nova_cell0:SELECT=6 {{(pid=125243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:56:11.177011 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [req-61451a02-c76b-49bc-9ce2-1a3a852fef19 req-2addb110-7ab0-4e41-bf95-8406019bc91c service nova] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:56:11.177489 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [req-61451a02-c76b-49bc-9ce2-1a3a852fef19 req-2addb110-7ab0-4e41-bf95-8406019bc91c service nova] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:56:11.177920 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [req-61451a02-c76b-49bc-9ce2-1a3a852fef19 req-2addb110-7ab0-4e41-bf95-8406019bc91c service nova] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:56:11.189647 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.compute.server_external_events [req-61451a02-c76b-49bc-9ce2-1a3a852fef19 req-2addb110-7ab0-4e41-bf95-8406019bc91c service nova] Creating event network-vif-plugged:b7f79f6d-d3ad-4794-bbcd-8936f95ed2b8 for instance 161ef6e2-46fb-4c64-bbf0-c178886e0965 on hv-cinder-86149 Oct 15 13:56:11.195406 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [req-61451a02-c76b-49bc-9ce2-1a3a852fef19 req-2addb110-7ab0-4e41-bf95-8406019bc91c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037284 Oct 15 13:56:11.196039 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 382/784] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 15 13:56:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 13:56:11.615470 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-a5695a3e-3a2d-48c4-bde8-224996da7df8 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:56:11.616400 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-a5695a3e-3a2d-48c4-bde8-224996da7df8 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 161ef6e2-46fb-4c64-bbf0-c178886e0965] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:56:11.618489 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG dbcounter [-] [125242] Writing DB stats nova_cell0:SELECT=2 {{(pid=125242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:56:11.619205 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG dbcounter [-] [125242] Writing DB stats nova_cell0:SELECT=6 {{(pid=125242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:56:11.626705 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-a5695a3e-3a2d-48c4-bde8-224996da7df8 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:56:11.627234 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-a5695a3e-3a2d-48c4-bde8-224996da7df8 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:56:11.627659 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-a5695a3e-3a2d-48c4-bde8-224996da7df8 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:56:11.628450 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-a5695a3e-3a2d-48c4-bde8-224996da7df8 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:56:11.628845 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-a5695a3e-3a2d-48c4-bde8-224996da7df8 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:56:11.629265 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-a5695a3e-3a2d-48c4-bde8-224996da7df8 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:56:11.771699 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-a5695a3e-3a2d-48c4-bde8-224996da7df8 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:56:11.783360 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-a5695a3e-3a2d-48c4-bde8-224996da7df8 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:56:11.784841 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-a5695a3e-3a2d-48c4-bde8-224996da7df8 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:56:11.786010 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-a5695a3e-3a2d-48c4-bde8-224996da7df8 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/161ef6e2-46fb-4c64-bbf0-c178886e0965" status: 200 len: 1408 microversion: 2.20 time: 0.175047 Oct 15 13:56:11.786577 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 403/785] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:56:11 2022] GET /compute/v2.1/servers/161ef6e2-46fb-4c64-bbf0-c178886e0965 => generated 1408 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 13:56:12.813241 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-00224178-2f91-4dba-b911-5c019437091c tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:56:12.813855 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-00224178-2f91-4dba-b911-5c019437091c tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 161ef6e2-46fb-4c64-bbf0-c178886e0965] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:56:12.820615 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-00224178-2f91-4dba-b911-5c019437091c tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:56:12.821109 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-00224178-2f91-4dba-b911-5c019437091c tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:56:12.821540 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-00224178-2f91-4dba-b911-5c019437091c tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:56:12.822332 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-00224178-2f91-4dba-b911-5c019437091c tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:56:12.822693 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-00224178-2f91-4dba-b911-5c019437091c tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:56:12.823116 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-00224178-2f91-4dba-b911-5c019437091c tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:56:12.983176 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-00224178-2f91-4dba-b911-5c019437091c tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:56:12.992896 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-00224178-2f91-4dba-b911-5c019437091c tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:56:12.994806 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-00224178-2f91-4dba-b911-5c019437091c tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:56:12.995694 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-00224178-2f91-4dba-b911-5c019437091c tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/161ef6e2-46fb-4c64-bbf0-c178886e0965" status: 200 len: 1408 microversion: 2.20 time: 0.187241 Oct 15 13:56:12.999917 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 383/786] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:56:12 2022] GET /compute/v2.1/servers/161ef6e2-46fb-4c64-bbf0-c178886e0965 => generated 1408 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 13:56:14.021614 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-1cec33f5-e8bd-4f25-b8f4-bcc4755a4115 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:56:14.022531 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-1cec33f5-e8bd-4f25-b8f4-bcc4755a4115 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 161ef6e2-46fb-4c64-bbf0-c178886e0965] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:56:14.029416 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-1cec33f5-e8bd-4f25-b8f4-bcc4755a4115 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:56:14.029908 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-1cec33f5-e8bd-4f25-b8f4-bcc4755a4115 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:56:14.030348 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-1cec33f5-e8bd-4f25-b8f4-bcc4755a4115 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:56:14.031055 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-1cec33f5-e8bd-4f25-b8f4-bcc4755a4115 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:56:14.031514 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-1cec33f5-e8bd-4f25-b8f4-bcc4755a4115 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:56:14.031983 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-1cec33f5-e8bd-4f25-b8f4-bcc4755a4115 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:56:14.171898 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-1cec33f5-e8bd-4f25-b8f4-bcc4755a4115 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:56:14.181049 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-1cec33f5-e8bd-4f25-b8f4-bcc4755a4115 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:56:14.182545 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-1cec33f5-e8bd-4f25-b8f4-bcc4755a4115 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:56:14.183735 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-1cec33f5-e8bd-4f25-b8f4-bcc4755a4115 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/161ef6e2-46fb-4c64-bbf0-c178886e0965" status: 200 len: 1601 microversion: 2.20 time: 0.166544 Oct 15 13:56:14.184343 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 404/787] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:56:14 2022] GET /compute/v2.1/servers/161ef6e2-46fb-4c64-bbf0-c178886e0965 => generated 1601 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 13:56:14.209199 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-49c78bfe-5740-4be0-8656-ef10074b7e11 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:56:14.209782 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-49c78bfe-5740-4be0-8656-ef10074b7e11 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 161ef6e2-46fb-4c64-bbf0-c178886e0965] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:56:14.216773 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-49c78bfe-5740-4be0-8656-ef10074b7e11 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:56:14.217257 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-49c78bfe-5740-4be0-8656-ef10074b7e11 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:56:14.217688 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-49c78bfe-5740-4be0-8656-ef10074b7e11 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:56:14.218383 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-49c78bfe-5740-4be0-8656-ef10074b7e11 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:56:14.218825 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-49c78bfe-5740-4be0-8656-ef10074b7e11 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:56:14.219242 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-49c78bfe-5740-4be0-8656-ef10074b7e11 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:56:14.307486 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-49c78bfe-5740-4be0-8656-ef10074b7e11 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/161ef6e2-46fb-4c64-bbf0-c178886e0965/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.102215 Oct 15 13:56:14.308130 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 384/788] 10.222.0.36 () {60 vars in 1316 bytes} [Sat Oct 15 13:56:14 2022] GET /compute/v2.1/servers/161ef6e2-46fb-4c64-bbf0-c178886e0965/os-interface => generated 285 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 13:56:15.319058 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [req-3642d476-65c4-4be4-9edc-982b8a847ced req-c2fe7dd7-0ee8-4c8e-adc3-8f31c617c714 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "161ef6e2-46fb-4c64-bbf0-c178886e0965", "tag": "b7f79f6d-d3ad-4794-bbcd-8936f95ed2b8"}]} {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 13:56:15.329182 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [req-3642d476-65c4-4be4-9edc-982b8a847ced req-c2fe7dd7-0ee8-4c8e-adc3-8f31c617c714 service nova] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:56:15.329657 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [req-3642d476-65c4-4be4-9edc-982b8a847ced req-c2fe7dd7-0ee8-4c8e-adc3-8f31c617c714 service nova] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:56:15.330082 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [req-3642d476-65c4-4be4-9edc-982b8a847ced req-c2fe7dd7-0ee8-4c8e-adc3-8f31c617c714 service nova] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:56:15.341597 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.compute.server_external_events [req-3642d476-65c4-4be4-9edc-982b8a847ced req-c2fe7dd7-0ee8-4c8e-adc3-8f31c617c714 service nova] Creating event network-changed:b7f79f6d-d3ad-4794-bbcd-8936f95ed2b8 for instance 161ef6e2-46fb-4c64-bbf0-c178886e0965 on hv-cinder-86149 Oct 15 13:56:15.346807 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [req-3642d476-65c4-4be4-9edc-982b8a847ced req-c2fe7dd7-0ee8-4c8e-adc3-8f31c617c714 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031648 Oct 15 13:56:15.347654 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 405/789] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 15 13:56:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 13:56:19.106508 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-73ce64cf-44f5-4fae-a084-f5e1b4f5e7c0 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:56:19.107133 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-73ce64cf-44f5-4fae-a084-f5e1b4f5e7c0 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] [instance: cb269dd0-b5af-4013-9ded-062f40176b8f] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:56:19.109098 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG dbcounter [-] [125243] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=125243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:56:19.115570 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-73ce64cf-44f5-4fae-a084-f5e1b4f5e7c0 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:56:19.116254 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-73ce64cf-44f5-4fae-a084-f5e1b4f5e7c0 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:56:19.116702 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-73ce64cf-44f5-4fae-a084-f5e1b4f5e7c0 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:56:19.117416 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-73ce64cf-44f5-4fae-a084-f5e1b4f5e7c0 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:56:19.117880 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-73ce64cf-44f5-4fae-a084-f5e1b4f5e7c0 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:56:19.118296 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-73ce64cf-44f5-4fae-a084-f5e1b4f5e7c0 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:56:19.209590 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.objects.instance [None req-73ce64cf-44f5-4fae-a084-f5e1b4f5e7c0 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lazy-loading 'services' on Instance uuid cb269dd0-b5af-4013-9ded-062f40176b8f {{(pid=125243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 15 13:56:19.289501 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-73ce64cf-44f5-4fae-a084-f5e1b4f5e7c0 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] 10.222.0.36 "DELETE /compute/v2.1/servers/cb269dd0-b5af-4013-9ded-062f40176b8f/os-volume_attachments/e2bb581a-89d5-4d2f-bcba-23862333c27e" status: 202 len: 0 microversion: 2.1 time: 0.187732 Oct 15 13:56:19.290065 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 385/790] 10.222.0.36 () {58 vars in 1416 bytes} [Sat Oct 15 13:56:19 2022] DELETE /compute/v2.1/servers/cb269dd0-b5af-4013-9ded-062f40176b8f/os-volume_attachments/e2bb581a-89d5-4d2f-bcba-23862333c27e => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 15 13:56:19.300254 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-3befb5dd-8143-4e48-b676-af4bd6cea231 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:56:19.302563 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-3befb5dd-8143-4e48-b676-af4bd6cea231 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] [instance: cb269dd0-b5af-4013-9ded-062f40176b8f] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:56:19.304596 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG dbcounter [-] [125242] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=3 {{(pid=125242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:56:19.312122 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-3befb5dd-8143-4e48-b676-af4bd6cea231 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:56:19.312625 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-3befb5dd-8143-4e48-b676-af4bd6cea231 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:56:19.313108 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-3befb5dd-8143-4e48-b676-af4bd6cea231 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:56:19.313815 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-3befb5dd-8143-4e48-b676-af4bd6cea231 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:56:19.314457 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-3befb5dd-8143-4e48-b676-af4bd6cea231 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:56:19.315007 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-3befb5dd-8143-4e48-b676-af4bd6cea231 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:56:19.348504 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-3befb5dd-8143-4e48-b676-af4bd6cea231 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] 10.222.0.36 "GET /compute/v2.1/servers/cb269dd0-b5af-4013-9ded-062f40176b8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053488 Oct 15 13:56:19.349103 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 406/791] 10.222.0.36 () {58 vars in 1302 bytes} [Sat Oct 15 13:56:19 2022] GET /compute/v2.1/servers/cb269dd0-b5af-4013-9ded-062f40176b8f/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 13:56:20.363844 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-15d672d6-faff-477c-bfce-b272e53c01da tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:56:20.366588 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-15d672d6-faff-477c-bfce-b272e53c01da tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] [instance: cb269dd0-b5af-4013-9ded-062f40176b8f] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:56:20.373114 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-15d672d6-faff-477c-bfce-b272e53c01da tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:56:20.373602 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-15d672d6-faff-477c-bfce-b272e53c01da tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:56:20.374041 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-15d672d6-faff-477c-bfce-b272e53c01da tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:56:20.374742 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-15d672d6-faff-477c-bfce-b272e53c01da tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:56:20.375195 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-15d672d6-faff-477c-bfce-b272e53c01da tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:56:20.375660 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-15d672d6-faff-477c-bfce-b272e53c01da tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:56:20.409497 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-15d672d6-faff-477c-bfce-b272e53c01da tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] 10.222.0.36 "GET /compute/v2.1/servers/cb269dd0-b5af-4013-9ded-062f40176b8f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050992 Oct 15 13:56:20.410185 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 386/792] 10.222.0.36 () {58 vars in 1302 bytes} [Sat Oct 15 13:56:20 2022] GET /compute/v2.1/servers/cb269dd0-b5af-4013-9ded-062f40176b8f/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 15 13:56:20.499596 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-13a2c85b-6008-4c97-bd4c-7585613e6d54 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:56:20.500214 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-13a2c85b-6008-4c97-bd4c-7585613e6d54 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] [instance: cb269dd0-b5af-4013-9ded-062f40176b8f] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:56:20.506838 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-13a2c85b-6008-4c97-bd4c-7585613e6d54 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:56:20.507326 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-13a2c85b-6008-4c97-bd4c-7585613e6d54 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:56:20.507763 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-13a2c85b-6008-4c97-bd4c-7585613e6d54 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:56:20.508492 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-13a2c85b-6008-4c97-bd4c-7585613e6d54 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:56:20.508942 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-13a2c85b-6008-4c97-bd4c-7585613e6d54 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:56:20.509364 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-13a2c85b-6008-4c97-bd4c-7585613e6d54 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:56:20.536607 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-13a2c85b-6008-4c97-bd4c-7585613e6d54 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] [instance: cb269dd0-b5af-4013-9ded-062f40176b8f] Going to try to terminate instance {{(pid=125242) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 15 13:56:20.623312 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-13a2c85b-6008-4c97-bd4c-7585613e6d54 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] 10.222.0.36 "DELETE /compute/v2.1/servers/cb269dd0-b5af-4013-9ded-062f40176b8f" status: 204 len: 0 microversion: 2.1 time: 0.128483 Oct 15 13:56:20.624128 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 407/793] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 15 13:56:20 2022] DELETE /compute/v2.1/servers/cb269dd0-b5af-4013-9ded-062f40176b8f => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 15 13:56:20.632870 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-4d0b35eb-8777-4be3-9912-6179722ecfeb tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:56:20.633564 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-4d0b35eb-8777-4be3-9912-6179722ecfeb tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] [instance: cb269dd0-b5af-4013-9ded-062f40176b8f] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:56:20.640006 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-4d0b35eb-8777-4be3-9912-6179722ecfeb tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:56:20.640479 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-4d0b35eb-8777-4be3-9912-6179722ecfeb tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:56:20.640922 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-4d0b35eb-8777-4be3-9912-6179722ecfeb tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:56:20.641613 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-4d0b35eb-8777-4be3-9912-6179722ecfeb tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:56:20.642059 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-4d0b35eb-8777-4be3-9912-6179722ecfeb tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:56:20.642468 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-4d0b35eb-8777-4be3-9912-6179722ecfeb tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:56:20.785250 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-4d0b35eb-8777-4be3-9912-6179722ecfeb tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5150c06020594efe957359f641eba5da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a0813bae074cd2aa552be82abe8493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:56:20.793783 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-4d0b35eb-8777-4be3-9912-6179722ecfeb tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] 10.222.0.36 "GET /compute/v2.1/servers/cb269dd0-b5af-4013-9ded-062f40176b8f" status: 200 len: 1690 microversion: 2.1 time: 0.164879 Oct 15 13:56:20.794371 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 387/794] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:56:20 2022] GET /compute/v2.1/servers/cb269dd0-b5af-4013-9ded-062f40176b8f => generated 1690 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:56:21.818592 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-d950c6a2-f73f-439f-ae23-81ddc91bc6be tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:56:21.819175 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-d950c6a2-f73f-439f-ae23-81ddc91bc6be tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] [instance: cb269dd0-b5af-4013-9ded-062f40176b8f] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:56:21.826719 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-d950c6a2-f73f-439f-ae23-81ddc91bc6be tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:56:21.827223 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-d950c6a2-f73f-439f-ae23-81ddc91bc6be tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:56:21.827707 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-d950c6a2-f73f-439f-ae23-81ddc91bc6be tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:56:21.828396 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-d950c6a2-f73f-439f-ae23-81ddc91bc6be tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:56:21.828863 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-d950c6a2-f73f-439f-ae23-81ddc91bc6be tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:56:21.829379 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-d950c6a2-f73f-439f-ae23-81ddc91bc6be tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:56:21.970506 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-d950c6a2-f73f-439f-ae23-81ddc91bc6be tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5150c06020594efe957359f641eba5da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a0813bae074cd2aa552be82abe8493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:56:21.983190 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-d950c6a2-f73f-439f-ae23-81ddc91bc6be tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] 10.222.0.36 "GET /compute/v2.1/servers/cb269dd0-b5af-4013-9ded-062f40176b8f" status: 200 len: 1690 microversion: 2.1 time: 0.168762 Oct 15 13:56:21.984042 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 408/795] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:56:21 2022] GET /compute/v2.1/servers/cb269dd0-b5af-4013-9ded-062f40176b8f => generated 1690 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:56:22.465401 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-7b33eb0f-958a-45eb-ac3b-c29d5f1cf453 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 13:56:22.466024 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-7b33eb0f-958a-45eb-ac3b-c29d5f1cf453 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] [instance: 1413aaed-46c7-4807-9d3b-957616dd4047] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:56:22.473025 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-7b33eb0f-958a-45eb-ac3b-c29d5f1cf453 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:56:22.473525 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-7b33eb0f-958a-45eb-ac3b-c29d5f1cf453 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:56:22.473964 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-7b33eb0f-958a-45eb-ac3b-c29d5f1cf453 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:56:22.474674 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-7b33eb0f-958a-45eb-ac3b-c29d5f1cf453 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:56:22.475135 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-7b33eb0f-958a-45eb-ac3b-c29d5f1cf453 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:56:22.475609 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-7b33eb0f-958a-45eb-ac3b-c29d5f1cf453 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:56:22.502039 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.objects.instance [None req-7b33eb0f-958a-45eb-ac3b-c29d5f1cf453 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lazy-loading 'flavor' on Instance uuid 1413aaed-46c7-4807-9d3b-957616dd4047 {{(pid=125243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 15 13:56:22.580171 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-7b33eb0f-958a-45eb-ac3b-c29d5f1cf453 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] 10.222.0.36 "POST /compute/v2.1/servers/1413aaed-46c7-4807-9d3b-957616dd4047/action" status: 202 len: 0 microversion: 2.1 time: 0.118686 Oct 15 13:56:22.580766 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 388/796] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 15 13:56:22 2022] POST /compute/v2.1/servers/1413aaed-46c7-4807-9d3b-957616dd4047/action => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 15 13:56:22.589384 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-1623275f-50b2-4955-b571-72d824668613 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:56:22.590024 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-1623275f-50b2-4955-b571-72d824668613 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] [instance: 1413aaed-46c7-4807-9d3b-957616dd4047] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:56:22.596191 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-1623275f-50b2-4955-b571-72d824668613 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:56:22.596682 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-1623275f-50b2-4955-b571-72d824668613 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:56:22.597093 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-1623275f-50b2-4955-b571-72d824668613 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:56:22.597828 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-1623275f-50b2-4955-b571-72d824668613 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:56:22.598281 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-1623275f-50b2-4955-b571-72d824668613 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:56:22.598703 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-1623275f-50b2-4955-b571-72d824668613 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:56:22.733049 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-1623275f-50b2-4955-b571-72d824668613 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e530c3f544748bd3ffc256b1630b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a6be8e43c7742be84f4dc3c95a990e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:56:22.744841 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-1623275f-50b2-4955-b571-72d824668613 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] 10.222.0.36 "GET /compute/v2.1/servers/1413aaed-46c7-4807-9d3b-957616dd4047" status: 200 len: 1568 microversion: 2.1 time: 0.159204 Oct 15 13:56:22.745633 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 409/797] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:56:22 2022] GET /compute/v2.1/servers/1413aaed-46c7-4807-9d3b-957616dd4047 => generated 1568 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:56:23.010561 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-06e98e59-11a5-4329-b1b8-5e84cf7fdd93 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:56:23.011325 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-06e98e59-11a5-4329-b1b8-5e84cf7fdd93 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] [instance: cb269dd0-b5af-4013-9ded-062f40176b8f] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:56:23.018720 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-06e98e59-11a5-4329-b1b8-5e84cf7fdd93 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:56:23.019289 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-06e98e59-11a5-4329-b1b8-5e84cf7fdd93 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:56:23.019769 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-06e98e59-11a5-4329-b1b8-5e84cf7fdd93 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:56:23.020562 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-06e98e59-11a5-4329-b1b8-5e84cf7fdd93 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:56:23.021058 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-06e98e59-11a5-4329-b1b8-5e84cf7fdd93 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:56:23.021527 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-06e98e59-11a5-4329-b1b8-5e84cf7fdd93 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:56:23.182155 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-06e98e59-11a5-4329-b1b8-5e84cf7fdd93 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5150c06020594efe957359f641eba5da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a0813bae074cd2aa552be82abe8493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:56:23.190469 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-06e98e59-11a5-4329-b1b8-5e84cf7fdd93 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] 10.222.0.36 "GET /compute/v2.1/servers/cb269dd0-b5af-4013-9ded-062f40176b8f" status: 200 len: 1690 microversion: 2.1 time: 0.185025 Oct 15 13:56:23.191057 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 389/798] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:56:23 2022] GET /compute/v2.1/servers/cb269dd0-b5af-4013-9ded-062f40176b8f => generated 1690 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:56:23.773455 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-54fccd88-f119-4c37-8094-f2a1b9865f41 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:56:23.774290 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-54fccd88-f119-4c37-8094-f2a1b9865f41 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] [instance: 1413aaed-46c7-4807-9d3b-957616dd4047] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:56:23.780917 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-54fccd88-f119-4c37-8094-f2a1b9865f41 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:56:23.781405 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-54fccd88-f119-4c37-8094-f2a1b9865f41 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:56:23.781845 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-54fccd88-f119-4c37-8094-f2a1b9865f41 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:56:23.789779 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-54fccd88-f119-4c37-8094-f2a1b9865f41 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:56:23.789779 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-54fccd88-f119-4c37-8094-f2a1b9865f41 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:56:23.789779 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-54fccd88-f119-4c37-8094-f2a1b9865f41 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:56:24.029410 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-54fccd88-f119-4c37-8094-f2a1b9865f41 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e530c3f544748bd3ffc256b1630b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a6be8e43c7742be84f4dc3c95a990e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:56:24.037389 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-54fccd88-f119-4c37-8094-f2a1b9865f41 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] 10.222.0.36 "GET /compute/v2.1/servers/1413aaed-46c7-4807-9d3b-957616dd4047" status: 200 len: 1568 microversion: 2.1 time: 0.267870 Oct 15 13:56:24.038086 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 410/799] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:56:23 2022] GET /compute/v2.1/servers/1413aaed-46c7-4807-9d3b-957616dd4047 => generated 1568 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:56:24.214537 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-d067db2a-e65c-4ac6-983c-5992ec54b348 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:56:24.215159 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-d067db2a-e65c-4ac6-983c-5992ec54b348 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] [instance: cb269dd0-b5af-4013-9ded-062f40176b8f] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:56:24.221708 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-d067db2a-e65c-4ac6-983c-5992ec54b348 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:56:24.222200 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-d067db2a-e65c-4ac6-983c-5992ec54b348 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:56:24.222635 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-d067db2a-e65c-4ac6-983c-5992ec54b348 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:56:24.223331 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-d067db2a-e65c-4ac6-983c-5992ec54b348 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:56:24.223781 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-d067db2a-e65c-4ac6-983c-5992ec54b348 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:56:24.224232 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-d067db2a-e65c-4ac6-983c-5992ec54b348 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:56:24.410752 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-d067db2a-e65c-4ac6-983c-5992ec54b348 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5150c06020594efe957359f641eba5da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a0813bae074cd2aa552be82abe8493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:56:24.429975 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-d067db2a-e65c-4ac6-983c-5992ec54b348 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] 10.222.0.36 "GET /compute/v2.1/servers/cb269dd0-b5af-4013-9ded-062f40176b8f" status: 200 len: 1690 microversion: 2.1 time: 0.219638 Oct 15 13:56:24.431393 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 390/800] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:56:24 2022] GET /compute/v2.1/servers/cb269dd0-b5af-4013-9ded-062f40176b8f => generated 1690 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:56:24.737920 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [req-009f2bfb-6a32-4603-8c6e-71d939fcfbb2 req-8da9e64e-b86f-445e-9484-596ad408ddac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb269dd0-b5af-4013-9ded-062f40176b8f", "name": "network-vif-deleted", "tag": "4fc36f1c-5dfc-463e-b40a-40955077b6d2"}]} {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 13:56:24.748499 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [req-009f2bfb-6a32-4603-8c6e-71d939fcfbb2 req-8da9e64e-b86f-445e-9484-596ad408ddac service nova] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:56:24.749009 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [req-009f2bfb-6a32-4603-8c6e-71d939fcfbb2 req-8da9e64e-b86f-445e-9484-596ad408ddac service nova] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:56:24.749438 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [req-009f2bfb-6a32-4603-8c6e-71d939fcfbb2 req-8da9e64e-b86f-445e-9484-596ad408ddac service nova] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:56:24.761954 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.compute.server_external_events [req-009f2bfb-6a32-4603-8c6e-71d939fcfbb2 req-8da9e64e-b86f-445e-9484-596ad408ddac service nova] Creating event network-vif-deleted:4fc36f1c-5dfc-463e-b40a-40955077b6d2 for instance cb269dd0-b5af-4013-9ded-062f40176b8f on hv-cinder-86149 Oct 15 13:56:24.768323 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [req-009f2bfb-6a32-4603-8c6e-71d939fcfbb2 req-8da9e64e-b86f-445e-9484-596ad408ddac service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034061 Oct 15 13:56:24.769128 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 411/801] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 15 13:56:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 13:56:25.061499 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-036b483a-f22b-4ac3-8b8f-188139247224 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:56:25.062772 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-036b483a-f22b-4ac3-8b8f-188139247224 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] [instance: 1413aaed-46c7-4807-9d3b-957616dd4047] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:56:25.069421 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-036b483a-f22b-4ac3-8b8f-188139247224 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:56:25.070009 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-036b483a-f22b-4ac3-8b8f-188139247224 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:56:25.070599 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-036b483a-f22b-4ac3-8b8f-188139247224 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:56:25.071385 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-036b483a-f22b-4ac3-8b8f-188139247224 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:56:25.071859 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-036b483a-f22b-4ac3-8b8f-188139247224 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:56:25.072382 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-036b483a-f22b-4ac3-8b8f-188139247224 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:56:25.220812 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-036b483a-f22b-4ac3-8b8f-188139247224 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e530c3f544748bd3ffc256b1630b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a6be8e43c7742be84f4dc3c95a990e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:56:25.229628 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-036b483a-f22b-4ac3-8b8f-188139247224 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] 10.222.0.36 "GET /compute/v2.1/servers/1413aaed-46c7-4807-9d3b-957616dd4047" status: 200 len: 1568 microversion: 2.1 time: 0.172700 Oct 15 13:56:25.230335 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 391/802] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:56:25 2022] GET /compute/v2.1/servers/1413aaed-46c7-4807-9d3b-957616dd4047 => generated 1568 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:56:25.454899 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-3c5aa79e-6948-4de7-8096-7fe85e1fadf2 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:56:25.459067 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-3c5aa79e-6948-4de7-8096-7fe85e1fadf2 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] [instance: cb269dd0-b5af-4013-9ded-062f40176b8f] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:56:25.466018 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-3c5aa79e-6948-4de7-8096-7fe85e1fadf2 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:56:25.466852 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-3c5aa79e-6948-4de7-8096-7fe85e1fadf2 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:56:25.467502 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-3c5aa79e-6948-4de7-8096-7fe85e1fadf2 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:56:25.468469 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-3c5aa79e-6948-4de7-8096-7fe85e1fadf2 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:56:25.469118 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-3c5aa79e-6948-4de7-8096-7fe85e1fadf2 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:56:25.469766 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-3c5aa79e-6948-4de7-8096-7fe85e1fadf2 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:56:25.504806 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-3c5aa79e-6948-4de7-8096-7fe85e1fadf2 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:56:25.505323 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-3c5aa79e-6948-4de7-8096-7fe85e1fadf2 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:56:25.506114 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-3c5aa79e-6948-4de7-8096-7fe85e1fadf2 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:56:25.506399 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.objects.instance [None req-3c5aa79e-6948-4de7-8096-7fe85e1fadf2 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lazy-loading 'fault' on Instance uuid cb269dd0-b5af-4013-9ded-062f40176b8f {{(pid=125242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 15 13:56:25.557511 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-3c5aa79e-6948-4de7-8096-7fe85e1fadf2 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5150c06020594efe957359f641eba5da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a0813bae074cd2aa552be82abe8493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:56:25.565255 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-3c5aa79e-6948-4de7-8096-7fe85e1fadf2 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] 10.222.0.36 "GET /compute/v2.1/servers/cb269dd0-b5af-4013-9ded-062f40176b8f" status: 200 len: 1335 microversion: 2.1 time: 0.115362 Oct 15 13:56:25.566068 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 412/803] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:56:25 2022] GET /compute/v2.1/servers/cb269dd0-b5af-4013-9ded-062f40176b8f => generated 1335 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:56:26.256128 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-d5430e4b-b6f5-4d6f-88bb-9a5f6066566a tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:56:26.256992 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-d5430e4b-b6f5-4d6f-88bb-9a5f6066566a tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] [instance: 1413aaed-46c7-4807-9d3b-957616dd4047] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:56:26.264240 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-d5430e4b-b6f5-4d6f-88bb-9a5f6066566a tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:56:26.264732 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-d5430e4b-b6f5-4d6f-88bb-9a5f6066566a tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:56:26.265173 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-d5430e4b-b6f5-4d6f-88bb-9a5f6066566a tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:56:26.265884 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-d5430e4b-b6f5-4d6f-88bb-9a5f6066566a tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:56:26.266338 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-d5430e4b-b6f5-4d6f-88bb-9a5f6066566a tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:56:26.266763 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-d5430e4b-b6f5-4d6f-88bb-9a5f6066566a tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:56:26.419899 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-d5430e4b-b6f5-4d6f-88bb-9a5f6066566a tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e530c3f544748bd3ffc256b1630b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a6be8e43c7742be84f4dc3c95a990e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:56:26.428924 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-d5430e4b-b6f5-4d6f-88bb-9a5f6066566a tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] 10.222.0.36 "GET /compute/v2.1/servers/1413aaed-46c7-4807-9d3b-957616dd4047" status: 200 len: 1568 microversion: 2.1 time: 0.176713 Oct 15 13:56:26.429551 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 392/804] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:56:26 2022] GET /compute/v2.1/servers/1413aaed-46c7-4807-9d3b-957616dd4047 => generated 1568 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:56:26.590945 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-adba0601-a030-4806-8452-def131b487d5 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:56:26.591593 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-adba0601-a030-4806-8452-def131b487d5 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] [instance: cb269dd0-b5af-4013-9ded-062f40176b8f] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:56:26.598714 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-adba0601-a030-4806-8452-def131b487d5 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:56:26.599218 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-adba0601-a030-4806-8452-def131b487d5 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:56:26.599656 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-adba0601-a030-4806-8452-def131b487d5 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:56:26.600490 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-adba0601-a030-4806-8452-def131b487d5 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:56:26.601205 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-adba0601-a030-4806-8452-def131b487d5 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:56:26.601791 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-adba0601-a030-4806-8452-def131b487d5 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:56:26.617768 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.wsgi [None req-adba0601-a030-4806-8452-def131b487d5 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] HTTP exception thrown: Instance cb269dd0-b5af-4013-9ded-062f40176b8f could not be found. Oct 15 13:56:26.619522 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-adba0601-a030-4806-8452-def131b487d5 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Request method failure captured: Oct 15 13:56:26.619522 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: request: GET /compute/v2.1/servers/cb269dd0-b5af-4013-9ded-062f40176b8f HTTP/1.1 Oct 15 13:56:26.619522 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Accept: application/json Oct 15 13:56:26.619522 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Accept-Encoding: identity Oct 15 13:56:26.619522 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Connection: close Oct 15 13:56:26.619522 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Content-Length: 0 Oct 15 13:56:26.619522 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Content-Type: application/json Oct 15 13:56:26.619522 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Host: 10.222.0.36 Oct 15 13:56:26.619522 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Openstack-System-Scope: None Oct 15 13:56:26.619522 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: User-Agent: python-urllib3/1.26.12 Oct 15 13:56:26.619522 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Auth-Token: gAAAAABjSrpDCbLnTEW_xEPAEWkhuHsRghFnNiYiSlFqABBnErC6h60c64D-HBU-sQLJ5OEFDKVHgv-ufGo5DM3852LBGobRbu9Cvywx7lBbDmHNFrYQMi7AZajfH_h200LKqYKwyZ50VzbOvILBgFaEam8UeQ6PXpFFptes7s3dL6W33wOCdG0 Oct 15 13:56:26.619522 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Domain-Id: None Oct 15 13:56:26.619522 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Domain-Name: None Oct 15 13:56:26.619522 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Identity-Status: Confirmed Oct 15 13:56:26.619522 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Is-Admin-Project: True Oct 15 13:56:26.619522 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Project-Domain-Id: default Oct 15 13:56:26.619522 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Project-Domain-Name: Default Oct 15 13:56:26.619522 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Project-Id: 09a0813bae074cd2aa552be82abe8493 Oct 15 13:56:26.619522 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1946714780 Oct 15 13:56:26.619522 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Role: member,reader Oct 15 13:56:26.619522 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Roles: member,reader Oct 15 13:56:26.621069 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_09a0813bae074cd2aa552be82abe8493", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/09a0813bae074cd2aa552be82abe8493"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/09a0813bae074cd2aa552be82abe8493"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/09a0813bae074cd2aa552be82abe8493"}]}] Oct 15 13:56:26.621069 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1946714780 Oct 15 13:56:26.621069 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Tenant-Id: 09a0813bae074cd2aa552be82abe8493 Oct 15 13:56:26.621069 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1946714780 Oct 15 13:56:26.621069 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-User: tempest-ServerRescueNegativeTestJSON-1946714780-project Oct 15 13:56:26.621069 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-User-Domain-Id: default Oct 15 13:56:26.621069 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-User-Domain-Name: Default Oct 15 13:56:26.621069 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-User-Id: 5150c06020594efe957359f641eba5da Oct 15 13:56:26.621069 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1946714780-project Oct 15 13:56:26.621069 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: method: > Oct 15 13:56:26.621069 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: exception: Instance cb269dd0-b5af-4013-9ded-062f40176b8f could not be found. Oct 15 13:56:26.621069 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: action_args: {'id': 'cb269dd0-b5af-4013-9ded-062f40176b8f'} Oct 15 13:56:26.621911 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 15 13:56:26.621911 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 13:56:26.621911 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 15 13:56:26.621911 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 15 13:56:26.621911 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 15 13:56:26.621911 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 15 13:56:26.621911 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 15 13:56:26.621911 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 15 13:56:26.621911 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 15 13:56:26.621911 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 15 13:56:26.621911 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb269dd0-b5af-4013-9ded-062f40176b8f could not be found. Oct 15 13:56:26.621911 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Oct 15 13:56:26.621911 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 13:56:26.621911 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Oct 15 13:56:26.621911 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 13:56:26.621911 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 13:56:26.621911 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 13:56:26.621911 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 15 13:56:26.621911 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 15 13:56:26.621911 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 15 13:56:26.623786 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 15 13:56:26.623786 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 15 13:56:26.623786 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 15 13:56:26.623786 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 15 13:56:26.623786 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 15 13:56:26.623786 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 15 13:56:26.623786 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 15 13:56:26.623786 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb269dd0-b5af-4013-9ded-062f40176b8f could not be found. Oct 15 13:56:26.623786 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Oct 15 13:56:26.623786 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 13:56:26.623786 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Oct 15 13:56:26.623786 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 13:56:26.623786 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 13:56:26.623786 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 13:56:26.623786 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 15 13:56:26.623786 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 15 13:56:26.623786 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb269dd0-b5af-4013-9ded-062f40176b8f could not be found. Oct 15 13:56:26.623786 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Oct 15 13:56:26.625379 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-adba0601-a030-4806-8452-def131b487d5 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Returning 404 to user: Instance cb269dd0-b5af-4013-9ded-062f40176b8f could not be found. {{(pid=125242) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 15 13:56:26.625379 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-adba0601-a030-4806-8452-def131b487d5 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] 10.222.0.36 "GET /compute/v2.1/servers/cb269dd0-b5af-4013-9ded-062f40176b8f" status: 404 len: 111 microversion: 2.1 time: 0.034148 Oct 15 13:56:26.625379 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 413/805] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:56:26 2022] GET /compute/v2.1/servers/cb269dd0-b5af-4013-9ded-062f40176b8f => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 15 13:56:26.630474 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-c57624d5-94cf-40a6-8256-e50906720585 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Calling method '.version_select at 0x7f1b5e2371f0>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:56:26.654905 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-c57624d5-94cf-40a6-8256-e50906720585 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-835936382" status: 202 len: 0 microversion: 2.1 time: 0.028292 Oct 15 13:56:26.655662 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 393/806] 10.222.0.36 () {58 vars in 1218 bytes} [Sat Oct 15 13:56:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-835936382 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 15 13:56:27.268454 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-12f553cb-0232-4deb-8102-0869acd11e33 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:56:27.270732 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-12f553cb-0232-4deb-8102-0869acd11e33 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] [instance: 40d67d09-379e-4c12-b36c-21edf3b23e45] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:56:27.277612 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-12f553cb-0232-4deb-8102-0869acd11e33 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:56:27.278102 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-12f553cb-0232-4deb-8102-0869acd11e33 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:56:27.278730 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-12f553cb-0232-4deb-8102-0869acd11e33 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:56:27.279438 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-12f553cb-0232-4deb-8102-0869acd11e33 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:56:27.279902 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-12f553cb-0232-4deb-8102-0869acd11e33 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:56:27.280355 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-12f553cb-0232-4deb-8102-0869acd11e33 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:56:27.315197 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-12f553cb-0232-4deb-8102-0869acd11e33 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] 10.222.0.36 "GET /compute/v2.1/servers/40d67d09-379e-4c12-b36c-21edf3b23e45/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051095 Oct 15 13:56:27.316231 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 414/807] 10.222.0.36 () {58 vars in 1302 bytes} [Sat Oct 15 13:56:27 2022] GET /compute/v2.1/servers/40d67d09-379e-4c12-b36c-21edf3b23e45/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 15 13:56:27.386288 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-27c5dd01-8c12-49e0-9421-203e2e5914cb tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:56:27.386812 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-27c5dd01-8c12-49e0-9421-203e2e5914cb tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] [instance: 40d67d09-379e-4c12-b36c-21edf3b23e45] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:56:27.394699 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-27c5dd01-8c12-49e0-9421-203e2e5914cb tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:56:27.395210 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-27c5dd01-8c12-49e0-9421-203e2e5914cb tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:56:27.395654 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-27c5dd01-8c12-49e0-9421-203e2e5914cb tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:56:27.396393 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-27c5dd01-8c12-49e0-9421-203e2e5914cb tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:56:27.396870 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-27c5dd01-8c12-49e0-9421-203e2e5914cb tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:56:27.397687 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-27c5dd01-8c12-49e0-9421-203e2e5914cb tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:56:27.427812 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-27c5dd01-8c12-49e0-9421-203e2e5914cb tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] [instance: 40d67d09-379e-4c12-b36c-21edf3b23e45] Going to try to terminate instance {{(pid=125243) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 15 13:56:27.464467 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-4f927b85-67d9-41f5-89ec-025340a0378c tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:56:27.465041 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG dbcounter [-] [125243] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=125243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:56:27.466150 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-4f927b85-67d9-41f5-89ec-025340a0378c tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] [instance: 1413aaed-46c7-4807-9d3b-957616dd4047] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:56:27.476642 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-4f927b85-67d9-41f5-89ec-025340a0378c tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:56:27.477436 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-4f927b85-67d9-41f5-89ec-025340a0378c tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:56:27.478202 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-4f927b85-67d9-41f5-89ec-025340a0378c tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:56:27.479437 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-4f927b85-67d9-41f5-89ec-025340a0378c tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:56:27.480339 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-4f927b85-67d9-41f5-89ec-025340a0378c tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:56:27.481445 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-4f927b85-67d9-41f5-89ec-025340a0378c tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:56:27.519042 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-27c5dd01-8c12-49e0-9421-203e2e5914cb tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] 10.222.0.36 "DELETE /compute/v2.1/servers/40d67d09-379e-4c12-b36c-21edf3b23e45" status: 204 len: 0 microversion: 2.1 time: 0.137549 Oct 15 13:56:27.523689 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 394/808] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 15 13:56:27 2022] DELETE /compute/v2.1/servers/40d67d09-379e-4c12-b36c-21edf3b23e45 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 15 13:56:27.530457 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-6c65691b-2adf-4153-aa81-0017c3d79fb6 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:56:27.531198 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-6c65691b-2adf-4153-aa81-0017c3d79fb6 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] [instance: 40d67d09-379e-4c12-b36c-21edf3b23e45] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:56:27.538074 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-6c65691b-2adf-4153-aa81-0017c3d79fb6 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:56:27.538646 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-6c65691b-2adf-4153-aa81-0017c3d79fb6 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:56:27.539078 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-6c65691b-2adf-4153-aa81-0017c3d79fb6 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:56:27.539801 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-6c65691b-2adf-4153-aa81-0017c3d79fb6 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:56:27.540274 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-6c65691b-2adf-4153-aa81-0017c3d79fb6 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:56:27.540691 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-6c65691b-2adf-4153-aa81-0017c3d79fb6 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:56:27.724561 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-4f927b85-67d9-41f5-89ec-025340a0378c tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e530c3f544748bd3ffc256b1630b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a6be8e43c7742be84f4dc3c95a990e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:56:27.735684 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-4f927b85-67d9-41f5-89ec-025340a0378c tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] 10.222.0.36 "GET /compute/v2.1/servers/1413aaed-46c7-4807-9d3b-957616dd4047" status: 200 len: 1568 microversion: 2.1 time: 0.278431 Oct 15 13:56:27.737428 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 415/809] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:56:27 2022] GET /compute/v2.1/servers/1413aaed-46c7-4807-9d3b-957616dd4047 => generated 1568 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 13:56:27.750292 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-6c65691b-2adf-4153-aa81-0017c3d79fb6 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583cce1547144e11978f20a3193ceba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f8b5024a194f70a9f7689ac44ab07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:56:27.765523 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-6c65691b-2adf-4153-aa81-0017c3d79fb6 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] 10.222.0.36 "GET /compute/v2.1/servers/40d67d09-379e-4c12-b36c-21edf3b23e45" status: 200 len: 1675 microversion: 2.1 time: 0.239761 Oct 15 13:56:27.767326 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 395/810] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:56:27 2022] GET /compute/v2.1/servers/40d67d09-379e-4c12-b36c-21edf3b23e45 => generated 1675 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 13:56:28.773735 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-d6cb4348-f9b6-4e89-8f3d-8d658fe78df6 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:56:28.774366 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-d6cb4348-f9b6-4e89-8f3d-8d658fe78df6 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] [instance: 1413aaed-46c7-4807-9d3b-957616dd4047] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:56:28.781240 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-d6cb4348-f9b6-4e89-8f3d-8d658fe78df6 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:56:28.781753 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-d6cb4348-f9b6-4e89-8f3d-8d658fe78df6 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:56:28.782198 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-d6cb4348-f9b6-4e89-8f3d-8d658fe78df6 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:56:28.782922 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-d6cb4348-f9b6-4e89-8f3d-8d658fe78df6 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:56:28.783381 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-d6cb4348-f9b6-4e89-8f3d-8d658fe78df6 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:56:28.783805 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-d6cb4348-f9b6-4e89-8f3d-8d658fe78df6 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:56:28.798698 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-b36ab13d-a3c3-4171-9430-bfd3b285425b tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:56:28.799810 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-b36ab13d-a3c3-4171-9430-bfd3b285425b tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] [instance: 40d67d09-379e-4c12-b36c-21edf3b23e45] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:56:28.812939 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-b36ab13d-a3c3-4171-9430-bfd3b285425b tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:56:28.813444 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-b36ab13d-a3c3-4171-9430-bfd3b285425b tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:56:28.813953 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-b36ab13d-a3c3-4171-9430-bfd3b285425b tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:56:28.814943 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-b36ab13d-a3c3-4171-9430-bfd3b285425b tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:56:28.815407 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-b36ab13d-a3c3-4171-9430-bfd3b285425b tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:56:28.815915 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-b36ab13d-a3c3-4171-9430-bfd3b285425b tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:56:29.000746 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-d6cb4348-f9b6-4e89-8f3d-8d658fe78df6 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e530c3f544748bd3ffc256b1630b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a6be8e43c7742be84f4dc3c95a990e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:56:29.008697 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-b36ab13d-a3c3-4171-9430-bfd3b285425b tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583cce1547144e11978f20a3193ceba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f8b5024a194f70a9f7689ac44ab07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:56:29.010490 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-d6cb4348-f9b6-4e89-8f3d-8d658fe78df6 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] 10.222.0.36 "GET /compute/v2.1/servers/1413aaed-46c7-4807-9d3b-957616dd4047" status: 200 len: 1568 microversion: 2.1 time: 0.241676 Oct 15 13:56:29.011088 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 416/811] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:56:28 2022] GET /compute/v2.1/servers/1413aaed-46c7-4807-9d3b-957616dd4047 => generated 1568 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:56:29.017437 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-b36ab13d-a3c3-4171-9430-bfd3b285425b tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] 10.222.0.36 "GET /compute/v2.1/servers/40d67d09-379e-4c12-b36c-21edf3b23e45" status: 200 len: 1675 microversion: 2.1 time: 0.228887 Oct 15 13:56:29.017991 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 396/812] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:56:28 2022] GET /compute/v2.1/servers/40d67d09-379e-4c12-b36c-21edf3b23e45 => generated 1675 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:56:29.678974 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-aaf545f4-7e87-4a1a-8a6c-22b869e27182 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:56:29.680128 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-aaf545f4-7e87-4a1a-8a6c-22b869e27182 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] [instance: a8976a74-703a-4fa4-9cc7-760a3e3f226b] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:56:29.689679 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-aaf545f4-7e87-4a1a-8a6c-22b869e27182 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:56:29.690551 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-aaf545f4-7e87-4a1a-8a6c-22b869e27182 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:56:29.690876 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-aaf545f4-7e87-4a1a-8a6c-22b869e27182 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:56:29.691622 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-aaf545f4-7e87-4a1a-8a6c-22b869e27182 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:56:29.692116 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-aaf545f4-7e87-4a1a-8a6c-22b869e27182 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:56:29.692579 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-aaf545f4-7e87-4a1a-8a6c-22b869e27182 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:56:29.722806 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-aaf545f4-7e87-4a1a-8a6c-22b869e27182 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] [instance: a8976a74-703a-4fa4-9cc7-760a3e3f226b] Going to try to terminate instance {{(pid=125242) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 15 13:56:29.740602 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG dbcounter [-] [125242] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:56:29.828853 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-aaf545f4-7e87-4a1a-8a6c-22b869e27182 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] 10.222.0.36 "DELETE /compute/v2.1/servers/a8976a74-703a-4fa4-9cc7-760a3e3f226b" status: 204 len: 0 microversion: 2.1 time: 0.155989 Oct 15 13:56:29.830157 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 417/813] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 15 13:56:29 2022] DELETE /compute/v2.1/servers/a8976a74-703a-4fa4-9cc7-760a3e3f226b => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 15 13:56:29.841880 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-bb7d6363-1abb-491d-9bb1-c7436a9e30a3 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:56:29.843615 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-bb7d6363-1abb-491d-9bb1-c7436a9e30a3 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] [instance: a8976a74-703a-4fa4-9cc7-760a3e3f226b] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:56:29.853271 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-bb7d6363-1abb-491d-9bb1-c7436a9e30a3 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:56:29.853771 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-bb7d6363-1abb-491d-9bb1-c7436a9e30a3 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:56:29.854204 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-bb7d6363-1abb-491d-9bb1-c7436a9e30a3 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:56:29.854923 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-bb7d6363-1abb-491d-9bb1-c7436a9e30a3 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:56:29.855381 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-bb7d6363-1abb-491d-9bb1-c7436a9e30a3 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:56:29.856187 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-bb7d6363-1abb-491d-9bb1-c7436a9e30a3 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:56:30.037087 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-24b919cb-af5d-42a5-9642-aabd0ba1f19e tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:56:30.038258 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-24b919cb-af5d-42a5-9642-aabd0ba1f19e tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] [instance: 1413aaed-46c7-4807-9d3b-957616dd4047] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:56:30.045271 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-24b919cb-af5d-42a5-9642-aabd0ba1f19e tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:56:30.046047 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-24b919cb-af5d-42a5-9642-aabd0ba1f19e tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:56:30.046483 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-24b919cb-af5d-42a5-9642-aabd0ba1f19e tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:56:30.047220 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-24b919cb-af5d-42a5-9642-aabd0ba1f19e tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:56:30.047679 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-24b919cb-af5d-42a5-9642-aabd0ba1f19e tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:56:30.048136 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-24b919cb-af5d-42a5-9642-aabd0ba1f19e tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:56:30.098467 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-bb7d6363-1abb-491d-9bb1-c7436a9e30a3 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5150c06020594efe957359f641eba5da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a0813bae074cd2aa552be82abe8493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:56:30.116895 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-bb7d6363-1abb-491d-9bb1-c7436a9e30a3 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] 10.222.0.36 "GET /compute/v2.1/servers/a8976a74-703a-4fa4-9cc7-760a3e3f226b" status: 200 len: 1507 microversion: 2.1 time: 0.281305 Oct 15 13:56:30.117550 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 397/814] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:56:29 2022] GET /compute/v2.1/servers/a8976a74-703a-4fa4-9cc7-760a3e3f226b => generated 1507 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 13:56:30.122424 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-7d15537d-4d47-472d-a411-1b28891cf712 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:56:30.123578 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-7d15537d-4d47-472d-a411-1b28891cf712 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] [instance: 40d67d09-379e-4c12-b36c-21edf3b23e45] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:56:30.130268 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-7d15537d-4d47-472d-a411-1b28891cf712 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:56:30.131003 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-7d15537d-4d47-472d-a411-1b28891cf712 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:56:30.131621 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-7d15537d-4d47-472d-a411-1b28891cf712 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:56:30.132614 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-7d15537d-4d47-472d-a411-1b28891cf712 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:56:30.133488 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-7d15537d-4d47-472d-a411-1b28891cf712 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:56:30.134146 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-7d15537d-4d47-472d-a411-1b28891cf712 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:56:30.250796 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-7d15537d-4d47-472d-a411-1b28891cf712 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583cce1547144e11978f20a3193ceba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f8b5024a194f70a9f7689ac44ab07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:56:30.262771 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-7d15537d-4d47-472d-a411-1b28891cf712 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] 10.222.0.36 "GET /compute/v2.1/servers/40d67d09-379e-4c12-b36c-21edf3b23e45" status: 200 len: 1323 microversion: 2.1 time: 0.144041 Oct 15 13:56:30.263921 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 398/815] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:56:30 2022] GET /compute/v2.1/servers/40d67d09-379e-4c12-b36c-21edf3b23e45 => generated 1323 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:56:30.271907 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [req-0015c6dc-2973-469a-81b6-ae36b9a35edf req-15c522bf-cdc2-415e-9d37-2e33c99a94ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40d67d09-379e-4c12-b36c-21edf3b23e45", "name": "network-vif-deleted", "tag": "00b42a41-b63e-414a-944b-f58697650617"}]} {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 13:56:30.285982 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [req-0015c6dc-2973-469a-81b6-ae36b9a35edf req-15c522bf-cdc2-415e-9d37-2e33c99a94ee service nova] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:56:30.287058 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [req-0015c6dc-2973-469a-81b6-ae36b9a35edf req-15c522bf-cdc2-415e-9d37-2e33c99a94ee service nova] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:56:30.288057 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [req-0015c6dc-2973-469a-81b6-ae36b9a35edf req-15c522bf-cdc2-415e-9d37-2e33c99a94ee service nova] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:56:30.307274 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.compute.server_external_events [req-0015c6dc-2973-469a-81b6-ae36b9a35edf req-15c522bf-cdc2-415e-9d37-2e33c99a94ee service nova] Creating event network-vif-deleted:00b42a41-b63e-414a-944b-f58697650617 for instance 40d67d09-379e-4c12-b36c-21edf3b23e45 on hv-cinder-86149 Oct 15 13:56:30.313896 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [req-0015c6dc-2973-469a-81b6-ae36b9a35edf req-15c522bf-cdc2-415e-9d37-2e33c99a94ee service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048045 Oct 15 13:56:30.315379 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 399/816] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 15 13:56:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 13:56:30.343339 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-24b919cb-af5d-42a5-9642-aabd0ba1f19e tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e530c3f544748bd3ffc256b1630b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a6be8e43c7742be84f4dc3c95a990e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:56:30.360738 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-24b919cb-af5d-42a5-9642-aabd0ba1f19e tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] 10.222.0.36 "GET /compute/v2.1/servers/1413aaed-46c7-4807-9d3b-957616dd4047" status: 200 len: 1568 microversion: 2.1 time: 0.327959 Oct 15 13:56:30.361571 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 418/817] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:56:30 2022] GET /compute/v2.1/servers/1413aaed-46c7-4807-9d3b-957616dd4047 => generated 1568 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 13:56:31.147290 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-e0d2b22e-61a2-42da-b63b-bf522ee85664 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:56:31.149144 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-e0d2b22e-61a2-42da-b63b-bf522ee85664 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] [instance: a8976a74-703a-4fa4-9cc7-760a3e3f226b] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:56:31.162510 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-e0d2b22e-61a2-42da-b63b-bf522ee85664 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:56:31.164681 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-e0d2b22e-61a2-42da-b63b-bf522ee85664 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:56:31.165249 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-e0d2b22e-61a2-42da-b63b-bf522ee85664 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:56:31.165982 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-e0d2b22e-61a2-42da-b63b-bf522ee85664 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:56:31.166525 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-e0d2b22e-61a2-42da-b63b-bf522ee85664 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:56:31.166984 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-e0d2b22e-61a2-42da-b63b-bf522ee85664 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:56:31.299271 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-11eaede6-652a-4526-8639-b9191f8276f0 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:56:31.300654 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-11eaede6-652a-4526-8639-b9191f8276f0 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] [instance: 40d67d09-379e-4c12-b36c-21edf3b23e45] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:56:31.308425 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-11eaede6-652a-4526-8639-b9191f8276f0 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:56:31.309297 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-11eaede6-652a-4526-8639-b9191f8276f0 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:56:31.309951 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-11eaede6-652a-4526-8639-b9191f8276f0 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:56:31.310905 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-11eaede6-652a-4526-8639-b9191f8276f0 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:56:31.311586 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-11eaede6-652a-4526-8639-b9191f8276f0 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:56:31.312065 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-11eaede6-652a-4526-8639-b9191f8276f0 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:56:31.333891 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.wsgi [None req-11eaede6-652a-4526-8639-b9191f8276f0 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] HTTP exception thrown: Instance 40d67d09-379e-4c12-b36c-21edf3b23e45 could not be found. Oct 15 13:56:31.335647 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-11eaede6-652a-4526-8639-b9191f8276f0 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Request method failure captured: Oct 15 13:56:31.335647 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: request: GET /compute/v2.1/servers/40d67d09-379e-4c12-b36c-21edf3b23e45 HTTP/1.1 Oct 15 13:56:31.335647 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Accept: application/json Oct 15 13:56:31.335647 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Accept-Encoding: identity Oct 15 13:56:31.335647 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Connection: close Oct 15 13:56:31.335647 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Content-Length: 0 Oct 15 13:56:31.335647 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Content-Type: application/json Oct 15 13:56:31.335647 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Host: 10.222.0.36 Oct 15 13:56:31.335647 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Openstack-System-Scope: None Oct 15 13:56:31.335647 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: User-Agent: python-urllib3/1.26.12 Oct 15 13:56:31.335647 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Auth-Token: gAAAAABjSrpEAEOvDYjQezlGXzh6XU2_Vl1KBLwmS9gwC61GtyVLxYlkshQyDPE_sOvB3OtB_cqctzpwbfjy2ZDsnCTYXEb6mgK25wVyiDmdp0o_CExIrnzjNhyInosPlpO2f8fIz0chymblvX9P3h-X24ZWwfGBe-8aG83eRywSSE77yc5-RNk Oct 15 13:56:31.335647 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Domain-Id: None Oct 15 13:56:31.335647 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Domain-Name: None Oct 15 13:56:31.335647 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Identity-Status: Confirmed Oct 15 13:56:31.335647 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Is-Admin-Project: True Oct 15 13:56:31.335647 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Project-Domain-Id: default Oct 15 13:56:31.335647 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Project-Domain-Name: Default Oct 15 13:56:31.335647 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Project-Id: 35f8b5024a194f70a9f7689ac44ab07b Oct 15 13:56:31.335647 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Project-Name: tempest-AttachVolumeTestJSON-908525129 Oct 15 13:56:31.335647 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Role: member,reader Oct 15 13:56:31.335647 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Roles: member,reader Oct 15 13:56:31.337651 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_35f8b5024a194f70a9f7689ac44ab07b", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/35f8b5024a194f70a9f7689ac44ab07b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/35f8b5024a194f70a9f7689ac44ab07b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/35f8b5024a194f70a9f7689ac44ab07b"}]}] Oct 15 13:56:31.337651 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Tenant: tempest-AttachVolumeTestJSON-908525129 Oct 15 13:56:31.337651 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Tenant-Id: 35f8b5024a194f70a9f7689ac44ab07b Oct 15 13:56:31.337651 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Tenant-Name: tempest-AttachVolumeTestJSON-908525129 Oct 15 13:56:31.337651 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-User: tempest-AttachVolumeTestJSON-908525129-project Oct 15 13:56:31.337651 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-User-Domain-Id: default Oct 15 13:56:31.337651 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-User-Domain-Name: Default Oct 15 13:56:31.337651 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-User-Id: 583cce1547144e11978f20a3193ceba4 Oct 15 13:56:31.337651 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-User-Name: tempest-AttachVolumeTestJSON-908525129-project Oct 15 13:56:31.337651 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: method: > Oct 15 13:56:31.337651 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: exception: Instance 40d67d09-379e-4c12-b36c-21edf3b23e45 could not be found. Oct 15 13:56:31.337651 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: action_args: {'id': '40d67d09-379e-4c12-b36c-21edf3b23e45'} Oct 15 13:56:31.339127 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 15 13:56:31.339127 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 13:56:31.339127 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 15 13:56:31.339127 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 15 13:56:31.339127 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 15 13:56:31.339127 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 15 13:56:31.339127 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 15 13:56:31.339127 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 15 13:56:31.339127 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 15 13:56:31.339127 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 15 13:56:31.339127 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40d67d09-379e-4c12-b36c-21edf3b23e45 could not be found. Oct 15 13:56:31.339127 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Oct 15 13:56:31.339127 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 13:56:31.339127 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Oct 15 13:56:31.339127 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 13:56:31.339127 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 13:56:31.339127 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 13:56:31.339127 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 15 13:56:31.339127 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 15 13:56:31.339127 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 15 13:56:31.340407 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 15 13:56:31.340407 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 15 13:56:31.340407 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 15 13:56:31.340407 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 15 13:56:31.340407 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 15 13:56:31.340407 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 15 13:56:31.340407 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 15 13:56:31.340407 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40d67d09-379e-4c12-b36c-21edf3b23e45 could not be found. Oct 15 13:56:31.340407 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Oct 15 13:56:31.340407 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 13:56:31.340407 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Oct 15 13:56:31.340407 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 13:56:31.340407 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 13:56:31.340407 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 13:56:31.340407 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 15 13:56:31.340407 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 15 13:56:31.340407 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40d67d09-379e-4c12-b36c-21edf3b23e45 could not be found. Oct 15 13:56:31.340407 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Oct 15 13:56:31.342330 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-11eaede6-652a-4526-8639-b9191f8276f0 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Returning 404 to user: Instance 40d67d09-379e-4c12-b36c-21edf3b23e45 could not be found. {{(pid=125242) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 15 13:56:31.342330 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-11eaede6-652a-4526-8639-b9191f8276f0 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] 10.222.0.36 "GET /compute/v2.1/servers/40d67d09-379e-4c12-b36c-21edf3b23e45" status: 404 len: 111 microversion: 2.1 time: 0.042989 Oct 15 13:56:31.342330 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 419/818] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:56:31 2022] GET /compute/v2.1/servers/40d67d09-379e-4c12-b36c-21edf3b23e45 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 15 13:56:31.349195 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-570d49cf-f016-4779-9193-5d7f804fac1a tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Calling method '.version_select at 0x7f1b5e2db940>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:56:31.399118 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-570d49cf-f016-4779-9193-5d7f804fac1a tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1788976729" status: 202 len: 0 microversion: 2.1 time: 0.053895 Oct 15 13:56:31.400116 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 420/819] 10.222.0.36 () {58 vars in 1221 bytes} [Sat Oct 15 13:56:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1788976729 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 15 13:56:31.406956 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-8c990372-3ba6-4901-86f7-b674790ce7fc tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:56:31.408002 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-8c990372-3ba6-4901-86f7-b674790ce7fc tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] [instance: 1413aaed-46c7-4807-9d3b-957616dd4047] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:56:31.417369 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-8c990372-3ba6-4901-86f7-b674790ce7fc tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:56:31.418347 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-8c990372-3ba6-4901-86f7-b674790ce7fc tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:56:31.419112 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-8c990372-3ba6-4901-86f7-b674790ce7fc tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:56:31.420063 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-8c990372-3ba6-4901-86f7-b674790ce7fc tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:56:31.420815 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-8c990372-3ba6-4901-86f7-b674790ce7fc tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:56:31.421430 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-8c990372-3ba6-4901-86f7-b674790ce7fc tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:56:31.424549 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-e0d2b22e-61a2-42da-b63b-bf522ee85664 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5150c06020594efe957359f641eba5da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a0813bae074cd2aa552be82abe8493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:56:31.437438 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-e0d2b22e-61a2-42da-b63b-bf522ee85664 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] 10.222.0.36 "GET /compute/v2.1/servers/a8976a74-703a-4fa4-9cc7-760a3e3f226b" status: 200 len: 1507 microversion: 2.1 time: 0.294841 Oct 15 13:56:31.441329 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 400/820] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:56:31 2022] GET /compute/v2.1/servers/a8976a74-703a-4fa4-9cc7-760a3e3f226b => generated 1507 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:56:31.739712 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-8c990372-3ba6-4901-86f7-b674790ce7fc tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e530c3f544748bd3ffc256b1630b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a6be8e43c7742be84f4dc3c95a990e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:56:31.751782 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-8c990372-3ba6-4901-86f7-b674790ce7fc tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] 10.222.0.36 "GET /compute/v2.1/servers/1413aaed-46c7-4807-9d3b-957616dd4047" status: 200 len: 1568 microversion: 2.1 time: 0.350250 Oct 15 13:56:31.753528 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 421/821] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:56:31 2022] GET /compute/v2.1/servers/1413aaed-46c7-4807-9d3b-957616dd4047 => generated 1568 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:56:32.336297 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [req-efcd94e3-6671-4fa6-ada4-84c20195e8d9 req-db3a9773-542f-487f-813b-9d3578ba21d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8976a74-703a-4fa4-9cc7-760a3e3f226b", "name": "network-vif-deleted", "tag": "5141cb8c-0fe9-45ee-84cc-9c59a65bca83"}]} {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 13:56:32.346433 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [req-efcd94e3-6671-4fa6-ada4-84c20195e8d9 req-db3a9773-542f-487f-813b-9d3578ba21d0 service nova] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:56:32.346911 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [req-efcd94e3-6671-4fa6-ada4-84c20195e8d9 req-db3a9773-542f-487f-813b-9d3578ba21d0 service nova] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:56:32.347339 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [req-efcd94e3-6671-4fa6-ada4-84c20195e8d9 req-db3a9773-542f-487f-813b-9d3578ba21d0 service nova] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:56:32.363437 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.compute.server_external_events [req-efcd94e3-6671-4fa6-ada4-84c20195e8d9 req-db3a9773-542f-487f-813b-9d3578ba21d0 service nova] Creating event network-vif-deleted:5141cb8c-0fe9-45ee-84cc-9c59a65bca83 for instance a8976a74-703a-4fa4-9cc7-760a3e3f226b on hv-cinder-86149 Oct 15 13:56:32.371341 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [req-efcd94e3-6671-4fa6-ada4-84c20195e8d9 req-db3a9773-542f-487f-813b-9d3578ba21d0 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040739 Oct 15 13:56:32.372287 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 401/822] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 15 13:56:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 15 13:56:32.465838 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-d10661fe-df8b-40e2-8ef2-080f6e296e99 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:56:32.467039 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-d10661fe-df8b-40e2-8ef2-080f6e296e99 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] [instance: a8976a74-703a-4fa4-9cc7-760a3e3f226b] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:56:32.474014 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-d10661fe-df8b-40e2-8ef2-080f6e296e99 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:56:32.474519 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-d10661fe-df8b-40e2-8ef2-080f6e296e99 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:56:32.475023 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-d10661fe-df8b-40e2-8ef2-080f6e296e99 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:56:32.475797 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-d10661fe-df8b-40e2-8ef2-080f6e296e99 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:56:32.476285 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-d10661fe-df8b-40e2-8ef2-080f6e296e99 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:56:32.476842 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-d10661fe-df8b-40e2-8ef2-080f6e296e99 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:56:32.477345 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-d8f4de1e-9338-4146-9b30-0a4aae822d9c tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Action: 'create', calling method: .version_select at 0x7f1b5e1ee310>, body: {"keypair": {"name": "tempest-keypair-1992153869", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBcyMxz9i3Icy+FHC15EQPKemTEvR7PhpZ1bfrk+K0mQDLlCjJ8cVz2Etyh3BrM89kEeUrzzgScQKxxX6R1bhLaAOqeeZMov3NlONIZgN9NG3IlVqIwTOgJmYSHgC0DAaA=="}} {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 13:56:32.500234 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.quota [None req-d8f4de1e-9338-4146-9b30-0a4aae822d9c tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Getting quotas for project 35f8b5024a194f70a9f7689ac44ab07b. Resources: {'key_pairs'} {{(pid=125243) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 15 13:56:32.505003 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.quota [None req-d8f4de1e-9338-4146-9b30-0a4aae822d9c tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Getting quotas for user 583cce1547144e11978f20a3193ceba4 and project 35f8b5024a194f70a9f7689ac44ab07b. Resources: {'key_pairs'} {{(pid=125243) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 15 13:56:32.522902 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-d10661fe-df8b-40e2-8ef2-080f6e296e99 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:56:32.523651 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-d10661fe-df8b-40e2-8ef2-080f6e296e99 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:56:32.524204 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-d10661fe-df8b-40e2-8ef2-080f6e296e99 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:56:32.524818 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.objects.instance [None req-d10661fe-df8b-40e2-8ef2-080f6e296e99 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lazy-loading 'fault' on Instance uuid a8976a74-703a-4fa4-9cc7-760a3e3f226b {{(pid=125242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 15 13:56:32.534920 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-d8f4de1e-9338-4146-9b30-0a4aae822d9c tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.070092 Oct 15 13:56:32.535802 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 402/823] 10.222.0.36 () {60 vars in 1159 bytes} [Sat Oct 15 13:56:32 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 13:56:32.574811 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-d10661fe-df8b-40e2-8ef2-080f6e296e99 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5150c06020594efe957359f641eba5da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a0813bae074cd2aa552be82abe8493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:56:32.591433 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-d10661fe-df8b-40e2-8ef2-080f6e296e99 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] 10.222.0.36 "GET /compute/v2.1/servers/a8976a74-703a-4fa4-9cc7-760a3e3f226b" status: 200 len: 1311 microversion: 2.1 time: 0.129538 Oct 15 13:56:32.593021 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 422/824] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:56:32 2022] GET /compute/v2.1/servers/a8976a74-703a-4fa4-9cc7-760a3e3f226b => generated 1311 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:56:32.781134 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-4730c7bb-a259-4ad6-90e8-41d1a276efa5 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:56:32.782878 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-4730c7bb-a259-4ad6-90e8-41d1a276efa5 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] [instance: 1413aaed-46c7-4807-9d3b-957616dd4047] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:56:32.794635 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-4730c7bb-a259-4ad6-90e8-41d1a276efa5 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:56:32.795250 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-4730c7bb-a259-4ad6-90e8-41d1a276efa5 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:56:32.795683 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-4730c7bb-a259-4ad6-90e8-41d1a276efa5 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:56:32.797041 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-4730c7bb-a259-4ad6-90e8-41d1a276efa5 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:56:32.797924 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-4730c7bb-a259-4ad6-90e8-41d1a276efa5 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:56:32.799145 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-4730c7bb-a259-4ad6-90e8-41d1a276efa5 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:56:32.980184 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-4730c7bb-a259-4ad6-90e8-41d1a276efa5 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e530c3f544748bd3ffc256b1630b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a6be8e43c7742be84f4dc3c95a990e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:56:32.989232 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-4730c7bb-a259-4ad6-90e8-41d1a276efa5 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] 10.222.0.36 "GET /compute/v2.1/servers/1413aaed-46c7-4807-9d3b-957616dd4047" status: 200 len: 1568 microversion: 2.1 time: 0.212544 Oct 15 13:56:32.989828 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 403/825] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:56:32 2022] GET /compute/v2.1/servers/1413aaed-46c7-4807-9d3b-957616dd4047 => generated 1568 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:56:33.618796 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-5ed9e82d-8d69-4609-8300-cbd7207ab0f0 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:56:33.619823 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-5ed9e82d-8d69-4609-8300-cbd7207ab0f0 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] [instance: a8976a74-703a-4fa4-9cc7-760a3e3f226b] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:56:33.628768 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-5ed9e82d-8d69-4609-8300-cbd7207ab0f0 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:56:33.629475 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-5ed9e82d-8d69-4609-8300-cbd7207ab0f0 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:56:33.630065 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-5ed9e82d-8d69-4609-8300-cbd7207ab0f0 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:56:33.631054 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-5ed9e82d-8d69-4609-8300-cbd7207ab0f0 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:56:33.631812 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-5ed9e82d-8d69-4609-8300-cbd7207ab0f0 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:56:33.632539 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-5ed9e82d-8d69-4609-8300-cbd7207ab0f0 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:56:33.651638 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.wsgi [None req-5ed9e82d-8d69-4609-8300-cbd7207ab0f0 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] HTTP exception thrown: Instance a8976a74-703a-4fa4-9cc7-760a3e3f226b could not be found. Oct 15 13:56:33.654687 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-5ed9e82d-8d69-4609-8300-cbd7207ab0f0 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Request method failure captured: Oct 15 13:56:33.654687 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: request: GET /compute/v2.1/servers/a8976a74-703a-4fa4-9cc7-760a3e3f226b HTTP/1.1 Oct 15 13:56:33.654687 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Accept: application/json Oct 15 13:56:33.654687 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Accept-Encoding: identity Oct 15 13:56:33.654687 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Connection: close Oct 15 13:56:33.654687 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Content-Length: 0 Oct 15 13:56:33.654687 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Content-Type: application/json Oct 15 13:56:33.654687 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Host: 10.222.0.36 Oct 15 13:56:33.654687 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Openstack-System-Scope: None Oct 15 13:56:33.654687 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: User-Agent: python-urllib3/1.26.12 Oct 15 13:56:33.654687 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Auth-Token: gAAAAABjSrpDCbLnTEW_xEPAEWkhuHsRghFnNiYiSlFqABBnErC6h60c64D-HBU-sQLJ5OEFDKVHgv-ufGo5DM3852LBGobRbu9Cvywx7lBbDmHNFrYQMi7AZajfH_h200LKqYKwyZ50VzbOvILBgFaEam8UeQ6PXpFFptes7s3dL6W33wOCdG0 Oct 15 13:56:33.654687 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Domain-Id: None Oct 15 13:56:33.654687 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Domain-Name: None Oct 15 13:56:33.654687 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Identity-Status: Confirmed Oct 15 13:56:33.654687 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Is-Admin-Project: True Oct 15 13:56:33.654687 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Project-Domain-Id: default Oct 15 13:56:33.654687 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Project-Domain-Name: Default Oct 15 13:56:33.654687 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Project-Id: 09a0813bae074cd2aa552be82abe8493 Oct 15 13:56:33.654687 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1946714780 Oct 15 13:56:33.654687 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Role: member,reader Oct 15 13:56:33.654687 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Roles: member,reader Oct 15 13:56:33.657556 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_09a0813bae074cd2aa552be82abe8493", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/09a0813bae074cd2aa552be82abe8493"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/09a0813bae074cd2aa552be82abe8493"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/09a0813bae074cd2aa552be82abe8493"}]}] Oct 15 13:56:33.657556 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1946714780 Oct 15 13:56:33.657556 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Tenant-Id: 09a0813bae074cd2aa552be82abe8493 Oct 15 13:56:33.657556 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1946714780 Oct 15 13:56:33.657556 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-User: tempest-ServerRescueNegativeTestJSON-1946714780-project Oct 15 13:56:33.657556 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-User-Domain-Id: default Oct 15 13:56:33.657556 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-User-Domain-Name: Default Oct 15 13:56:33.657556 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-User-Id: 5150c06020594efe957359f641eba5da Oct 15 13:56:33.657556 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1946714780-project Oct 15 13:56:33.657556 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: method: > Oct 15 13:56:33.657556 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: exception: Instance a8976a74-703a-4fa4-9cc7-760a3e3f226b could not be found. Oct 15 13:56:33.657556 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: action_args: {'id': 'a8976a74-703a-4fa4-9cc7-760a3e3f226b'} Oct 15 13:56:33.658987 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 15 13:56:33.658987 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 13:56:33.658987 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 15 13:56:33.658987 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 15 13:56:33.658987 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 15 13:56:33.658987 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 15 13:56:33.658987 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 15 13:56:33.658987 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 15 13:56:33.658987 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 15 13:56:33.658987 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 15 13:56:33.658987 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8976a74-703a-4fa4-9cc7-760a3e3f226b could not be found. Oct 15 13:56:33.658987 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Oct 15 13:56:33.658987 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 13:56:33.658987 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Oct 15 13:56:33.658987 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 13:56:33.658987 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 13:56:33.658987 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 13:56:33.658987 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 15 13:56:33.658987 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 15 13:56:33.658987 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 15 13:56:33.661568 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 15 13:56:33.661568 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 15 13:56:33.661568 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 15 13:56:33.661568 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 15 13:56:33.661568 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 15 13:56:33.661568 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 15 13:56:33.661568 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 15 13:56:33.661568 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8976a74-703a-4fa4-9cc7-760a3e3f226b could not be found. Oct 15 13:56:33.661568 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Oct 15 13:56:33.661568 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 13:56:33.661568 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Oct 15 13:56:33.661568 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 13:56:33.661568 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 13:56:33.661568 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 13:56:33.661568 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 15 13:56:33.661568 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 15 13:56:33.661568 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8976a74-703a-4fa4-9cc7-760a3e3f226b could not be found. Oct 15 13:56:33.661568 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Oct 15 13:56:33.663904 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-5ed9e82d-8d69-4609-8300-cbd7207ab0f0 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Returning 404 to user: Instance a8976a74-703a-4fa4-9cc7-760a3e3f226b could not be found. {{(pid=125242) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 15 13:56:33.665957 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-5ed9e82d-8d69-4609-8300-cbd7207ab0f0 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] 10.222.0.36 "GET /compute/v2.1/servers/a8976a74-703a-4fa4-9cc7-760a3e3f226b" status: 404 len: 111 microversion: 2.1 time: 0.051661 Oct 15 13:56:33.667301 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 423/826] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:56:33 2022] GET /compute/v2.1/servers/a8976a74-703a-4fa4-9cc7-760a3e3f226b => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 15 13:56:33.679113 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-6579e5dd-9c1d-4fe2-8ad8-6f54024b5d71 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:56:33.680171 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-6579e5dd-9c1d-4fe2-8ad8-6f54024b5d71 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] [instance: 242ed9b0-fe03-4583-ad2f-4760e86d2031] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:56:33.690789 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-6579e5dd-9c1d-4fe2-8ad8-6f54024b5d71 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:56:33.691587 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-6579e5dd-9c1d-4fe2-8ad8-6f54024b5d71 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:56:33.692323 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-6579e5dd-9c1d-4fe2-8ad8-6f54024b5d71 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:56:33.693512 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-6579e5dd-9c1d-4fe2-8ad8-6f54024b5d71 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:56:33.694282 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-6579e5dd-9c1d-4fe2-8ad8-6f54024b5d71 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:56:33.694847 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-6579e5dd-9c1d-4fe2-8ad8-6f54024b5d71 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:56:33.735007 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-6579e5dd-9c1d-4fe2-8ad8-6f54024b5d71 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] [instance: 242ed9b0-fe03-4583-ad2f-4760e86d2031] Going to try to terminate instance {{(pid=125243) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 15 13:56:33.859180 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-6579e5dd-9c1d-4fe2-8ad8-6f54024b5d71 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] 10.222.0.36 "DELETE /compute/v2.1/servers/242ed9b0-fe03-4583-ad2f-4760e86d2031" status: 204 len: 0 microversion: 2.1 time: 0.186203 Oct 15 13:56:33.860160 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 404/827] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 15 13:56:33 2022] DELETE /compute/v2.1/servers/242ed9b0-fe03-4583-ad2f-4760e86d2031 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 15 13:56:33.876376 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-521caab7-6c39-4330-9084-9bad6933bd42 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:56:33.877331 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-521caab7-6c39-4330-9084-9bad6933bd42 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] [instance: 242ed9b0-fe03-4583-ad2f-4760e86d2031] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:56:33.888719 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-521caab7-6c39-4330-9084-9bad6933bd42 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:56:33.889360 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-521caab7-6c39-4330-9084-9bad6933bd42 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:56:33.890039 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-521caab7-6c39-4330-9084-9bad6933bd42 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:56:33.890804 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-521caab7-6c39-4330-9084-9bad6933bd42 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:56:33.891259 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-521caab7-6c39-4330-9084-9bad6933bd42 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:56:33.891970 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-521caab7-6c39-4330-9084-9bad6933bd42 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:56:34.021750 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-cb2b5767-0a37-4bf6-9d4f-010e1e661df9 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:56:34.023031 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-cb2b5767-0a37-4bf6-9d4f-010e1e661df9 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] [instance: 1413aaed-46c7-4807-9d3b-957616dd4047] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:56:34.036281 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-cb2b5767-0a37-4bf6-9d4f-010e1e661df9 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:56:34.037782 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-cb2b5767-0a37-4bf6-9d4f-010e1e661df9 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:56:34.038637 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-cb2b5767-0a37-4bf6-9d4f-010e1e661df9 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:56:34.040484 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-cb2b5767-0a37-4bf6-9d4f-010e1e661df9 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:56:34.041215 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-cb2b5767-0a37-4bf6-9d4f-010e1e661df9 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:56:34.042005 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-cb2b5767-0a37-4bf6-9d4f-010e1e661df9 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:56:34.137062 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-521caab7-6c39-4330-9084-9bad6933bd42 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5150c06020594efe957359f641eba5da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a0813bae074cd2aa552be82abe8493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:56:34.176228 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-521caab7-6c39-4330-9084-9bad6933bd42 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] 10.222.0.36 "GET /compute/v2.1/servers/242ed9b0-fe03-4583-ad2f-4760e86d2031" status: 200 len: 1523 microversion: 2.1 time: 0.308491 Oct 15 13:56:34.176228 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 424/828] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:56:33 2022] GET /compute/v2.1/servers/242ed9b0-fe03-4583-ad2f-4760e86d2031 => generated 1523 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:56:34.251198 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-cb2b5767-0a37-4bf6-9d4f-010e1e661df9 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e530c3f544748bd3ffc256b1630b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a6be8e43c7742be84f4dc3c95a990e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:56:34.268946 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-cb2b5767-0a37-4bf6-9d4f-010e1e661df9 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] 10.222.0.36 "GET /compute/v2.1/servers/1413aaed-46c7-4807-9d3b-957616dd4047" status: 200 len: 1568 microversion: 2.1 time: 0.256960 Oct 15 13:56:34.270132 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 405/829] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:56:34 2022] GET /compute/v2.1/servers/1413aaed-46c7-4807-9d3b-957616dd4047 => generated 1568 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:56:34.309301 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-b93589b2-e003-4ed3-a3ac-680bdcf223df tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-626504696", "imageRef": "26e64909-1cae-49ca-af5e-adea40c062d7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "429e755e-8108-4b4c-9eb4-bd9e6c7ffcca"}], "security_groups": [{"name": "tempest-securitygroup--1763697610"}], "key_name": "tempest-keypair-1992153869", "user_data": "}} {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 13:56:34.429633 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.network.neutron [None req-b93589b2-e003-4ed3-a3ac-680bdcf223df tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] validate_networks() for [('429e755e-8108-4b4c-9eb4-bd9e6c7ffcca', None, None, None, None, None)] {{(pid=125242) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 15 13:56:35.160934 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.virt.hardware [None req-b93589b2-e003-4ed3-a3ac-680bdcf223df tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Flavor limits 0:0:0 {{(pid=125242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 15 13:56:35.161782 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.virt.hardware [None req-b93589b2-e003-4ed3-a3ac-680bdcf223df tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Image limits 0:0:0 {{(pid=125242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 15 13:56:35.161782 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.virt.hardware [None req-b93589b2-e003-4ed3-a3ac-680bdcf223df tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Flavor pref 0:0:0 {{(pid=125242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 15 13:56:35.162208 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.virt.hardware [None req-b93589b2-e003-4ed3-a3ac-680bdcf223df tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Image pref 0:0:0 {{(pid=125242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 15 13:56:35.162615 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.virt.hardware [None req-b93589b2-e003-4ed3-a3ac-680bdcf223df tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 15 13:56:35.173064 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-b93589b2-e003-4ed3-a3ac-680bdcf223df tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:56:35.173550 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-b93589b2-e003-4ed3-a3ac-680bdcf223df tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:56:35.174073 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-b93589b2-e003-4ed3-a3ac-680bdcf223df tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:56:35.174810 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-b93589b2-e003-4ed3-a3ac-680bdcf223df tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:56:35.175266 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-b93589b2-e003-4ed3-a3ac-680bdcf223df tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:56:35.175688 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-b93589b2-e003-4ed3-a3ac-680bdcf223df tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:56:35.194746 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.quota [None req-b93589b2-e003-4ed3-a3ac-680bdcf223df tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Getting quotas for project 35f8b5024a194f70a9f7689ac44ab07b. Resources: {'cores', 'ram', 'instances'} {{(pid=125242) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 15 13:56:35.199571 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.quota [None req-b93589b2-e003-4ed3-a3ac-680bdcf223df tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Getting quotas for user 583cce1547144e11978f20a3193ceba4 and project 35f8b5024a194f70a9f7689ac44ab07b. Resources: {'cores', 'ram', 'instances'} {{(pid=125242) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 15 13:56:35.213134 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-b93589b2-e003-4ed3-a3ac-680bdcf223df tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Going to run 1 instances... {{(pid=125242) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 15 13:56:35.215532 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-b93589b2-e003-4ed3-a3ac-680bdcf223df tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] [instance: 191fca7f-a39d-4a31-9be0-b655f49aea35] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='26e64909-1cae-49ca-af5e-adea40c062d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125242) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 15 13:56:35.218112 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-604700a6-8c73-45bd-9c7a-cfc21ff17068 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:56:35.219125 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-604700a6-8c73-45bd-9c7a-cfc21ff17068 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] [instance: 242ed9b0-fe03-4583-ad2f-4760e86d2031] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:56:35.227494 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-604700a6-8c73-45bd-9c7a-cfc21ff17068 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:56:35.228176 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-604700a6-8c73-45bd-9c7a-cfc21ff17068 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:56:35.228625 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-604700a6-8c73-45bd-9c7a-cfc21ff17068 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:56:35.229352 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-604700a6-8c73-45bd-9c7a-cfc21ff17068 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:56:35.229812 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-604700a6-8c73-45bd-9c7a-cfc21ff17068 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:56:35.230236 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-604700a6-8c73-45bd-9c7a-cfc21ff17068 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:56:35.289760 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-b93589b2-e003-4ed3-a3ac-680bdcf223df tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.984204 Oct 15 13:56:35.290617 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 425/830] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 15 13:56:34 2022] POST /compute/v2.1/servers => generated 402 bytes in 987 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 15 13:56:35.299251 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-501adf06-8ba6-45c7-a458-de73f02af6db tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:56:35.300339 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-501adf06-8ba6-45c7-a458-de73f02af6db tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] [instance: 1413aaed-46c7-4807-9d3b-957616dd4047] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:56:35.313584 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-501adf06-8ba6-45c7-a458-de73f02af6db tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:56:35.314547 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-501adf06-8ba6-45c7-a458-de73f02af6db tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:56:35.315377 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-501adf06-8ba6-45c7-a458-de73f02af6db tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:56:35.316765 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-501adf06-8ba6-45c7-a458-de73f02af6db tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:56:35.317591 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-501adf06-8ba6-45c7-a458-de73f02af6db tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:56:35.318375 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-501adf06-8ba6-45c7-a458-de73f02af6db tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:56:35.472539 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-604700a6-8c73-45bd-9c7a-cfc21ff17068 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5150c06020594efe957359f641eba5da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a0813bae074cd2aa552be82abe8493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:56:35.488947 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-604700a6-8c73-45bd-9c7a-cfc21ff17068 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] 10.222.0.36 "GET /compute/v2.1/servers/242ed9b0-fe03-4583-ad2f-4760e86d2031" status: 200 len: 1523 microversion: 2.1 time: 0.274529 Oct 15 13:56:35.504494 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 406/831] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:56:35 2022] GET /compute/v2.1/servers/242ed9b0-fe03-4583-ad2f-4760e86d2031 => generated 1523 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 13:56:35.520153 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-51d1b8ab-14ab-4c24-a21a-64ec40d60372 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:56:35.521100 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-51d1b8ab-14ab-4c24-a21a-64ec40d60372 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] [instance: 191fca7f-a39d-4a31-9be0-b655f49aea35] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:56:35.529318 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-501adf06-8ba6-45c7-a458-de73f02af6db tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e530c3f544748bd3ffc256b1630b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a6be8e43c7742be84f4dc3c95a990e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:56:35.539674 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-501adf06-8ba6-45c7-a458-de73f02af6db tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] 10.222.0.36 "GET /compute/v2.1/servers/1413aaed-46c7-4807-9d3b-957616dd4047" status: 200 len: 1568 microversion: 2.1 time: 0.247508 Oct 15 13:56:35.540638 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 426/832] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:56:35 2022] GET /compute/v2.1/servers/1413aaed-46c7-4807-9d3b-957616dd4047 => generated 1568 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:56:35.605228 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-51d1b8ab-14ab-4c24-a21a-64ec40d60372 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583cce1547144e11978f20a3193ceba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f8b5024a194f70a9f7689ac44ab07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:56:35.615567 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-51d1b8ab-14ab-4c24-a21a-64ec40d60372 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] 10.222.0.36 "GET /compute/v2.1/servers/191fca7f-a39d-4a31-9be0-b655f49aea35" status: 200 len: 1237 microversion: 2.1 time: 0.108783 Oct 15 13:56:35.616502 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 407/833] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:56:35 2022] GET /compute/v2.1/servers/191fca7f-a39d-4a31-9be0-b655f49aea35 => generated 1237 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:56:36.404057 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [req-0e2f9d5d-db94-4dd0-94e3-cc7f83759f5a req-b6f42b1e-6153-48c6-aec9-d93a8d2e26e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "242ed9b0-fe03-4583-ad2f-4760e86d2031", "name": "network-vif-deleted", "tag": "b700737e-c8a7-40a1-96f2-1665f19a9778"}]} {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 13:56:36.428366 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [req-0e2f9d5d-db94-4dd0-94e3-cc7f83759f5a req-b6f42b1e-6153-48c6-aec9-d93a8d2e26e7 service nova] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:56:36.429283 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [req-0e2f9d5d-db94-4dd0-94e3-cc7f83759f5a req-b6f42b1e-6153-48c6-aec9-d93a8d2e26e7 service nova] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:56:36.429818 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [req-0e2f9d5d-db94-4dd0-94e3-cc7f83759f5a req-b6f42b1e-6153-48c6-aec9-d93a8d2e26e7 service nova] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:56:36.448621 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.compute.server_external_events [req-0e2f9d5d-db94-4dd0-94e3-cc7f83759f5a req-b6f42b1e-6153-48c6-aec9-d93a8d2e26e7 service nova] Creating event network-vif-deleted:b700737e-c8a7-40a1-96f2-1665f19a9778 for instance 242ed9b0-fe03-4583-ad2f-4760e86d2031 on hv-cinder-86149 Oct 15 13:56:36.455992 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [req-0e2f9d5d-db94-4dd0-94e3-cc7f83759f5a req-b6f42b1e-6153-48c6-aec9-d93a8d2e26e7 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055682 Oct 15 13:56:36.456610 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 427/834] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 15 13:56:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 13:56:36.526928 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-5b6ef93f-04b5-4685-a0c0-c7340aaf4ee9 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:56:36.528061 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-5b6ef93f-04b5-4685-a0c0-c7340aaf4ee9 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] [instance: 242ed9b0-fe03-4583-ad2f-4760e86d2031] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:56:36.538598 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-5b6ef93f-04b5-4685-a0c0-c7340aaf4ee9 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:56:36.539141 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-5b6ef93f-04b5-4685-a0c0-c7340aaf4ee9 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:56:36.539861 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-5b6ef93f-04b5-4685-a0c0-c7340aaf4ee9 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:56:36.540879 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-5b6ef93f-04b5-4685-a0c0-c7340aaf4ee9 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:56:36.541458 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-5b6ef93f-04b5-4685-a0c0-c7340aaf4ee9 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:56:36.541954 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-5b6ef93f-04b5-4685-a0c0-c7340aaf4ee9 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:56:36.565807 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-b9e6f199-3e91-4eeb-a4f9-f8ed6edaad96 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:56:36.566606 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-b9e6f199-3e91-4eeb-a4f9-f8ed6edaad96 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] [instance: 1413aaed-46c7-4807-9d3b-957616dd4047] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:56:36.574733 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-b9e6f199-3e91-4eeb-a4f9-f8ed6edaad96 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:56:36.575121 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-b9e6f199-3e91-4eeb-a4f9-f8ed6edaad96 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:56:36.575635 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-b9e6f199-3e91-4eeb-a4f9-f8ed6edaad96 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:56:36.576473 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-b9e6f199-3e91-4eeb-a4f9-f8ed6edaad96 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:56:36.576916 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-b9e6f199-3e91-4eeb-a4f9-f8ed6edaad96 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:56:36.577258 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-5b6ef93f-04b5-4685-a0c0-c7340aaf4ee9 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:56:36.577387 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-b9e6f199-3e91-4eeb-a4f9-f8ed6edaad96 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:56:36.577759 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-5b6ef93f-04b5-4685-a0c0-c7340aaf4ee9 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:56:36.578184 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-5b6ef93f-04b5-4685-a0c0-c7340aaf4ee9 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:56:36.578653 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.objects.instance [None req-5b6ef93f-04b5-4685-a0c0-c7340aaf4ee9 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lazy-loading 'fault' on Instance uuid 242ed9b0-fe03-4583-ad2f-4760e86d2031 {{(pid=125243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 15 13:56:36.634454 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-5b6ef93f-04b5-4685-a0c0-c7340aaf4ee9 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5150c06020594efe957359f641eba5da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a0813bae074cd2aa552be82abe8493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:56:36.643020 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-5b6ef93f-04b5-4685-a0c0-c7340aaf4ee9 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] 10.222.0.36 "GET /compute/v2.1/servers/242ed9b0-fe03-4583-ad2f-4760e86d2031" status: 200 len: 1312 microversion: 2.1 time: 0.122771 Oct 15 13:56:36.643625 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 408/835] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:56:36 2022] GET /compute/v2.1/servers/242ed9b0-fe03-4583-ad2f-4760e86d2031 => generated 1312 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:56:36.655998 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-3348830a-e88e-48b0-a181-0ad5dc2ea6f4 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:56:36.657389 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-3348830a-e88e-48b0-a181-0ad5dc2ea6f4 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] [instance: 191fca7f-a39d-4a31-9be0-b655f49aea35] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:56:36.664749 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-3348830a-e88e-48b0-a181-0ad5dc2ea6f4 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:56:36.665430 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-3348830a-e88e-48b0-a181-0ad5dc2ea6f4 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:56:36.665877 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-3348830a-e88e-48b0-a181-0ad5dc2ea6f4 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:56:36.666598 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-3348830a-e88e-48b0-a181-0ad5dc2ea6f4 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:56:36.667052 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-3348830a-e88e-48b0-a181-0ad5dc2ea6f4 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:56:36.667474 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-3348830a-e88e-48b0-a181-0ad5dc2ea6f4 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:56:36.749270 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-3348830a-e88e-48b0-a181-0ad5dc2ea6f4 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583cce1547144e11978f20a3193ceba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f8b5024a194f70a9f7689ac44ab07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:56:36.767350 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-3348830a-e88e-48b0-a181-0ad5dc2ea6f4 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] 10.222.0.36 "GET /compute/v2.1/servers/191fca7f-a39d-4a31-9be0-b655f49aea35" status: 200 len: 1289 microversion: 2.1 time: 0.117011 Oct 15 13:56:36.768463 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 409/836] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:56:36 2022] GET /compute/v2.1/servers/191fca7f-a39d-4a31-9be0-b655f49aea35 => generated 1289 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:56:36.778985 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-b9e6f199-3e91-4eeb-a4f9-f8ed6edaad96 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e530c3f544748bd3ffc256b1630b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a6be8e43c7742be84f4dc3c95a990e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:56:36.788363 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-b9e6f199-3e91-4eeb-a4f9-f8ed6edaad96 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] 10.222.0.36 "GET /compute/v2.1/servers/1413aaed-46c7-4807-9d3b-957616dd4047" status: 200 len: 1569 microversion: 2.1 time: 0.226836 Oct 15 13:56:36.797080 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 428/837] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:56:36 2022] GET /compute/v2.1/servers/1413aaed-46c7-4807-9d3b-957616dd4047 => generated 1569 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:56:36.813891 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-5b92a423-fa28-4250-945f-48a92729c757 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 13:56:36.814502 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-5b92a423-fa28-4250-945f-48a92729c757 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] [instance: 1413aaed-46c7-4807-9d3b-957616dd4047] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:56:36.821643 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-5b92a423-fa28-4250-945f-48a92729c757 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:56:36.822168 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-5b92a423-fa28-4250-945f-48a92729c757 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:56:36.822617 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-5b92a423-fa28-4250-945f-48a92729c757 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:56:36.823363 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-5b92a423-fa28-4250-945f-48a92729c757 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:56:36.824060 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-5b92a423-fa28-4250-945f-48a92729c757 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:56:36.824661 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-5b92a423-fa28-4250-945f-48a92729c757 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:56:36.907683 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-5b92a423-fa28-4250-945f-48a92729c757 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] [instance: 1413aaed-46c7-4807-9d3b-957616dd4047] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=125243) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 15 13:56:36.996373 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG dbcounter [-] [125243] Writing DB stats nova_cell1:UPDATE=3,nova_cell1:SELECT=94,nova_cell1:INSERT=3 {{(pid=125243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:56:37.048416 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-5b92a423-fa28-4250-945f-48a92729c757 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] 10.222.0.36 "POST /compute/v2.1/servers/1413aaed-46c7-4807-9d3b-957616dd4047/action" status: 202 len: 0 microversion: 2.1 time: 0.238603 Oct 15 13:56:37.049108 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 410/838] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 15 13:56:36 2022] POST /compute/v2.1/servers/1413aaed-46c7-4807-9d3b-957616dd4047/action => generated 0 bytes in 240 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 15 13:56:37.057825 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-a2fcdc96-8e29-4e88-b7cb-0f44cfdc07ac tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:56:37.058609 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-a2fcdc96-8e29-4e88-b7cb-0f44cfdc07ac tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] [instance: 1413aaed-46c7-4807-9d3b-957616dd4047] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:56:37.065495 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-a2fcdc96-8e29-4e88-b7cb-0f44cfdc07ac tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:56:37.066405 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-a2fcdc96-8e29-4e88-b7cb-0f44cfdc07ac tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:56:37.066955 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-a2fcdc96-8e29-4e88-b7cb-0f44cfdc07ac tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:56:37.067767 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-a2fcdc96-8e29-4e88-b7cb-0f44cfdc07ac tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:56:37.068352 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-a2fcdc96-8e29-4e88-b7cb-0f44cfdc07ac tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:56:37.068848 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-a2fcdc96-8e29-4e88-b7cb-0f44cfdc07ac tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:56:37.217394 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-a2fcdc96-8e29-4e88-b7cb-0f44cfdc07ac tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e530c3f544748bd3ffc256b1630b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a6be8e43c7742be84f4dc3c95a990e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:56:37.225724 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-a2fcdc96-8e29-4e88-b7cb-0f44cfdc07ac tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] 10.222.0.36 "GET /compute/v2.1/servers/1413aaed-46c7-4807-9d3b-957616dd4047" status: 200 len: 1577 microversion: 2.1 time: 0.172192 Oct 15 13:56:37.226508 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 429/839] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:56:37 2022] GET /compute/v2.1/servers/1413aaed-46c7-4807-9d3b-957616dd4047 => generated 1577 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:56:37.667170 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-173a60a2-1a4e-49eb-be5d-0a2263a083b0 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:56:37.667936 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-173a60a2-1a4e-49eb-be5d-0a2263a083b0 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] [instance: 242ed9b0-fe03-4583-ad2f-4760e86d2031] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:56:37.678813 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-173a60a2-1a4e-49eb-be5d-0a2263a083b0 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:56:37.679590 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-173a60a2-1a4e-49eb-be5d-0a2263a083b0 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:56:37.680090 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-173a60a2-1a4e-49eb-be5d-0a2263a083b0 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:56:37.680826 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-173a60a2-1a4e-49eb-be5d-0a2263a083b0 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:56:37.681455 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-173a60a2-1a4e-49eb-be5d-0a2263a083b0 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:56:37.681878 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-173a60a2-1a4e-49eb-be5d-0a2263a083b0 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:56:37.718100 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-173a60a2-1a4e-49eb-be5d-0a2263a083b0 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:56:37.718595 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-173a60a2-1a4e-49eb-be5d-0a2263a083b0 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:56:37.719028 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-173a60a2-1a4e-49eb-be5d-0a2263a083b0 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:56:37.719462 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.objects.instance [None req-173a60a2-1a4e-49eb-be5d-0a2263a083b0 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lazy-loading 'fault' on Instance uuid 242ed9b0-fe03-4583-ad2f-4760e86d2031 {{(pid=125243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 15 13:56:37.797306 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-bbd59198-53c2-4685-97c7-21d99b4e2dd7 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:56:37.799352 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-bbd59198-53c2-4685-97c7-21d99b4e2dd7 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] [instance: 191fca7f-a39d-4a31-9be0-b655f49aea35] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:56:37.809372 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-bbd59198-53c2-4685-97c7-21d99b4e2dd7 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:56:37.810504 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-bbd59198-53c2-4685-97c7-21d99b4e2dd7 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:56:37.811127 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-bbd59198-53c2-4685-97c7-21d99b4e2dd7 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:56:37.812328 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-bbd59198-53c2-4685-97c7-21d99b4e2dd7 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:56:37.813174 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-bbd59198-53c2-4685-97c7-21d99b4e2dd7 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:56:37.813787 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-bbd59198-53c2-4685-97c7-21d99b4e2dd7 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:56:37.856743 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-173a60a2-1a4e-49eb-be5d-0a2263a083b0 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5150c06020594efe957359f641eba5da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a0813bae074cd2aa552be82abe8493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:56:37.887108 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-173a60a2-1a4e-49eb-be5d-0a2263a083b0 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] 10.222.0.36 "GET /compute/v2.1/servers/242ed9b0-fe03-4583-ad2f-4760e86d2031" status: 200 len: 1312 microversion: 2.1 time: 0.221941 Oct 15 13:56:37.888851 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 411/840] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:56:37 2022] GET /compute/v2.1/servers/242ed9b0-fe03-4583-ad2f-4760e86d2031 => generated 1312 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 13:56:37.997148 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-bbd59198-53c2-4685-97c7-21d99b4e2dd7 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583cce1547144e11978f20a3193ceba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f8b5024a194f70a9f7689ac44ab07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:56:38.007384 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-bbd59198-53c2-4685-97c7-21d99b4e2dd7 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] 10.222.0.36 "GET /compute/v2.1/servers/191fca7f-a39d-4a31-9be0-b655f49aea35" status: 200 len: 1295 microversion: 2.1 time: 0.216840 Oct 15 13:56:38.022651 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 430/841] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:56:37 2022] GET /compute/v2.1/servers/191fca7f-a39d-4a31-9be0-b655f49aea35 => generated 1295 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 13:56:38.257455 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-996498b9-7f57-4835-b94d-1f6bbac52566 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:56:38.258522 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-996498b9-7f57-4835-b94d-1f6bbac52566 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] [instance: 1413aaed-46c7-4807-9d3b-957616dd4047] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:56:38.266982 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-996498b9-7f57-4835-b94d-1f6bbac52566 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:56:38.267832 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-996498b9-7f57-4835-b94d-1f6bbac52566 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:56:38.268495 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-996498b9-7f57-4835-b94d-1f6bbac52566 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:56:38.269440 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-996498b9-7f57-4835-b94d-1f6bbac52566 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:56:38.270089 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-996498b9-7f57-4835-b94d-1f6bbac52566 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:56:38.270710 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-996498b9-7f57-4835-b94d-1f6bbac52566 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:56:38.503623 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-996498b9-7f57-4835-b94d-1f6bbac52566 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e530c3f544748bd3ffc256b1630b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a6be8e43c7742be84f4dc3c95a990e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:56:38.511803 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-996498b9-7f57-4835-b94d-1f6bbac52566 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] 10.222.0.36 "GET /compute/v2.1/servers/1413aaed-46c7-4807-9d3b-957616dd4047" status: 200 len: 1517 microversion: 2.1 time: 0.260949 Oct 15 13:56:38.512423 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 412/842] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:56:38 2022] GET /compute/v2.1/servers/1413aaed-46c7-4807-9d3b-957616dd4047 => generated 1517 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:56:38.930450 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-f48c96b7-3ed2-4226-8079-c7a81b7d27f3 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:56:38.932059 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-f48c96b7-3ed2-4226-8079-c7a81b7d27f3 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] [instance: 242ed9b0-fe03-4583-ad2f-4760e86d2031] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:56:38.940210 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-f48c96b7-3ed2-4226-8079-c7a81b7d27f3 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:56:38.940700 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-f48c96b7-3ed2-4226-8079-c7a81b7d27f3 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:56:38.941131 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-f48c96b7-3ed2-4226-8079-c7a81b7d27f3 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:56:38.941839 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-f48c96b7-3ed2-4226-8079-c7a81b7d27f3 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:56:38.942318 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-f48c96b7-3ed2-4226-8079-c7a81b7d27f3 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:56:38.942743 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-f48c96b7-3ed2-4226-8079-c7a81b7d27f3 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:56:38.958029 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.wsgi [None req-f48c96b7-3ed2-4226-8079-c7a81b7d27f3 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] HTTP exception thrown: Instance 242ed9b0-fe03-4583-ad2f-4760e86d2031 could not be found. Oct 15 13:56:38.960045 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-f48c96b7-3ed2-4226-8079-c7a81b7d27f3 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Request method failure captured: Oct 15 13:56:38.960045 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: request: GET /compute/v2.1/servers/242ed9b0-fe03-4583-ad2f-4760e86d2031 HTTP/1.1 Oct 15 13:56:38.960045 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Accept: application/json Oct 15 13:56:38.960045 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Accept-Encoding: identity Oct 15 13:56:38.960045 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Connection: close Oct 15 13:56:38.960045 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Content-Length: 0 Oct 15 13:56:38.960045 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Content-Type: application/json Oct 15 13:56:38.960045 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Host: 10.222.0.36 Oct 15 13:56:38.960045 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Openstack-System-Scope: None Oct 15 13:56:38.960045 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: User-Agent: python-urllib3/1.26.12 Oct 15 13:56:38.960045 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Auth-Token: gAAAAABjSrpDCbLnTEW_xEPAEWkhuHsRghFnNiYiSlFqABBnErC6h60c64D-HBU-sQLJ5OEFDKVHgv-ufGo5DM3852LBGobRbu9Cvywx7lBbDmHNFrYQMi7AZajfH_h200LKqYKwyZ50VzbOvILBgFaEam8UeQ6PXpFFptes7s3dL6W33wOCdG0 Oct 15 13:56:38.960045 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Domain-Id: None Oct 15 13:56:38.960045 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Domain-Name: None Oct 15 13:56:38.960045 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Identity-Status: Confirmed Oct 15 13:56:38.960045 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Is-Admin-Project: True Oct 15 13:56:38.960045 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Project-Domain-Id: default Oct 15 13:56:38.960045 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Project-Domain-Name: Default Oct 15 13:56:38.960045 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Project-Id: 09a0813bae074cd2aa552be82abe8493 Oct 15 13:56:38.960045 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1946714780 Oct 15 13:56:38.960045 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Role: member,reader Oct 15 13:56:38.960045 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Roles: member,reader Oct 15 13:56:38.961760 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_09a0813bae074cd2aa552be82abe8493", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/09a0813bae074cd2aa552be82abe8493"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/09a0813bae074cd2aa552be82abe8493"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/09a0813bae074cd2aa552be82abe8493"}]}] Oct 15 13:56:38.961760 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1946714780 Oct 15 13:56:38.961760 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Tenant-Id: 09a0813bae074cd2aa552be82abe8493 Oct 15 13:56:38.961760 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1946714780 Oct 15 13:56:38.961760 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-User: tempest-ServerRescueNegativeTestJSON-1946714780-project Oct 15 13:56:38.961760 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-User-Domain-Id: default Oct 15 13:56:38.961760 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-User-Domain-Name: Default Oct 15 13:56:38.961760 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-User-Id: 5150c06020594efe957359f641eba5da Oct 15 13:56:38.961760 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1946714780-project Oct 15 13:56:38.961760 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: method: > Oct 15 13:56:38.961760 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: exception: Instance 242ed9b0-fe03-4583-ad2f-4760e86d2031 could not be found. Oct 15 13:56:38.961760 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: action_args: {'id': '242ed9b0-fe03-4583-ad2f-4760e86d2031'} Oct 15 13:56:38.962661 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 15 13:56:38.962661 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 13:56:38.962661 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 15 13:56:38.962661 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 15 13:56:38.962661 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 15 13:56:38.962661 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 15 13:56:38.962661 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 15 13:56:38.962661 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 15 13:56:38.962661 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 15 13:56:38.962661 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 15 13:56:38.962661 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 242ed9b0-fe03-4583-ad2f-4760e86d2031 could not be found. Oct 15 13:56:38.962661 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Oct 15 13:56:38.962661 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 13:56:38.962661 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Oct 15 13:56:38.962661 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 13:56:38.962661 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 13:56:38.962661 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 13:56:38.962661 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 15 13:56:38.962661 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 15 13:56:38.962661 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 15 13:56:38.965136 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 15 13:56:38.965136 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 15 13:56:38.965136 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 15 13:56:38.965136 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 15 13:56:38.965136 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 15 13:56:38.965136 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 15 13:56:38.965136 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 15 13:56:38.965136 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 242ed9b0-fe03-4583-ad2f-4760e86d2031 could not be found. Oct 15 13:56:38.965136 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Oct 15 13:56:38.965136 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 13:56:38.965136 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Oct 15 13:56:38.965136 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 13:56:38.965136 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 13:56:38.965136 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 13:56:38.965136 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 15 13:56:38.965136 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 15 13:56:38.965136 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 242ed9b0-fe03-4583-ad2f-4760e86d2031 could not be found. Oct 15 13:56:38.965136 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Oct 15 13:56:38.966334 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-f48c96b7-3ed2-4226-8079-c7a81b7d27f3 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] Returning 404 to user: Instance 242ed9b0-fe03-4583-ad2f-4760e86d2031 could not be found. {{(pid=125242) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 15 13:56:38.966334 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-f48c96b7-3ed2-4226-8079-c7a81b7d27f3 tempest-ServerRescueNegativeTestJSON-1946714780 tempest-ServerRescueNegativeTestJSON-1946714780-project] 10.222.0.36 "GET /compute/v2.1/servers/242ed9b0-fe03-4583-ad2f-4760e86d2031" status: 404 len: 111 microversion: 2.1 time: 0.036125 Oct 15 13:56:38.972650 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 431/843] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:56:38 2022] GET /compute/v2.1/servers/242ed9b0-fe03-4583-ad2f-4760e86d2031 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 15 13:56:39.031576 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-a7d78285-647e-4ab5-94b2-8484103eff49 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:56:39.032291 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-a7d78285-647e-4ab5-94b2-8484103eff49 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] [instance: 191fca7f-a39d-4a31-9be0-b655f49aea35] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:56:39.040535 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-a7d78285-647e-4ab5-94b2-8484103eff49 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:56:39.042060 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-a7d78285-647e-4ab5-94b2-8484103eff49 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:56:39.043080 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-a7d78285-647e-4ab5-94b2-8484103eff49 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:56:39.044040 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-a7d78285-647e-4ab5-94b2-8484103eff49 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:56:39.044667 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-a7d78285-647e-4ab5-94b2-8484103eff49 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:56:39.045250 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-a7d78285-647e-4ab5-94b2-8484103eff49 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:56:39.171800 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [req-6e673450-3c73-4f46-a6a9-e5c56a948f9e req-ab2746f4-cffe-4f38-9c2b-51c3fd0fff78 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "191fca7f-a39d-4a31-9be0-b655f49aea35", "tag": "ffaa042f-4e73-43a4-964a-886d1dc0d768"}]} {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 13:56:39.227270 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [req-6e673450-3c73-4f46-a6a9-e5c56a948f9e req-ab2746f4-cffe-4f38-9c2b-51c3fd0fff78 service nova] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:56:39.231949 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [req-6e673450-3c73-4f46-a6a9-e5c56a948f9e req-ab2746f4-cffe-4f38-9c2b-51c3fd0fff78 service nova] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:56:39.233298 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [req-6e673450-3c73-4f46-a6a9-e5c56a948f9e req-ab2746f4-cffe-4f38-9c2b-51c3fd0fff78 service nova] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:56:39.262994 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.compute.server_external_events [req-6e673450-3c73-4f46-a6a9-e5c56a948f9e req-ab2746f4-cffe-4f38-9c2b-51c3fd0fff78 service nova] Creating event network-changed:ffaa042f-4e73-43a4-964a-886d1dc0d768 for instance 191fca7f-a39d-4a31-9be0-b655f49aea35 on hv-cinder-86149 Oct 15 13:56:39.272788 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [req-6e673450-3c73-4f46-a6a9-e5c56a948f9e req-ab2746f4-cffe-4f38-9c2b-51c3fd0fff78 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115967 Oct 15 13:56:39.274964 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 432/844] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 15 13:56:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 13:56:39.318642 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-a7d78285-647e-4ab5-94b2-8484103eff49 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583cce1547144e11978f20a3193ceba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f8b5024a194f70a9f7689ac44ab07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:56:39.330475 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-a7d78285-647e-4ab5-94b2-8484103eff49 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] 10.222.0.36 "GET /compute/v2.1/servers/191fca7f-a39d-4a31-9be0-b655f49aea35" status: 200 len: 1363 microversion: 2.1 time: 0.302683 Oct 15 13:56:39.331957 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 413/845] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:56:39 2022] GET /compute/v2.1/servers/191fca7f-a39d-4a31-9be0-b655f49aea35 => generated 1363 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:56:39.433936 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [req-a742413a-f1fc-478a-92b4-b327375e8515 req-d960407a-4b93-4806-aa01-5fe40525828f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1413aaed-46c7-4807-9d3b-957616dd4047", "name": "network-vif-unplugged", "status": "completed", "tag": "4b0e8bf4-1aae-4e0a-be03-f2d19fe48439"}]} {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 13:56:39.444520 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [req-a742413a-f1fc-478a-92b4-b327375e8515 req-d960407a-4b93-4806-aa01-5fe40525828f service nova] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:56:39.445338 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [req-a742413a-f1fc-478a-92b4-b327375e8515 req-d960407a-4b93-4806-aa01-5fe40525828f service nova] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:56:39.445904 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [req-a742413a-f1fc-478a-92b4-b327375e8515 req-d960407a-4b93-4806-aa01-5fe40525828f service nova] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:56:39.461153 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.compute.server_external_events [req-a742413a-f1fc-478a-92b4-b327375e8515 req-d960407a-4b93-4806-aa01-5fe40525828f service nova] Creating event network-vif-unplugged:4b0e8bf4-1aae-4e0a-be03-f2d19fe48439 for instance 1413aaed-46c7-4807-9d3b-957616dd4047 on hv-cinder-86149 Oct 15 13:56:39.466955 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [req-a742413a-f1fc-478a-92b4-b327375e8515 req-d960407a-4b93-4806-aa01-5fe40525828f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038263 Oct 15 13:56:39.467575 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 433/846] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 15 13:56:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 13:56:39.599767 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-5ae49fc5-ea8c-41ca-9222-a6aeebdb2f88 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:56:39.600959 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-5ae49fc5-ea8c-41ca-9222-a6aeebdb2f88 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] [instance: 1413aaed-46c7-4807-9d3b-957616dd4047] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:56:39.612745 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-5ae49fc5-ea8c-41ca-9222-a6aeebdb2f88 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:56:39.613958 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-5ae49fc5-ea8c-41ca-9222-a6aeebdb2f88 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:56:39.614498 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-5ae49fc5-ea8c-41ca-9222-a6aeebdb2f88 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:56:39.615601 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-5ae49fc5-ea8c-41ca-9222-a6aeebdb2f88 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:56:39.616188 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-5ae49fc5-ea8c-41ca-9222-a6aeebdb2f88 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:56:39.616682 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-5ae49fc5-ea8c-41ca-9222-a6aeebdb2f88 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:56:40.015615 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-5ae49fc5-ea8c-41ca-9222-a6aeebdb2f88 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e530c3f544748bd3ffc256b1630b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a6be8e43c7742be84f4dc3c95a990e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:56:40.028969 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-5ae49fc5-ea8c-41ca-9222-a6aeebdb2f88 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] 10.222.0.36 "GET /compute/v2.1/servers/1413aaed-46c7-4807-9d3b-957616dd4047" status: 200 len: 1575 microversion: 2.1 time: 0.433858 Oct 15 13:56:40.029572 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 414/847] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:56:39 2022] GET /compute/v2.1/servers/1413aaed-46c7-4807-9d3b-957616dd4047 => generated 1575 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:56:40.371950 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-efedf731-5cf0-4574-afb9-49503adcdeb1 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:56:40.372920 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-efedf731-5cf0-4574-afb9-49503adcdeb1 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] [instance: 191fca7f-a39d-4a31-9be0-b655f49aea35] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:56:40.385102 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-efedf731-5cf0-4574-afb9-49503adcdeb1 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:56:40.386230 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-efedf731-5cf0-4574-afb9-49503adcdeb1 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:56:40.387226 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-efedf731-5cf0-4574-afb9-49503adcdeb1 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:56:40.388565 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-efedf731-5cf0-4574-afb9-49503adcdeb1 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:56:40.389861 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-efedf731-5cf0-4574-afb9-49503adcdeb1 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:56:40.390635 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-efedf731-5cf0-4574-afb9-49503adcdeb1 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:56:40.560589 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-efedf731-5cf0-4574-afb9-49503adcdeb1 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583cce1547144e11978f20a3193ceba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f8b5024a194f70a9f7689ac44ab07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:56:40.571103 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-efedf731-5cf0-4574-afb9-49503adcdeb1 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] 10.222.0.36 "GET /compute/v2.1/servers/191fca7f-a39d-4a31-9be0-b655f49aea35" status: 200 len: 1363 microversion: 2.1 time: 0.206631 Oct 15 13:56:40.571868 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 434/848] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:56:40 2022] GET /compute/v2.1/servers/191fca7f-a39d-4a31-9be0-b655f49aea35 => generated 1363 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:56:41.056833 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-efa48135-b3a1-4fe9-99b5-da363da8f940 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:56:41.057681 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-efa48135-b3a1-4fe9-99b5-da363da8f940 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] [instance: 1413aaed-46c7-4807-9d3b-957616dd4047] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:56:41.064831 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-efa48135-b3a1-4fe9-99b5-da363da8f940 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:56:41.065430 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-efa48135-b3a1-4fe9-99b5-da363da8f940 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:56:41.065946 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-efa48135-b3a1-4fe9-99b5-da363da8f940 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:56:41.066958 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-efa48135-b3a1-4fe9-99b5-da363da8f940 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:56:41.067494 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-efa48135-b3a1-4fe9-99b5-da363da8f940 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:56:41.068024 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-efa48135-b3a1-4fe9-99b5-da363da8f940 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:56:41.243446 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-efa48135-b3a1-4fe9-99b5-da363da8f940 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e530c3f544748bd3ffc256b1630b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a6be8e43c7742be84f4dc3c95a990e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:56:41.256679 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-efa48135-b3a1-4fe9-99b5-da363da8f940 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] 10.222.0.36 "GET /compute/v2.1/servers/1413aaed-46c7-4807-9d3b-957616dd4047" status: 200 len: 1575 microversion: 2.1 time: 0.203904 Oct 15 13:56:41.257770 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 415/849] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:56:41 2022] GET /compute/v2.1/servers/1413aaed-46c7-4807-9d3b-957616dd4047 => generated 1575 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:56:41.600001 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-a3757c9f-8217-4db7-a3b0-1ea155c90d09 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:56:41.602273 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-a3757c9f-8217-4db7-a3b0-1ea155c90d09 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] [instance: 191fca7f-a39d-4a31-9be0-b655f49aea35] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:56:41.616335 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-a3757c9f-8217-4db7-a3b0-1ea155c90d09 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:56:41.617581 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-a3757c9f-8217-4db7-a3b0-1ea155c90d09 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:56:41.618778 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-a3757c9f-8217-4db7-a3b0-1ea155c90d09 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:56:41.619844 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-a3757c9f-8217-4db7-a3b0-1ea155c90d09 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:56:41.620567 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-a3757c9f-8217-4db7-a3b0-1ea155c90d09 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:56:41.621259 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-a3757c9f-8217-4db7-a3b0-1ea155c90d09 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:56:41.944836 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-a3757c9f-8217-4db7-a3b0-1ea155c90d09 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583cce1547144e11978f20a3193ceba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f8b5024a194f70a9f7689ac44ab07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:56:41.957033 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-a3757c9f-8217-4db7-a3b0-1ea155c90d09 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] 10.222.0.36 "GET /compute/v2.1/servers/191fca7f-a39d-4a31-9be0-b655f49aea35" status: 200 len: 1363 microversion: 2.1 time: 0.365122 Oct 15 13:56:41.958308 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 435/850] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:56:41 2022] GET /compute/v2.1/servers/191fca7f-a39d-4a31-9be0-b655f49aea35 => generated 1363 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 13:56:42.282914 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-8cbbafab-d7fa-46dd-a23d-3d1bca7ec8bc tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:56:42.284414 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-8cbbafab-d7fa-46dd-a23d-3d1bca7ec8bc tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] [instance: 1413aaed-46c7-4807-9d3b-957616dd4047] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:56:42.294205 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-8cbbafab-d7fa-46dd-a23d-3d1bca7ec8bc tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:56:42.295064 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-8cbbafab-d7fa-46dd-a23d-3d1bca7ec8bc tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:56:42.295757 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-8cbbafab-d7fa-46dd-a23d-3d1bca7ec8bc tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:56:42.296816 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-8cbbafab-d7fa-46dd-a23d-3d1bca7ec8bc tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:56:42.297514 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-8cbbafab-d7fa-46dd-a23d-3d1bca7ec8bc tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:56:42.298168 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-8cbbafab-d7fa-46dd-a23d-3d1bca7ec8bc tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:56:42.770767 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-8cbbafab-d7fa-46dd-a23d-3d1bca7ec8bc tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e530c3f544748bd3ffc256b1630b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a6be8e43c7742be84f4dc3c95a990e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:56:42.780471 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-8cbbafab-d7fa-46dd-a23d-3d1bca7ec8bc tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] 10.222.0.36 "GET /compute/v2.1/servers/1413aaed-46c7-4807-9d3b-957616dd4047" status: 200 len: 1575 microversion: 2.1 time: 0.501682 Oct 15 13:56:42.781064 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 416/851] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:56:42 2022] GET /compute/v2.1/servers/1413aaed-46c7-4807-9d3b-957616dd4047 => generated 1575 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:56:43.012583 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-2e6ac0fc-43a2-412a-bc4a-9aeddc23e0a3 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:56:43.013595 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-2e6ac0fc-43a2-412a-bc4a-9aeddc23e0a3 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] [instance: 191fca7f-a39d-4a31-9be0-b655f49aea35] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:56:43.026671 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-2e6ac0fc-43a2-412a-bc4a-9aeddc23e0a3 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:56:43.028154 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-2e6ac0fc-43a2-412a-bc4a-9aeddc23e0a3 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:56:43.029355 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-2e6ac0fc-43a2-412a-bc4a-9aeddc23e0a3 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:56:43.031033 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-2e6ac0fc-43a2-412a-bc4a-9aeddc23e0a3 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:56:43.032265 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-2e6ac0fc-43a2-412a-bc4a-9aeddc23e0a3 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:56:43.033327 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-2e6ac0fc-43a2-412a-bc4a-9aeddc23e0a3 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:56:43.332366 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-2e6ac0fc-43a2-412a-bc4a-9aeddc23e0a3 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583cce1547144e11978f20a3193ceba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f8b5024a194f70a9f7689ac44ab07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:56:43.348213 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-2e6ac0fc-43a2-412a-bc4a-9aeddc23e0a3 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] 10.222.0.36 "GET /compute/v2.1/servers/191fca7f-a39d-4a31-9be0-b655f49aea35" status: 200 len: 1363 microversion: 2.1 time: 0.352468 Oct 15 13:56:43.358067 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 436/852] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:56:42 2022] GET /compute/v2.1/servers/191fca7f-a39d-4a31-9be0-b655f49aea35 => generated 1363 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:56:43.808582 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-6c553239-30d7-481e-8f5e-70bd60da79ee tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:56:43.809292 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-6c553239-30d7-481e-8f5e-70bd60da79ee tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] [instance: 1413aaed-46c7-4807-9d3b-957616dd4047] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:56:43.814317 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG dbcounter [-] [125243] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:UPDATE=3,nova_api:INSERT=1 {{(pid=125243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:56:43.818705 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-6c553239-30d7-481e-8f5e-70bd60da79ee tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:56:43.819762 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-6c553239-30d7-481e-8f5e-70bd60da79ee tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:56:43.820465 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-6c553239-30d7-481e-8f5e-70bd60da79ee tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:56:43.822112 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-6c553239-30d7-481e-8f5e-70bd60da79ee tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:56:43.822528 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-6c553239-30d7-481e-8f5e-70bd60da79ee tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:56:43.822766 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-6c553239-30d7-481e-8f5e-70bd60da79ee tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:56:44.056636 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-6c553239-30d7-481e-8f5e-70bd60da79ee tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e530c3f544748bd3ffc256b1630b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a6be8e43c7742be84f4dc3c95a990e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:56:44.065177 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-6c553239-30d7-481e-8f5e-70bd60da79ee tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] 10.222.0.36 "GET /compute/v2.1/servers/1413aaed-46c7-4807-9d3b-957616dd4047" status: 200 len: 1575 microversion: 2.1 time: 0.263024 Oct 15 13:56:44.075389 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 417/853] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:56:43 2022] GET /compute/v2.1/servers/1413aaed-46c7-4807-9d3b-957616dd4047 => generated 1575 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:56:44.390100 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-26ad1951-f8a8-4849-ba0b-14fce6293698 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:56:44.390672 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-26ad1951-f8a8-4849-ba0b-14fce6293698 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] [instance: 191fca7f-a39d-4a31-9be0-b655f49aea35] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:56:44.405939 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-26ad1951-f8a8-4849-ba0b-14fce6293698 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:56:44.406890 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-26ad1951-f8a8-4849-ba0b-14fce6293698 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:56:44.407744 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-26ad1951-f8a8-4849-ba0b-14fce6293698 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:56:44.409231 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-26ad1951-f8a8-4849-ba0b-14fce6293698 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:56:44.410050 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-26ad1951-f8a8-4849-ba0b-14fce6293698 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:56:44.410694 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-26ad1951-f8a8-4849-ba0b-14fce6293698 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:56:44.616252 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-26ad1951-f8a8-4849-ba0b-14fce6293698 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583cce1547144e11978f20a3193ceba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f8b5024a194f70a9f7689ac44ab07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:56:44.626983 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-26ad1951-f8a8-4849-ba0b-14fce6293698 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] 10.222.0.36 "GET /compute/v2.1/servers/191fca7f-a39d-4a31-9be0-b655f49aea35" status: 200 len: 1363 microversion: 2.1 time: 0.241294 Oct 15 13:56:44.627611 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 437/854] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:56:44 2022] GET /compute/v2.1/servers/191fca7f-a39d-4a31-9be0-b655f49aea35 => generated 1363 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:56:45.091214 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-cb17f0fb-f057-42ab-851a-6ea426a1b248 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:56:45.091929 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-cb17f0fb-f057-42ab-851a-6ea426a1b248 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] [instance: 1413aaed-46c7-4807-9d3b-957616dd4047] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:56:45.099082 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-cb17f0fb-f057-42ab-851a-6ea426a1b248 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:56:45.099574 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-cb17f0fb-f057-42ab-851a-6ea426a1b248 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:56:45.100058 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-cb17f0fb-f057-42ab-851a-6ea426a1b248 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:56:45.100772 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-cb17f0fb-f057-42ab-851a-6ea426a1b248 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:56:45.101222 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-cb17f0fb-f057-42ab-851a-6ea426a1b248 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:56:45.101646 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-cb17f0fb-f057-42ab-851a-6ea426a1b248 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:56:45.295379 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-cb17f0fb-f057-42ab-851a-6ea426a1b248 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e530c3f544748bd3ffc256b1630b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a6be8e43c7742be84f4dc3c95a990e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:56:45.309173 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-cb17f0fb-f057-42ab-851a-6ea426a1b248 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] 10.222.0.36 "GET /compute/v2.1/servers/1413aaed-46c7-4807-9d3b-957616dd4047" status: 200 len: 1575 microversion: 2.1 time: 0.222619 Oct 15 13:56:45.310148 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 418/855] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:56:45 2022] GET /compute/v2.1/servers/1413aaed-46c7-4807-9d3b-957616dd4047 => generated 1575 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 13:56:45.652802 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-6f7be518-c1a1-4d01-a052-0fdb0a288d76 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:56:45.653512 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-6f7be518-c1a1-4d01-a052-0fdb0a288d76 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] [instance: 191fca7f-a39d-4a31-9be0-b655f49aea35] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:56:45.656329 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG dbcounter [-] [125242] Writing DB stats nova_cell0:SELECT=2 {{(pid=125242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:56:45.656585 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG dbcounter [-] [125242] Writing DB stats nova_cell0:SELECT=6 {{(pid=125242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:56:45.664013 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-6f7be518-c1a1-4d01-a052-0fdb0a288d76 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:56:45.664744 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-6f7be518-c1a1-4d01-a052-0fdb0a288d76 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:56:45.665193 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-6f7be518-c1a1-4d01-a052-0fdb0a288d76 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:56:45.665939 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-6f7be518-c1a1-4d01-a052-0fdb0a288d76 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:56:45.666395 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-6f7be518-c1a1-4d01-a052-0fdb0a288d76 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:56:45.666819 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-6f7be518-c1a1-4d01-a052-0fdb0a288d76 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:56:45.688147 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG dbcounter [-] [125242] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:56:45.863813 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-6f7be518-c1a1-4d01-a052-0fdb0a288d76 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583cce1547144e11978f20a3193ceba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f8b5024a194f70a9f7689ac44ab07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:56:45.882488 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-6f7be518-c1a1-4d01-a052-0fdb0a288d76 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] 10.222.0.36 "GET /compute/v2.1/servers/191fca7f-a39d-4a31-9be0-b655f49aea35" status: 200 len: 1363 microversion: 2.1 time: 0.234093 Oct 15 13:56:45.888317 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 438/856] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:56:45 2022] GET /compute/v2.1/servers/191fca7f-a39d-4a31-9be0-b655f49aea35 => generated 1363 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:56:46.337855 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-25f47227-fdf9-4360-a533-5af9a1bf6290 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:56:46.339023 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-25f47227-fdf9-4360-a533-5af9a1bf6290 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] [instance: 1413aaed-46c7-4807-9d3b-957616dd4047] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:56:46.342359 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG dbcounter [-] [125243] Writing DB stats nova_cell0:SELECT=6 {{(pid=125243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:56:46.352990 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-25f47227-fdf9-4360-a533-5af9a1bf6290 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:56:46.354077 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-25f47227-fdf9-4360-a533-5af9a1bf6290 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:56:46.354818 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-25f47227-fdf9-4360-a533-5af9a1bf6290 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:56:46.356560 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-25f47227-fdf9-4360-a533-5af9a1bf6290 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:56:46.359664 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-25f47227-fdf9-4360-a533-5af9a1bf6290 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:56:46.360278 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-25f47227-fdf9-4360-a533-5af9a1bf6290 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:56:46.541975 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-25f47227-fdf9-4360-a533-5af9a1bf6290 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e530c3f544748bd3ffc256b1630b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a6be8e43c7742be84f4dc3c95a990e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:56:46.550375 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-25f47227-fdf9-4360-a533-5af9a1bf6290 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] 10.222.0.36 "GET /compute/v2.1/servers/1413aaed-46c7-4807-9d3b-957616dd4047" status: 200 len: 1575 microversion: 2.1 time: 0.219925 Oct 15 13:56:46.550967 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 419/857] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:56:46 2022] GET /compute/v2.1/servers/1413aaed-46c7-4807-9d3b-957616dd4047 => generated 1575 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:56:46.912162 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-04d2caf0-0f11-4f7f-8af1-64142a40c9a0 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:56:46.913012 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-04d2caf0-0f11-4f7f-8af1-64142a40c9a0 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] [instance: 191fca7f-a39d-4a31-9be0-b655f49aea35] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:56:46.915367 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG dbcounter [-] [125242] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=125242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:56:46.929191 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-04d2caf0-0f11-4f7f-8af1-64142a40c9a0 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:56:46.930489 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-04d2caf0-0f11-4f7f-8af1-64142a40c9a0 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:56:46.931368 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-04d2caf0-0f11-4f7f-8af1-64142a40c9a0 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:56:46.933286 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-04d2caf0-0f11-4f7f-8af1-64142a40c9a0 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:56:46.935080 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-04d2caf0-0f11-4f7f-8af1-64142a40c9a0 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:56:46.936673 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-04d2caf0-0f11-4f7f-8af1-64142a40c9a0 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:56:47.148082 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-04d2caf0-0f11-4f7f-8af1-64142a40c9a0 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583cce1547144e11978f20a3193ceba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f8b5024a194f70a9f7689ac44ab07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:56:47.167505 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-04d2caf0-0f11-4f7f-8af1-64142a40c9a0 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] 10.222.0.36 "GET /compute/v2.1/servers/191fca7f-a39d-4a31-9be0-b655f49aea35" status: 200 len: 1363 microversion: 2.1 time: 0.260006 Oct 15 13:56:47.185833 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 439/858] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:56:46 2022] GET /compute/v2.1/servers/191fca7f-a39d-4a31-9be0-b655f49aea35 => generated 1363 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:56:47.577343 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-baf74378-2d15-4525-bdd0-b2174e57a6e7 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:56:47.579018 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-baf74378-2d15-4525-bdd0-b2174e57a6e7 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] [instance: 1413aaed-46c7-4807-9d3b-957616dd4047] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:56:47.590712 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-baf74378-2d15-4525-bdd0-b2174e57a6e7 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:56:47.591917 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-baf74378-2d15-4525-bdd0-b2174e57a6e7 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:56:47.592707 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-baf74378-2d15-4525-bdd0-b2174e57a6e7 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:56:47.593579 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-baf74378-2d15-4525-bdd0-b2174e57a6e7 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:56:47.594101 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-baf74378-2d15-4525-bdd0-b2174e57a6e7 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:56:47.594763 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-baf74378-2d15-4525-bdd0-b2174e57a6e7 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:56:47.728707 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [req-7b1041b6-eb94-47e5-be1e-45971dc7be6b req-d66f82c7-d06d-4210-a05a-b4f5176170e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "191fca7f-a39d-4a31-9be0-b655f49aea35", "name": "network-vif-plugged", "status": "completed", "tag": "ffaa042f-4e73-43a4-964a-886d1dc0d768"}]} {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 13:56:47.740049 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [req-7b1041b6-eb94-47e5-be1e-45971dc7be6b req-d66f82c7-d06d-4210-a05a-b4f5176170e8 service nova] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:56:47.740901 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [req-7b1041b6-eb94-47e5-be1e-45971dc7be6b req-d66f82c7-d06d-4210-a05a-b4f5176170e8 service nova] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:56:47.741519 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [req-7b1041b6-eb94-47e5-be1e-45971dc7be6b req-d66f82c7-d06d-4210-a05a-b4f5176170e8 service nova] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:56:47.754963 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.compute.server_external_events [req-7b1041b6-eb94-47e5-be1e-45971dc7be6b req-d66f82c7-d06d-4210-a05a-b4f5176170e8 service nova] Creating event network-vif-plugged:ffaa042f-4e73-43a4-964a-886d1dc0d768 for instance 191fca7f-a39d-4a31-9be0-b655f49aea35 on hv-cinder-86149 Oct 15 13:56:47.763064 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [req-7b1041b6-eb94-47e5-be1e-45971dc7be6b req-d66f82c7-d06d-4210-a05a-b4f5176170e8 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038672 Oct 15 13:56:47.764395 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 440/859] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 15 13:56:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 13:56:47.822655 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-baf74378-2d15-4525-bdd0-b2174e57a6e7 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e530c3f544748bd3ffc256b1630b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a6be8e43c7742be84f4dc3c95a990e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:56:47.836422 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-baf74378-2d15-4525-bdd0-b2174e57a6e7 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] 10.222.0.36 "GET /compute/v2.1/servers/1413aaed-46c7-4807-9d3b-957616dd4047" status: 200 len: 1575 microversion: 2.1 time: 0.265723 Oct 15 13:56:47.837931 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 420/860] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:56:47 2022] GET /compute/v2.1/servers/1413aaed-46c7-4807-9d3b-957616dd4047 => generated 1575 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:56:48.195311 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-a64d05da-abae-45f1-8476-d35a0629c8c4 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:56:48.196336 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-a64d05da-abae-45f1-8476-d35a0629c8c4 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] [instance: 191fca7f-a39d-4a31-9be0-b655f49aea35] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:56:48.203491 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-a64d05da-abae-45f1-8476-d35a0629c8c4 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:56:48.204037 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-a64d05da-abae-45f1-8476-d35a0629c8c4 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:56:48.204482 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-a64d05da-abae-45f1-8476-d35a0629c8c4 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:56:48.205625 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-a64d05da-abae-45f1-8476-d35a0629c8c4 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:56:48.206099 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-a64d05da-abae-45f1-8476-d35a0629c8c4 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:56:48.206531 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-a64d05da-abae-45f1-8476-d35a0629c8c4 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:56:48.394643 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-a64d05da-abae-45f1-8476-d35a0629c8c4 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583cce1547144e11978f20a3193ceba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f8b5024a194f70a9f7689ac44ab07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:56:48.408115 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-a64d05da-abae-45f1-8476-d35a0629c8c4 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] 10.222.0.36 "GET /compute/v2.1/servers/191fca7f-a39d-4a31-9be0-b655f49aea35" status: 200 len: 1363 microversion: 2.1 time: 0.217359 Oct 15 13:56:48.409574 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 441/861] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:56:48 2022] GET /compute/v2.1/servers/191fca7f-a39d-4a31-9be0-b655f49aea35 => generated 1363 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:56:48.885214 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-c1899cc7-cb0f-4bb7-901f-656df7dbfb09 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:56:48.887021 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-c1899cc7-cb0f-4bb7-901f-656df7dbfb09 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] [instance: 1413aaed-46c7-4807-9d3b-957616dd4047] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:56:48.903761 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-c1899cc7-cb0f-4bb7-901f-656df7dbfb09 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:56:48.904583 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-c1899cc7-cb0f-4bb7-901f-656df7dbfb09 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:56:48.905271 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-c1899cc7-cb0f-4bb7-901f-656df7dbfb09 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:56:48.906383 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-c1899cc7-cb0f-4bb7-901f-656df7dbfb09 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:56:48.907188 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-c1899cc7-cb0f-4bb7-901f-656df7dbfb09 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:56:48.908056 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-c1899cc7-cb0f-4bb7-901f-656df7dbfb09 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:56:49.082888 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-c1899cc7-cb0f-4bb7-901f-656df7dbfb09 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e530c3f544748bd3ffc256b1630b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a6be8e43c7742be84f4dc3c95a990e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:56:49.092135 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-c1899cc7-cb0f-4bb7-901f-656df7dbfb09 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] 10.222.0.36 "GET /compute/v2.1/servers/1413aaed-46c7-4807-9d3b-957616dd4047" status: 200 len: 1575 microversion: 2.1 time: 0.211009 Oct 15 13:56:49.093443 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 421/862] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:56:48 2022] GET /compute/v2.1/servers/1413aaed-46c7-4807-9d3b-957616dd4047 => generated 1575 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:56:49.433108 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-536b0a0b-024c-4138-b902-815edcf6e002 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:56:49.436645 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-536b0a0b-024c-4138-b902-815edcf6e002 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] [instance: 191fca7f-a39d-4a31-9be0-b655f49aea35] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:56:49.443638 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-536b0a0b-024c-4138-b902-815edcf6e002 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:56:49.444170 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-536b0a0b-024c-4138-b902-815edcf6e002 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:56:49.444637 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-536b0a0b-024c-4138-b902-815edcf6e002 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:56:49.445563 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-536b0a0b-024c-4138-b902-815edcf6e002 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:56:49.446239 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-536b0a0b-024c-4138-b902-815edcf6e002 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:56:49.446929 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-536b0a0b-024c-4138-b902-815edcf6e002 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:56:49.672399 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-536b0a0b-024c-4138-b902-815edcf6e002 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583cce1547144e11978f20a3193ceba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f8b5024a194f70a9f7689ac44ab07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:56:49.682654 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-536b0a0b-024c-4138-b902-815edcf6e002 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] 10.222.0.36 "GET /compute/v2.1/servers/191fca7f-a39d-4a31-9be0-b655f49aea35" status: 200 len: 1363 microversion: 2.1 time: 0.253601 Oct 15 13:56:49.696150 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 442/863] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:56:49 2022] GET /compute/v2.1/servers/191fca7f-a39d-4a31-9be0-b655f49aea35 => generated 1363 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:56:50.119960 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-c249b57f-27f4-4b08-8ad5-dddfaa0074c7 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:56:50.121335 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-c249b57f-27f4-4b08-8ad5-dddfaa0074c7 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] [instance: 1413aaed-46c7-4807-9d3b-957616dd4047] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:56:50.136025 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-c249b57f-27f4-4b08-8ad5-dddfaa0074c7 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:56:50.144966 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-c249b57f-27f4-4b08-8ad5-dddfaa0074c7 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:56:50.145603 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-c249b57f-27f4-4b08-8ad5-dddfaa0074c7 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:56:50.153068 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-c249b57f-27f4-4b08-8ad5-dddfaa0074c7 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:56:50.153862 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-c249b57f-27f4-4b08-8ad5-dddfaa0074c7 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:56:50.154491 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-c249b57f-27f4-4b08-8ad5-dddfaa0074c7 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:56:50.428379 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-c249b57f-27f4-4b08-8ad5-dddfaa0074c7 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e530c3f544748bd3ffc256b1630b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a6be8e43c7742be84f4dc3c95a990e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:56:50.440965 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-c249b57f-27f4-4b08-8ad5-dddfaa0074c7 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] 10.222.0.36 "GET /compute/v2.1/servers/1413aaed-46c7-4807-9d3b-957616dd4047" status: 200 len: 1575 microversion: 2.1 time: 0.325598 Oct 15 13:56:50.456496 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 422/864] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:56:50 2022] GET /compute/v2.1/servers/1413aaed-46c7-4807-9d3b-957616dd4047 => generated 1575 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:56:50.711317 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-d7152873-0b27-4134-a9c6-3b9494a27e1e tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:56:50.712654 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-d7152873-0b27-4134-a9c6-3b9494a27e1e tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] [instance: 191fca7f-a39d-4a31-9be0-b655f49aea35] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:56:50.721855 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-d7152873-0b27-4134-a9c6-3b9494a27e1e tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:56:50.722359 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-d7152873-0b27-4134-a9c6-3b9494a27e1e tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:56:50.722791 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-d7152873-0b27-4134-a9c6-3b9494a27e1e tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:56:50.723508 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-d7152873-0b27-4134-a9c6-3b9494a27e1e tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:56:50.731657 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-d7152873-0b27-4134-a9c6-3b9494a27e1e tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:56:50.732152 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-d7152873-0b27-4134-a9c6-3b9494a27e1e tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:56:51.049494 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-d7152873-0b27-4134-a9c6-3b9494a27e1e tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583cce1547144e11978f20a3193ceba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f8b5024a194f70a9f7689ac44ab07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:56:51.064221 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-d7152873-0b27-4134-a9c6-3b9494a27e1e tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] 10.222.0.36 "GET /compute/v2.1/servers/191fca7f-a39d-4a31-9be0-b655f49aea35" status: 200 len: 1549 microversion: 2.1 time: 0.356946 Oct 15 13:56:51.067734 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 443/865] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:56:50 2022] GET /compute/v2.1/servers/191fca7f-a39d-4a31-9be0-b655f49aea35 => generated 1549 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:56:51.116984 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-06446bed-d0f1-4d27-ad1b-bb3ed006fdb4 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:56:51.118638 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-06446bed-d0f1-4d27-ad1b-bb3ed006fdb4 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] [instance: 191fca7f-a39d-4a31-9be0-b655f49aea35] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:56:51.129707 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-06446bed-d0f1-4d27-ad1b-bb3ed006fdb4 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:56:51.131090 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-06446bed-d0f1-4d27-ad1b-bb3ed006fdb4 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:56:51.131630 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-06446bed-d0f1-4d27-ad1b-bb3ed006fdb4 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:56:51.132661 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-06446bed-d0f1-4d27-ad1b-bb3ed006fdb4 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:56:51.133836 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-06446bed-d0f1-4d27-ad1b-bb3ed006fdb4 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:56:51.134545 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-06446bed-d0f1-4d27-ad1b-bb3ed006fdb4 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:56:51.332304 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-06446bed-d0f1-4d27-ad1b-bb3ed006fdb4 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] 10.222.0.36 "GET /compute/v2.1/servers/191fca7f-a39d-4a31-9be0-b655f49aea35/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.232413 Oct 15 13:56:51.333948 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 423/866] 10.222.0.36 () {58 vars in 1275 bytes} [Sat Oct 15 13:56:51 2022] GET /compute/v2.1/servers/191fca7f-a39d-4a31-9be0-b655f49aea35/os-interface => generated 284 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 13:56:51.477536 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-7cabc62e-02e3-4462-a2cf-362f88fa9ece tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:56:51.478837 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-7cabc62e-02e3-4462-a2cf-362f88fa9ece tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] [instance: 1413aaed-46c7-4807-9d3b-957616dd4047] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:56:51.501734 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-7cabc62e-02e3-4462-a2cf-362f88fa9ece tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:56:51.503242 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-7cabc62e-02e3-4462-a2cf-362f88fa9ece tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:56:51.504733 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-7cabc62e-02e3-4462-a2cf-362f88fa9ece tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:56:51.506702 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-7cabc62e-02e3-4462-a2cf-362f88fa9ece tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:56:51.508310 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-7cabc62e-02e3-4462-a2cf-362f88fa9ece tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:56:51.514836 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-7cabc62e-02e3-4462-a2cf-362f88fa9ece tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:56:51.799756 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-c5c7756b-a23a-459f-a242-8411a1d73221 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Action: 'create', calling method: .version_select at 0x7f1b5e3920d0>, body: {"keypair": {"name": "tempest-keypair-1921749236", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKbtH043PBucgmjM515fw/d3JsVyuPgqgOSTteFKzDtDb4xNGPTlDs9FHcfFNLVLC3cl11IRH6YH9a48HeC3BXlx0eRE7YaFkiGsAoFHfoeumfouGn/zObWC8PsLTTzMnQ=="}} {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 13:56:51.831207 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.quota [None req-c5c7756b-a23a-459f-a242-8411a1d73221 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Getting quotas for project 1976b27e84a4484ba9d46a4244b08699. Resources: {'key_pairs'} {{(pid=125243) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 15 13:56:51.837954 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.quota [None req-c5c7756b-a23a-459f-a242-8411a1d73221 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Getting quotas for user a10fc1a48c9c41eaa1bf3ff2e4109657 and project 1976b27e84a4484ba9d46a4244b08699. Resources: {'key_pairs'} {{(pid=125243) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 15 13:56:51.881181 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-c5c7756b-a23a-459f-a242-8411a1d73221 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.314530 Oct 15 13:56:51.883721 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 424/867] 10.222.0.36 () {60 vars in 1159 bytes} [Sat Oct 15 13:56:51 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 15 13:56:52.089110 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-7cabc62e-02e3-4462-a2cf-362f88fa9ece tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e530c3f544748bd3ffc256b1630b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a6be8e43c7742be84f4dc3c95a990e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:56:52.113269 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-7cabc62e-02e3-4462-a2cf-362f88fa9ece tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] 10.222.0.36 "GET /compute/v2.1/servers/1413aaed-46c7-4807-9d3b-957616dd4047" status: 200 len: 1575 microversion: 2.1 time: 0.643706 Oct 15 13:56:52.114207 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 444/868] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:56:51 2022] GET /compute/v2.1/servers/1413aaed-46c7-4807-9d3b-957616dd4047 => generated 1575 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:56:53.141470 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-51584c05-cf32-4974-8be8-904545fe91a0 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:56:53.143990 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-51584c05-cf32-4974-8be8-904545fe91a0 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] [instance: 1413aaed-46c7-4807-9d3b-957616dd4047] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:56:53.153463 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-51584c05-cf32-4974-8be8-904545fe91a0 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:56:53.155054 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-51584c05-cf32-4974-8be8-904545fe91a0 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:56:53.156024 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-51584c05-cf32-4974-8be8-904545fe91a0 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:56:53.157710 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-51584c05-cf32-4974-8be8-904545fe91a0 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:56:53.158825 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-51584c05-cf32-4974-8be8-904545fe91a0 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:56:53.160124 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-51584c05-cf32-4974-8be8-904545fe91a0 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:56:53.725042 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-51584c05-cf32-4974-8be8-904545fe91a0 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e530c3f544748bd3ffc256b1630b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a6be8e43c7742be84f4dc3c95a990e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:56:53.740080 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-51584c05-cf32-4974-8be8-904545fe91a0 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] 10.222.0.36 "GET /compute/v2.1/servers/1413aaed-46c7-4807-9d3b-957616dd4047" status: 200 len: 1575 microversion: 2.1 time: 0.603417 Oct 15 13:56:53.741257 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 425/869] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:56:53 2022] GET /compute/v2.1/servers/1413aaed-46c7-4807-9d3b-957616dd4047 => generated 1575 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:56:53.745452 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [req-0a7bbd93-1f1a-4fe6-8065-9dc580cd7023 req-4e6c7bf5-732c-4dce-be2c-e70dafe67ba3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "191fca7f-a39d-4a31-9be0-b655f49aea35", "tag": "ffaa042f-4e73-43a4-964a-886d1dc0d768"}]} {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 13:56:53.778980 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [req-0a7bbd93-1f1a-4fe6-8065-9dc580cd7023 req-4e6c7bf5-732c-4dce-be2c-e70dafe67ba3 service nova] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:56:53.780338 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [req-0a7bbd93-1f1a-4fe6-8065-9dc580cd7023 req-4e6c7bf5-732c-4dce-be2c-e70dafe67ba3 service nova] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:56:53.781281 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [req-0a7bbd93-1f1a-4fe6-8065-9dc580cd7023 req-4e6c7bf5-732c-4dce-be2c-e70dafe67ba3 service nova] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:56:53.814305 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.compute.server_external_events [req-0a7bbd93-1f1a-4fe6-8065-9dc580cd7023 req-4e6c7bf5-732c-4dce-be2c-e70dafe67ba3 service nova] Creating event network-changed:ffaa042f-4e73-43a4-964a-886d1dc0d768 for instance 191fca7f-a39d-4a31-9be0-b655f49aea35 on hv-cinder-86149 Oct 15 13:56:53.826221 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [req-0a7bbd93-1f1a-4fe6-8065-9dc580cd7023 req-4e6c7bf5-732c-4dce-be2c-e70dafe67ba3 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090120 Oct 15 13:56:53.832524 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 445/870] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 15 13:56:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 13:56:53.973226 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-dd03b216-830f-4fbe-bc3c-184c3aefa135 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-286379530", "imageRef": "26e64909-1cae-49ca-af5e-adea40c062d7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b6c514f8-1a01-4cc0-b2b4-f8ec3eab2ef0"}], "security_groups": [{"name": "tempest-securitygroup--601061821"}], "key_name": "tempest-keypair-1921749236", "user_data": "}} {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 13:56:54.144640 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.network.neutron [None req-dd03b216-830f-4fbe-bc3c-184c3aefa135 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] validate_networks() for [('b6c514f8-1a01-4cc0-b2b4-f8ec3eab2ef0', None, None, None, None, None)] {{(pid=125243) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 15 13:56:54.784336 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-8d5d583d-d71f-4792-a322-e1f7148db374 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:56:54.785190 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-8d5d583d-d71f-4792-a322-e1f7148db374 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] [instance: 1413aaed-46c7-4807-9d3b-957616dd4047] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:56:54.802147 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-8d5d583d-d71f-4792-a322-e1f7148db374 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:56:54.802663 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-8d5d583d-d71f-4792-a322-e1f7148db374 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:56:54.803108 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-8d5d583d-d71f-4792-a322-e1f7148db374 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:56:54.803854 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-8d5d583d-d71f-4792-a322-e1f7148db374 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:56:54.804346 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-8d5d583d-d71f-4792-a322-e1f7148db374 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:56:54.804781 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-8d5d583d-d71f-4792-a322-e1f7148db374 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:56:55.015494 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.virt.hardware [None req-dd03b216-830f-4fbe-bc3c-184c3aefa135 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Flavor limits 0:0:0 {{(pid=125243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 15 13:56:55.015747 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.virt.hardware [None req-dd03b216-830f-4fbe-bc3c-184c3aefa135 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Image limits 0:0:0 {{(pid=125243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 15 13:56:55.016437 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.virt.hardware [None req-dd03b216-830f-4fbe-bc3c-184c3aefa135 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Flavor pref 0:0:0 {{(pid=125243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 15 13:56:55.017216 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.virt.hardware [None req-dd03b216-830f-4fbe-bc3c-184c3aefa135 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Image pref 0:0:0 {{(pid=125243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 15 13:56:55.017421 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.virt.hardware [None req-dd03b216-830f-4fbe-bc3c-184c3aefa135 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 15 13:56:55.035780 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-dd03b216-830f-4fbe-bc3c-184c3aefa135 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:56:55.036636 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-dd03b216-830f-4fbe-bc3c-184c3aefa135 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:56:55.037345 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-dd03b216-830f-4fbe-bc3c-184c3aefa135 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:56:55.038150 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-dd03b216-830f-4fbe-bc3c-184c3aefa135 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:56:55.038662 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-dd03b216-830f-4fbe-bc3c-184c3aefa135 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:56:55.039228 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-dd03b216-830f-4fbe-bc3c-184c3aefa135 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:56:55.079455 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-8d5d583d-d71f-4792-a322-e1f7148db374 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e530c3f544748bd3ffc256b1630b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a6be8e43c7742be84f4dc3c95a990e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:56:55.080900 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.quota [None req-dd03b216-830f-4fbe-bc3c-184c3aefa135 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Getting quotas for project 1976b27e84a4484ba9d46a4244b08699. Resources: {'cores', 'ram', 'instances'} {{(pid=125243) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 15 13:56:55.089644 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.quota [None req-dd03b216-830f-4fbe-bc3c-184c3aefa135 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Getting quotas for user a10fc1a48c9c41eaa1bf3ff2e4109657 and project 1976b27e84a4484ba9d46a4244b08699. Resources: {'cores', 'ram', 'instances'} {{(pid=125243) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 15 13:56:55.094186 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-8d5d583d-d71f-4792-a322-e1f7148db374 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] 10.222.0.36 "GET /compute/v2.1/servers/1413aaed-46c7-4807-9d3b-957616dd4047" status: 200 len: 1575 microversion: 2.1 time: 0.314471 Oct 15 13:56:55.095441 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 446/871] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:56:54 2022] GET /compute/v2.1/servers/1413aaed-46c7-4807-9d3b-957616dd4047 => generated 1575 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 13:56:55.107642 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-dd03b216-830f-4fbe-bc3c-184c3aefa135 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Going to run 1 instances... {{(pid=125243) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 15 13:56:55.111000 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-dd03b216-830f-4fbe-bc3c-184c3aefa135 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] [instance: 00959d34-6e9e-4c3d-a32b-1dfc66397406] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='26e64909-1cae-49ca-af5e-adea40c062d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125243) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 15 13:56:55.166787 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-dd03b216-830f-4fbe-bc3c-184c3aefa135 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.197833 Oct 15 13:56:55.172214 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 426/872] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 15 13:56:53 2022] POST /compute/v2.1/servers => generated 401 bytes in 1204 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 15 13:56:55.179156 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-4c178df3-38da-499f-ad70-c802d2535d3a tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:56:55.179776 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-4c178df3-38da-499f-ad70-c802d2535d3a tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] [instance: 00959d34-6e9e-4c3d-a32b-1dfc66397406] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:56:55.265680 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-4c178df3-38da-499f-ad70-c802d2535d3a tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10fc1a48c9c41eaa1bf3ff2e4109657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1976b27e84a4484ba9d46a4244b08699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:56:55.285114 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-4c178df3-38da-499f-ad70-c802d2535d3a tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] 10.222.0.36 "GET /compute/v2.1/servers/00959d34-6e9e-4c3d-a32b-1dfc66397406" status: 200 len: 1241 microversion: 2.1 time: 0.108716 Oct 15 13:56:55.307156 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 447/873] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:56:55 2022] GET /compute/v2.1/servers/00959d34-6e9e-4c3d-a32b-1dfc66397406 => generated 1241 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 13:56:55.867060 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [req-8ca227b3-4467-4056-978e-fbc45985dbcb req-bc382fb9-efaa-4b92-a574-9367cc7511ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1413aaed-46c7-4807-9d3b-957616dd4047", "name": "network-vif-plugged", "status": "completed", "tag": "4b0e8bf4-1aae-4e0a-be03-f2d19fe48439"}]} {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 13:56:55.881271 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [req-8ca227b3-4467-4056-978e-fbc45985dbcb req-bc382fb9-efaa-4b92-a574-9367cc7511ba service nova] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:56:55.882352 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [req-8ca227b3-4467-4056-978e-fbc45985dbcb req-bc382fb9-efaa-4b92-a574-9367cc7511ba service nova] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:56:55.882939 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [req-8ca227b3-4467-4056-978e-fbc45985dbcb req-bc382fb9-efaa-4b92-a574-9367cc7511ba service nova] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:56:55.905745 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.compute.server_external_events [req-8ca227b3-4467-4056-978e-fbc45985dbcb req-bc382fb9-efaa-4b92-a574-9367cc7511ba service nova] Creating event network-vif-plugged:4b0e8bf4-1aae-4e0a-be03-f2d19fe48439 for instance 1413aaed-46c7-4807-9d3b-957616dd4047 on hv-cinder-86149 Oct 15 13:56:55.912257 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [req-8ca227b3-4467-4056-978e-fbc45985dbcb req-bc382fb9-efaa-4b92-a574-9367cc7511ba service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051967 Oct 15 13:56:55.913176 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 427/874] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 15 13:56:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 15 13:56:56.125658 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-9409b815-af2c-4dca-9772-635df735fc15 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:56:56.132042 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-9409b815-af2c-4dca-9772-635df735fc15 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] [instance: 1413aaed-46c7-4807-9d3b-957616dd4047] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:56:56.147717 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-9409b815-af2c-4dca-9772-635df735fc15 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:56:56.149195 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-9409b815-af2c-4dca-9772-635df735fc15 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:56:56.149580 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-9409b815-af2c-4dca-9772-635df735fc15 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:56:56.150606 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-9409b815-af2c-4dca-9772-635df735fc15 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:56:56.151307 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-9409b815-af2c-4dca-9772-635df735fc15 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:56:56.151924 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-9409b815-af2c-4dca-9772-635df735fc15 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:56:56.312592 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-d9f83284-0fa4-4e37-88ca-2b8f9408db91 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:56:56.313323 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-d9f83284-0fa4-4e37-88ca-2b8f9408db91 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] [instance: 00959d34-6e9e-4c3d-a32b-1dfc66397406] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:56:56.329105 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-d9f83284-0fa4-4e37-88ca-2b8f9408db91 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:56:56.330207 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-d9f83284-0fa4-4e37-88ca-2b8f9408db91 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:56:56.333977 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-d9f83284-0fa4-4e37-88ca-2b8f9408db91 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:56:56.336378 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-d9f83284-0fa4-4e37-88ca-2b8f9408db91 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:56:56.337359 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-d9f83284-0fa4-4e37-88ca-2b8f9408db91 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:56:56.337809 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-d9f83284-0fa4-4e37-88ca-2b8f9408db91 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:56:56.505360 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-d9f83284-0fa4-4e37-88ca-2b8f9408db91 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10fc1a48c9c41eaa1bf3ff2e4109657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1976b27e84a4484ba9d46a4244b08699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:56:56.514236 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-9409b815-af2c-4dca-9772-635df735fc15 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e530c3f544748bd3ffc256b1630b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a6be8e43c7742be84f4dc3c95a990e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:56:56.519580 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-d9f83284-0fa4-4e37-88ca-2b8f9408db91 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] 10.222.0.36 "GET /compute/v2.1/servers/00959d34-6e9e-4c3d-a32b-1dfc66397406" status: 200 len: 1293 microversion: 2.1 time: 0.210896 Oct 15 13:56:56.524469 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 428/875] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:56:56 2022] GET /compute/v2.1/servers/00959d34-6e9e-4c3d-a32b-1dfc66397406 => generated 1293 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:56:56.531193 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-9409b815-af2c-4dca-9772-635df735fc15 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] 10.222.0.36 "GET /compute/v2.1/servers/1413aaed-46c7-4807-9d3b-957616dd4047" status: 200 len: 1575 microversion: 2.1 time: 0.412717 Oct 15 13:56:56.533363 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 448/876] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:56:56 2022] GET /compute/v2.1/servers/1413aaed-46c7-4807-9d3b-957616dd4047 => generated 1575 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:56:57.556439 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-e10c16a9-ad63-4c2c-8e98-829186eb8f75 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:56:57.557225 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-e10c16a9-ad63-4c2c-8e98-829186eb8f75 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] [instance: 1413aaed-46c7-4807-9d3b-957616dd4047] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:56:57.564713 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-e10c16a9-ad63-4c2c-8e98-829186eb8f75 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:56:57.565203 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-e10c16a9-ad63-4c2c-8e98-829186eb8f75 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:56:57.565645 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-e10c16a9-ad63-4c2c-8e98-829186eb8f75 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:56:57.566343 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-e10c16a9-ad63-4c2c-8e98-829186eb8f75 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:56:57.566804 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-e10c16a9-ad63-4c2c-8e98-829186eb8f75 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:56:57.567237 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-e10c16a9-ad63-4c2c-8e98-829186eb8f75 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:56:57.568989 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-ed560b8d-7969-4c04-b62d-d53a4f03e80c tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:56:57.569767 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-ed560b8d-7969-4c04-b62d-d53a4f03e80c tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] [instance: 00959d34-6e9e-4c3d-a32b-1dfc66397406] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:56:57.578794 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-ed560b8d-7969-4c04-b62d-d53a4f03e80c tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:56:57.579420 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-ed560b8d-7969-4c04-b62d-d53a4f03e80c tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:56:57.580032 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-ed560b8d-7969-4c04-b62d-d53a4f03e80c tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:56:57.580995 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-ed560b8d-7969-4c04-b62d-d53a4f03e80c tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:56:57.581575 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-ed560b8d-7969-4c04-b62d-d53a4f03e80c tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:56:57.582010 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-ed560b8d-7969-4c04-b62d-d53a4f03e80c tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:56:57.682523 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-ed560b8d-7969-4c04-b62d-d53a4f03e80c tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10fc1a48c9c41eaa1bf3ff2e4109657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1976b27e84a4484ba9d46a4244b08699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:56:57.690697 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-ed560b8d-7969-4c04-b62d-d53a4f03e80c tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] 10.222.0.36 "GET /compute/v2.1/servers/00959d34-6e9e-4c3d-a32b-1dfc66397406" status: 200 len: 1293 microversion: 2.1 time: 0.127483 Oct 15 13:56:57.692058 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 449/877] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:56:57 2022] GET /compute/v2.1/servers/00959d34-6e9e-4c3d-a32b-1dfc66397406 => generated 1293 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:56:57.846727 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-e10c16a9-ad63-4c2c-8e98-829186eb8f75 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e530c3f544748bd3ffc256b1630b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a6be8e43c7742be84f4dc3c95a990e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:56:57.854041 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG dbcounter [-] [125243] Writing DB stats nova_cell1:SELECT=100 {{(pid=125243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:56:57.865470 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-e10c16a9-ad63-4c2c-8e98-829186eb8f75 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] 10.222.0.36 "GET /compute/v2.1/servers/1413aaed-46c7-4807-9d3b-957616dd4047" status: 200 len: 1575 microversion: 2.1 time: 0.312658 Oct 15 13:56:57.866550 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 429/878] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:56:57 2022] GET /compute/v2.1/servers/1413aaed-46c7-4807-9d3b-957616dd4047 => generated 1575 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:56:58.724526 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-6ba9b4a6-d2df-494b-aeb2-fbf2d877244d tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:56:58.725233 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-6ba9b4a6-d2df-494b-aeb2-fbf2d877244d tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] [instance: 00959d34-6e9e-4c3d-a32b-1dfc66397406] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:56:58.733201 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-6ba9b4a6-d2df-494b-aeb2-fbf2d877244d tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:56:58.733694 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-6ba9b4a6-d2df-494b-aeb2-fbf2d877244d tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:56:58.734130 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-6ba9b4a6-d2df-494b-aeb2-fbf2d877244d tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:56:58.734856 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-6ba9b4a6-d2df-494b-aeb2-fbf2d877244d tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:56:58.735309 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-6ba9b4a6-d2df-494b-aeb2-fbf2d877244d tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:56:58.735739 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-6ba9b4a6-d2df-494b-aeb2-fbf2d877244d tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:56:58.838615 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-6ba9b4a6-d2df-494b-aeb2-fbf2d877244d tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10fc1a48c9c41eaa1bf3ff2e4109657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1976b27e84a4484ba9d46a4244b08699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:56:58.853048 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-6ba9b4a6-d2df-494b-aeb2-fbf2d877244d tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] 10.222.0.36 "GET /compute/v2.1/servers/00959d34-6e9e-4c3d-a32b-1dfc66397406" status: 200 len: 1299 microversion: 2.1 time: 0.132262 Oct 15 13:56:58.853841 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 450/879] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:56:58 2022] GET /compute/v2.1/servers/00959d34-6e9e-4c3d-a32b-1dfc66397406 => generated 1299 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:56:58.903406 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-3b8ad086-4bd8-453f-b3ea-101107250ba2 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:56:58.904611 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-3b8ad086-4bd8-453f-b3ea-101107250ba2 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] [instance: 1413aaed-46c7-4807-9d3b-957616dd4047] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:56:58.915464 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-3b8ad086-4bd8-453f-b3ea-101107250ba2 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:56:58.916617 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-3b8ad086-4bd8-453f-b3ea-101107250ba2 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:56:58.917343 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-3b8ad086-4bd8-453f-b3ea-101107250ba2 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:56:58.918627 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-3b8ad086-4bd8-453f-b3ea-101107250ba2 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:56:58.919493 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-3b8ad086-4bd8-453f-b3ea-101107250ba2 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:56:58.920210 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-3b8ad086-4bd8-453f-b3ea-101107250ba2 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:56:59.204674 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-3b8ad086-4bd8-453f-b3ea-101107250ba2 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e530c3f544748bd3ffc256b1630b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a6be8e43c7742be84f4dc3c95a990e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:56:59.215730 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-3b8ad086-4bd8-453f-b3ea-101107250ba2 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] 10.222.0.36 "GET /compute/v2.1/servers/1413aaed-46c7-4807-9d3b-957616dd4047" status: 200 len: 1562 microversion: 2.1 time: 0.321451 Oct 15 13:56:59.227988 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 430/880] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:56:58 2022] GET /compute/v2.1/servers/1413aaed-46c7-4807-9d3b-957616dd4047 => generated 1562 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:56:59.892844 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-ecccbcfb-487d-472b-a2a2-40ed93178869 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:56:59.894057 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-ecccbcfb-487d-472b-a2a2-40ed93178869 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] [instance: 00959d34-6e9e-4c3d-a32b-1dfc66397406] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:56:59.906210 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-ecccbcfb-487d-472b-a2a2-40ed93178869 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:56:59.907065 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-ecccbcfb-487d-472b-a2a2-40ed93178869 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:56:59.907824 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-ecccbcfb-487d-472b-a2a2-40ed93178869 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:56:59.909130 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-ecccbcfb-487d-472b-a2a2-40ed93178869 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:56:59.909948 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-ecccbcfb-487d-472b-a2a2-40ed93178869 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:56:59.910724 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-ecccbcfb-487d-472b-a2a2-40ed93178869 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:57:00.031480 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [req-9a781b61-0b18-4bb4-abf2-851f9645824a req-cc3518da-e932-47e2-8c9c-df4b6ab43999 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00959d34-6e9e-4c3d-a32b-1dfc66397406", "tag": "ea820bb3-7b18-44f5-9f71-bc5999daab15"}]} {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 13:57:00.046182 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [req-9a781b61-0b18-4bb4-abf2-851f9645824a req-cc3518da-e932-47e2-8c9c-df4b6ab43999 service nova] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:57:00.047352 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [req-9a781b61-0b18-4bb4-abf2-851f9645824a req-cc3518da-e932-47e2-8c9c-df4b6ab43999 service nova] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:57:00.048339 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [req-9a781b61-0b18-4bb4-abf2-851f9645824a req-cc3518da-e932-47e2-8c9c-df4b6ab43999 service nova] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:57:00.066833 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.compute.server_external_events [req-9a781b61-0b18-4bb4-abf2-851f9645824a req-cc3518da-e932-47e2-8c9c-df4b6ab43999 service nova] Creating event network-changed:ea820bb3-7b18-44f5-9f71-bc5999daab15 for instance 00959d34-6e9e-4c3d-a32b-1dfc66397406 on hv-cinder-86149 Oct 15 13:57:00.073369 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [req-9a781b61-0b18-4bb4-abf2-851f9645824a req-cc3518da-e932-47e2-8c9c-df4b6ab43999 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044738 Oct 15 13:57:00.074194 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 431/881] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 15 13:57:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 15 13:57:00.217072 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-ecccbcfb-487d-472b-a2a2-40ed93178869 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10fc1a48c9c41eaa1bf3ff2e4109657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1976b27e84a4484ba9d46a4244b08699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:57:00.225562 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-ecccbcfb-487d-472b-a2a2-40ed93178869 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] 10.222.0.36 "GET /compute/v2.1/servers/00959d34-6e9e-4c3d-a32b-1dfc66397406" status: 200 len: 1366 microversion: 2.1 time: 0.340868 Oct 15 13:57:00.226285 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 451/882] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:56:59 2022] GET /compute/v2.1/servers/00959d34-6e9e-4c3d-a32b-1dfc66397406 => generated 1366 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:57:01.263110 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-fd148ed4-9461-4152-b943-6ac38d8beeb4 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:57:01.263904 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-fd148ed4-9461-4152-b943-6ac38d8beeb4 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] [instance: 00959d34-6e9e-4c3d-a32b-1dfc66397406] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:57:01.272724 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-fd148ed4-9461-4152-b943-6ac38d8beeb4 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:57:01.273216 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-fd148ed4-9461-4152-b943-6ac38d8beeb4 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:57:01.273646 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-fd148ed4-9461-4152-b943-6ac38d8beeb4 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:57:01.274727 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-fd148ed4-9461-4152-b943-6ac38d8beeb4 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:57:01.275188 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-fd148ed4-9461-4152-b943-6ac38d8beeb4 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:57:01.275605 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-fd148ed4-9461-4152-b943-6ac38d8beeb4 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:57:01.444846 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-fd148ed4-9461-4152-b943-6ac38d8beeb4 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10fc1a48c9c41eaa1bf3ff2e4109657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1976b27e84a4484ba9d46a4244b08699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:57:01.463908 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-fd148ed4-9461-4152-b943-6ac38d8beeb4 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] 10.222.0.36 "GET /compute/v2.1/servers/00959d34-6e9e-4c3d-a32b-1dfc66397406" status: 200 len: 1366 microversion: 2.1 time: 0.206461 Oct 15 13:57:01.464549 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 432/883] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:57:01 2022] GET /compute/v2.1/servers/00959d34-6e9e-4c3d-a32b-1dfc66397406 => generated 1366 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:57:02.488116 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-8682b302-3ee5-4822-8118-eda30f70913b tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:57:02.488691 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-8682b302-3ee5-4822-8118-eda30f70913b tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] [instance: 00959d34-6e9e-4c3d-a32b-1dfc66397406] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:57:02.495583 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-8682b302-3ee5-4822-8118-eda30f70913b tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:57:02.496125 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-8682b302-3ee5-4822-8118-eda30f70913b tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:57:02.496599 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-8682b302-3ee5-4822-8118-eda30f70913b tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:57:02.497326 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-8682b302-3ee5-4822-8118-eda30f70913b tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:57:02.497786 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-8682b302-3ee5-4822-8118-eda30f70913b tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:57:02.498219 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-8682b302-3ee5-4822-8118-eda30f70913b tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:57:02.675402 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-8682b302-3ee5-4822-8118-eda30f70913b tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10fc1a48c9c41eaa1bf3ff2e4109657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1976b27e84a4484ba9d46a4244b08699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:57:02.685137 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-8682b302-3ee5-4822-8118-eda30f70913b tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] 10.222.0.36 "GET /compute/v2.1/servers/00959d34-6e9e-4c3d-a32b-1dfc66397406" status: 200 len: 1366 microversion: 2.1 time: 0.201267 Oct 15 13:57:02.685823 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 452/884] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:57:02 2022] GET /compute/v2.1/servers/00959d34-6e9e-4c3d-a32b-1dfc66397406 => generated 1366 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 13:57:03.713336 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-3a667105-ecbe-4e8a-9e28-3a82d6fa7103 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:57:03.713929 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-3a667105-ecbe-4e8a-9e28-3a82d6fa7103 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] [instance: 00959d34-6e9e-4c3d-a32b-1dfc66397406] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:57:03.721558 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-3a667105-ecbe-4e8a-9e28-3a82d6fa7103 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:57:03.722132 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-3a667105-ecbe-4e8a-9e28-3a82d6fa7103 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:57:03.722704 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-3a667105-ecbe-4e8a-9e28-3a82d6fa7103 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:57:03.723518 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-3a667105-ecbe-4e8a-9e28-3a82d6fa7103 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:57:03.724114 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-3a667105-ecbe-4e8a-9e28-3a82d6fa7103 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:57:03.724613 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-3a667105-ecbe-4e8a-9e28-3a82d6fa7103 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:57:03.877101 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-3a667105-ecbe-4e8a-9e28-3a82d6fa7103 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10fc1a48c9c41eaa1bf3ff2e4109657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1976b27e84a4484ba9d46a4244b08699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:57:03.885544 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-3a667105-ecbe-4e8a-9e28-3a82d6fa7103 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] 10.222.0.36 "GET /compute/v2.1/servers/00959d34-6e9e-4c3d-a32b-1dfc66397406" status: 200 len: 1366 microversion: 2.1 time: 0.176707 Oct 15 13:57:03.886148 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 433/885] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:57:03 2022] GET /compute/v2.1/servers/00959d34-6e9e-4c3d-a32b-1dfc66397406 => generated 1366 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:57:04.910692 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-c737c50f-b11e-4daf-bb4d-8dcfb5c4b3e8 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:57:04.911328 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-c737c50f-b11e-4daf-bb4d-8dcfb5c4b3e8 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] [instance: 00959d34-6e9e-4c3d-a32b-1dfc66397406] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:57:04.918687 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-c737c50f-b11e-4daf-bb4d-8dcfb5c4b3e8 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:57:04.919191 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-c737c50f-b11e-4daf-bb4d-8dcfb5c4b3e8 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:57:04.919629 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-c737c50f-b11e-4daf-bb4d-8dcfb5c4b3e8 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:57:04.920366 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-c737c50f-b11e-4daf-bb4d-8dcfb5c4b3e8 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:57:04.920854 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-c737c50f-b11e-4daf-bb4d-8dcfb5c4b3e8 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:57:04.921287 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-c737c50f-b11e-4daf-bb4d-8dcfb5c4b3e8 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:57:05.064355 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-c737c50f-b11e-4daf-bb4d-8dcfb5c4b3e8 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10fc1a48c9c41eaa1bf3ff2e4109657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1976b27e84a4484ba9d46a4244b08699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:57:05.073199 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-c737c50f-b11e-4daf-bb4d-8dcfb5c4b3e8 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] 10.222.0.36 "GET /compute/v2.1/servers/00959d34-6e9e-4c3d-a32b-1dfc66397406" status: 200 len: 1366 microversion: 2.1 time: 0.166736 Oct 15 13:57:05.074030 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 453/886] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:57:04 2022] GET /compute/v2.1/servers/00959d34-6e9e-4c3d-a32b-1dfc66397406 => generated 1366 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:57:06.104205 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-1c798130-cbc3-4291-9187-59a387e5c915 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:57:06.104840 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-1c798130-cbc3-4291-9187-59a387e5c915 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] [instance: 00959d34-6e9e-4c3d-a32b-1dfc66397406] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:57:06.107809 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG dbcounter [-] [125243] Writing DB stats nova_cell0:SELECT=2 {{(pid=125243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:57:06.108510 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG dbcounter [-] [125243] Writing DB stats nova_cell0:SELECT=10 {{(pid=125243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:57:06.114834 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-1c798130-cbc3-4291-9187-59a387e5c915 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:57:06.115333 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-1c798130-cbc3-4291-9187-59a387e5c915 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:57:06.115777 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-1c798130-cbc3-4291-9187-59a387e5c915 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:57:06.116545 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-1c798130-cbc3-4291-9187-59a387e5c915 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:57:06.116974 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-1c798130-cbc3-4291-9187-59a387e5c915 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:57:06.117430 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-1c798130-cbc3-4291-9187-59a387e5c915 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:57:06.259561 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-1c798130-cbc3-4291-9187-59a387e5c915 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10fc1a48c9c41eaa1bf3ff2e4109657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1976b27e84a4484ba9d46a4244b08699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:57:06.267640 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-1c798130-cbc3-4291-9187-59a387e5c915 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] 10.222.0.36 "GET /compute/v2.1/servers/00959d34-6e9e-4c3d-a32b-1dfc66397406" status: 200 len: 1366 microversion: 2.1 time: 0.169846 Oct 15 13:57:06.268255 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 434/887] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:57:06 2022] GET /compute/v2.1/servers/00959d34-6e9e-4c3d-a32b-1dfc66397406 => generated 1366 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:57:06.447211 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-d6134ef2-17b9-4db5-b3d6-4c983963eac7 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1662270376"}} {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 13:57:06.447915 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-d6134ef2-17b9-4db5-b3d6-4c983963eac7 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] [instance: 6490290c-19e1-49db-9190-3b945ece5145] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:57:06.449910 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG dbcounter [-] [125242] Writing DB stats nova_cell0:SELECT=2 {{(pid=125242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:57:06.456526 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-d6134ef2-17b9-4db5-b3d6-4c983963eac7 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:57:06.457025 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-d6134ef2-17b9-4db5-b3d6-4c983963eac7 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:57:06.457464 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-d6134ef2-17b9-4db5-b3d6-4c983963eac7 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:57:06.458168 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-d6134ef2-17b9-4db5-b3d6-4c983963eac7 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:57:06.458638 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-d6134ef2-17b9-4db5-b3d6-4c983963eac7 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:57:06.459256 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-d6134ef2-17b9-4db5-b3d6-4c983963eac7 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:57:06.610482 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.network.security_group_api [None req-d6134ef2-17b9-4db5-b3d6-4c983963eac7 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Removing security group dfe7e769-8b2f-4486-b4ba-b22b15514c14 from port 3f885321-034d-42f2-a8c5-c0315db5a5eb Oct 15 13:57:06.962192 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-d6134ef2-17b9-4db5-b3d6-4c983963eac7 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] 10.222.0.36 "POST /compute/v2.1/servers/6490290c-19e1-49db-9190-3b945ece5145/action" status: 202 len: 0 microversion: 2.1 time: 0.520648 Oct 15 13:57:06.962969 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 454/888] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 15 13:57:06 2022] POST /compute/v2.1/servers/6490290c-19e1-49db-9190-3b945ece5145/action => generated 0 bytes in 522 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 15 13:57:06.971490 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [req-f50c6da8-7240-4915-af83-2390f14a8755 req-bae2a960-fb7b-4b0b-8849-9497855c0160 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6490290c-19e1-49db-9190-3b945ece5145", "tag": "3f885321-034d-42f2-a8c5-c0315db5a5eb"}]} {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 13:57:06.989987 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [req-f50c6da8-7240-4915-af83-2390f14a8755 req-bae2a960-fb7b-4b0b-8849-9497855c0160 service nova] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:57:06.990469 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [req-f50c6da8-7240-4915-af83-2390f14a8755 req-bae2a960-fb7b-4b0b-8849-9497855c0160 service nova] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:57:06.990898 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [req-f50c6da8-7240-4915-af83-2390f14a8755 req-bae2a960-fb7b-4b0b-8849-9497855c0160 service nova] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:57:07.002923 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.compute.server_external_events [req-f50c6da8-7240-4915-af83-2390f14a8755 req-bae2a960-fb7b-4b0b-8849-9497855c0160 service nova] Creating event network-changed:3f885321-034d-42f2-a8c5-c0315db5a5eb for instance 6490290c-19e1-49db-9190-3b945ece5145 on hv-cinder-86149 Oct 15 13:57:07.010527 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [req-f50c6da8-7240-4915-af83-2390f14a8755 req-bae2a960-fb7b-4b0b-8849-9497855c0160 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041770 Oct 15 13:57:07.011138 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 435/889] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 15 13:57:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 13:57:07.291474 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-72441621-f539-4256-a023-785ecc3ddc77 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:57:07.292208 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-72441621-f539-4256-a023-785ecc3ddc77 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] [instance: 00959d34-6e9e-4c3d-a32b-1dfc66397406] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:57:07.298477 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-72441621-f539-4256-a023-785ecc3ddc77 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:57:07.298970 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-72441621-f539-4256-a023-785ecc3ddc77 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:57:07.299405 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-72441621-f539-4256-a023-785ecc3ddc77 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:57:07.306668 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-72441621-f539-4256-a023-785ecc3ddc77 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:57:07.307155 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-72441621-f539-4256-a023-785ecc3ddc77 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:57:07.307587 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-72441621-f539-4256-a023-785ecc3ddc77 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:57:07.601335 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-72441621-f539-4256-a023-785ecc3ddc77 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10fc1a48c9c41eaa1bf3ff2e4109657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1976b27e84a4484ba9d46a4244b08699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:57:07.613091 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-72441621-f539-4256-a023-785ecc3ddc77 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] 10.222.0.36 "GET /compute/v2.1/servers/00959d34-6e9e-4c3d-a32b-1dfc66397406" status: 200 len: 1366 microversion: 2.1 time: 0.325973 Oct 15 13:57:07.613671 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 455/890] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:57:07 2022] GET /compute/v2.1/servers/00959d34-6e9e-4c3d-a32b-1dfc66397406 => generated 1366 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:57:07.790194 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [req-ad9819c6-bc2f-49b6-bb49-a5daf8e08d4b req-48ecca11-2c9f-41d9-988b-4feb8ddb03fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00959d34-6e9e-4c3d-a32b-1dfc66397406", "name": "network-vif-plugged", "status": "completed", "tag": "ea820bb3-7b18-44f5-9f71-bc5999daab15"}]} {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 13:57:07.809367 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [req-ad9819c6-bc2f-49b6-bb49-a5daf8e08d4b req-48ecca11-2c9f-41d9-988b-4feb8ddb03fb service nova] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:57:07.814451 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [req-ad9819c6-bc2f-49b6-bb49-a5daf8e08d4b req-48ecca11-2c9f-41d9-988b-4feb8ddb03fb service nova] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:57:07.815391 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [req-ad9819c6-bc2f-49b6-bb49-a5daf8e08d4b req-48ecca11-2c9f-41d9-988b-4feb8ddb03fb service nova] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:57:07.831846 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.compute.server_external_events [req-ad9819c6-bc2f-49b6-bb49-a5daf8e08d4b req-48ecca11-2c9f-41d9-988b-4feb8ddb03fb service nova] Creating event network-vif-plugged:ea820bb3-7b18-44f5-9f71-bc5999daab15 for instance 00959d34-6e9e-4c3d-a32b-1dfc66397406 on hv-cinder-86149 Oct 15 13:57:07.841005 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [req-ad9819c6-bc2f-49b6-bb49-a5daf8e08d4b req-48ecca11-2c9f-41d9-988b-4feb8ddb03fb service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058492 Oct 15 13:57:07.842191 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 436/891] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 15 13:57:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 13:57:08.641227 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-7b2ec583-613c-4c3d-a9ba-7fc61646f52f tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:57:08.643281 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-7b2ec583-613c-4c3d-a9ba-7fc61646f52f tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] [instance: 00959d34-6e9e-4c3d-a32b-1dfc66397406] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:57:08.654670 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-7b2ec583-613c-4c3d-a9ba-7fc61646f52f tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:57:08.655567 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-7b2ec583-613c-4c3d-a9ba-7fc61646f52f tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:57:08.656344 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-7b2ec583-613c-4c3d-a9ba-7fc61646f52f tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:57:08.657527 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-7b2ec583-613c-4c3d-a9ba-7fc61646f52f tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:57:08.658356 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-7b2ec583-613c-4c3d-a9ba-7fc61646f52f tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:57:08.659140 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-7b2ec583-613c-4c3d-a9ba-7fc61646f52f tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:57:08.747541 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-91abf180-8cdc-4ce7-8422-5ba16a9c53b4 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:57:08.748165 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-91abf180-8cdc-4ce7-8422-5ba16a9c53b4 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] [instance: 6490290c-19e1-49db-9190-3b945ece5145] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:57:08.755865 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-91abf180-8cdc-4ce7-8422-5ba16a9c53b4 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:57:08.756665 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-91abf180-8cdc-4ce7-8422-5ba16a9c53b4 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:57:08.757305 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-91abf180-8cdc-4ce7-8422-5ba16a9c53b4 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:57:08.758309 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-91abf180-8cdc-4ce7-8422-5ba16a9c53b4 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:57:08.758806 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-91abf180-8cdc-4ce7-8422-5ba16a9c53b4 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:57:08.759236 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-91abf180-8cdc-4ce7-8422-5ba16a9c53b4 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:57:08.819310 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-7b2ec583-613c-4c3d-a9ba-7fc61646f52f tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10fc1a48c9c41eaa1bf3ff2e4109657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1976b27e84a4484ba9d46a4244b08699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:57:08.829449 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-7b2ec583-613c-4c3d-a9ba-7fc61646f52f tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] 10.222.0.36 "GET /compute/v2.1/servers/00959d34-6e9e-4c3d-a32b-1dfc66397406" status: 200 len: 1366 microversion: 2.1 time: 0.195657 Oct 15 13:57:08.831131 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 456/892] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:57:08 2022] GET /compute/v2.1/servers/00959d34-6e9e-4c3d-a32b-1dfc66397406 => generated 1366 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:57:08.837244 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [req-83feb31f-6af2-48d0-930b-3d8888a810bf req-7e729752-f43c-47a6-a5d7-bb38c41e6f14 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6490290c-19e1-49db-9190-3b945ece5145", "tag": "3f885321-034d-42f2-a8c5-c0315db5a5eb"}]} {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 13:57:08.849466 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [req-83feb31f-6af2-48d0-930b-3d8888a810bf req-7e729752-f43c-47a6-a5d7-bb38c41e6f14 service nova] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:57:08.849959 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [req-83feb31f-6af2-48d0-930b-3d8888a810bf req-7e729752-f43c-47a6-a5d7-bb38c41e6f14 service nova] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:57:08.850390 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [req-83feb31f-6af2-48d0-930b-3d8888a810bf req-7e729752-f43c-47a6-a5d7-bb38c41e6f14 service nova] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:57:08.862842 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.compute.server_external_events [req-83feb31f-6af2-48d0-930b-3d8888a810bf req-7e729752-f43c-47a6-a5d7-bb38c41e6f14 service nova] Creating event network-changed:3f885321-034d-42f2-a8c5-c0315db5a5eb for instance 6490290c-19e1-49db-9190-3b945ece5145 on hv-cinder-86149 Oct 15 13:57:08.868744 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [req-83feb31f-6af2-48d0-930b-3d8888a810bf req-7e729752-f43c-47a6-a5d7-bb38c41e6f14 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036062 Oct 15 13:57:08.870003 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 457/893] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 15 13:57:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 13:57:08.892310 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.objects.instance [None req-91abf180-8cdc-4ce7-8422-5ba16a9c53b4 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lazy-loading 'services' on Instance uuid 6490290c-19e1-49db-9190-3b945ece5145 {{(pid=125243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 15 13:57:08.974165 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-91abf180-8cdc-4ce7-8422-5ba16a9c53b4 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] 10.222.0.36 "DELETE /compute/v2.1/servers/6490290c-19e1-49db-9190-3b945ece5145/os-volume_attachments/1290f442-4d94-4f2c-a099-95a6910dc895" status: 202 len: 0 microversion: 2.1 time: 0.232328 Oct 15 13:57:08.974771 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 437/894] 10.222.0.36 () {58 vars in 1416 bytes} [Sat Oct 15 13:57:08 2022] DELETE /compute/v2.1/servers/6490290c-19e1-49db-9190-3b945ece5145/os-volume_attachments/1290f442-4d94-4f2c-a099-95a6910dc895 => generated 0 bytes in 234 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 15 13:57:08.984692 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-b16c093f-62af-4f5f-98f2-71cd0f70903a tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:57:08.987041 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-b16c093f-62af-4f5f-98f2-71cd0f70903a tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] [instance: 6490290c-19e1-49db-9190-3b945ece5145] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:57:08.993965 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-b16c093f-62af-4f5f-98f2-71cd0f70903a tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:57:08.994758 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-b16c093f-62af-4f5f-98f2-71cd0f70903a tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:57:08.995188 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-b16c093f-62af-4f5f-98f2-71cd0f70903a tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:57:08.996106 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-b16c093f-62af-4f5f-98f2-71cd0f70903a tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:57:08.996573 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-b16c093f-62af-4f5f-98f2-71cd0f70903a tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:57:08.996997 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-b16c093f-62af-4f5f-98f2-71cd0f70903a tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:57:09.017023 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG dbcounter [-] [125242] Writing DB stats nova_cell1:SELECT=100 {{(pid=125242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:57:09.034245 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-b16c093f-62af-4f5f-98f2-71cd0f70903a tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] 10.222.0.36 "GET /compute/v2.1/servers/6490290c-19e1-49db-9190-3b945ece5145/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054338 Oct 15 13:57:09.039430 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 458/895] 10.222.0.36 () {58 vars in 1302 bytes} [Sat Oct 15 13:57:08 2022] GET /compute/v2.1/servers/6490290c-19e1-49db-9190-3b945ece5145/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 13:57:09.855489 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-d6fac702-6206-4263-bfd8-2b0562c5358a tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:57:09.856541 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-d6fac702-6206-4263-bfd8-2b0562c5358a tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] [instance: 00959d34-6e9e-4c3d-a32b-1dfc66397406] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:57:09.872472 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-d6fac702-6206-4263-bfd8-2b0562c5358a tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:57:09.873246 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-d6fac702-6206-4263-bfd8-2b0562c5358a tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:57:09.873660 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-d6fac702-6206-4263-bfd8-2b0562c5358a tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:57:09.874556 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-d6fac702-6206-4263-bfd8-2b0562c5358a tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:57:09.875009 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-d6fac702-6206-4263-bfd8-2b0562c5358a tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:57:09.875430 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-d6fac702-6206-4263-bfd8-2b0562c5358a tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:57:10.029152 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-d6fac702-6206-4263-bfd8-2b0562c5358a tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10fc1a48c9c41eaa1bf3ff2e4109657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1976b27e84a4484ba9d46a4244b08699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:57:10.037755 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-d6fac702-6206-4263-bfd8-2b0562c5358a tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] 10.222.0.36 "GET /compute/v2.1/servers/00959d34-6e9e-4c3d-a32b-1dfc66397406" status: 200 len: 1556 microversion: 2.1 time: 0.187473 Oct 15 13:57:10.038381 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 438/896] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:57:09 2022] GET /compute/v2.1/servers/00959d34-6e9e-4c3d-a32b-1dfc66397406 => generated 1556 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:57:10.047026 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-7ca4efea-ff21-4994-a7ea-49171a48fc26 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:57:10.049275 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-7ca4efea-ff21-4994-a7ea-49171a48fc26 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] [instance: 6490290c-19e1-49db-9190-3b945ece5145] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:57:10.056261 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-7ca4efea-ff21-4994-a7ea-49171a48fc26 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:57:10.056749 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-7ca4efea-ff21-4994-a7ea-49171a48fc26 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:57:10.057180 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-7ca4efea-ff21-4994-a7ea-49171a48fc26 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:57:10.057884 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-7ca4efea-ff21-4994-a7ea-49171a48fc26 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:57:10.058326 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-7ca4efea-ff21-4994-a7ea-49171a48fc26 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:57:10.058741 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-7ca4efea-ff21-4994-a7ea-49171a48fc26 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:57:10.060550 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-c7155e7d-880a-4a09-a553-327aab2011b6 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:57:10.061034 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-c7155e7d-880a-4a09-a553-327aab2011b6 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] [instance: 00959d34-6e9e-4c3d-a32b-1dfc66397406] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:57:10.067475 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-c7155e7d-880a-4a09-a553-327aab2011b6 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:57:10.068006 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-c7155e7d-880a-4a09-a553-327aab2011b6 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:57:10.068443 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-c7155e7d-880a-4a09-a553-327aab2011b6 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:57:10.069146 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-c7155e7d-880a-4a09-a553-327aab2011b6 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:57:10.069595 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-c7155e7d-880a-4a09-a553-327aab2011b6 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:57:10.070018 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-c7155e7d-880a-4a09-a553-327aab2011b6 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:57:10.090071 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-7ca4efea-ff21-4994-a7ea-49171a48fc26 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] 10.222.0.36 "GET /compute/v2.1/servers/6490290c-19e1-49db-9190-3b945ece5145/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047017 Oct 15 13:57:10.090565 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 459/897] 10.222.0.36 () {58 vars in 1302 bytes} [Sat Oct 15 13:57:10 2022] GET /compute/v2.1/servers/6490290c-19e1-49db-9190-3b945ece5145/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 13:57:10.154736 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-c7155e7d-880a-4a09-a553-327aab2011b6 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] 10.222.0.36 "GET /compute/v2.1/servers/00959d34-6e9e-4c3d-a32b-1dfc66397406/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.098030 Oct 15 13:57:10.155347 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 439/898] 10.222.0.36 () {58 vars in 1275 bytes} [Sat Oct 15 13:57:10 2022] GET /compute/v2.1/servers/00959d34-6e9e-4c3d-a32b-1dfc66397406/os-interface => generated 284 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 13:57:11.105764 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-69cf0978-8710-4b24-a8b9-40904a48b320 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:57:11.110339 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-69cf0978-8710-4b24-a8b9-40904a48b320 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] [instance: 6490290c-19e1-49db-9190-3b945ece5145] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:57:11.122078 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-69cf0978-8710-4b24-a8b9-40904a48b320 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:57:11.122960 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-69cf0978-8710-4b24-a8b9-40904a48b320 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:57:11.123752 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-69cf0978-8710-4b24-a8b9-40904a48b320 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:57:11.125056 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-69cf0978-8710-4b24-a8b9-40904a48b320 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:57:11.126018 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-69cf0978-8710-4b24-a8b9-40904a48b320 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:57:11.126799 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-69cf0978-8710-4b24-a8b9-40904a48b320 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:57:11.163525 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-69cf0978-8710-4b24-a8b9-40904a48b320 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] 10.222.0.36 "GET /compute/v2.1/servers/6490290c-19e1-49db-9190-3b945ece5145/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.064965 Oct 15 13:57:11.170110 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 460/899] 10.222.0.36 () {58 vars in 1302 bytes} [Sat Oct 15 13:57:11 2022] GET /compute/v2.1/servers/6490290c-19e1-49db-9190-3b945ece5145/os-volume_attachments => generated 25 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 15 13:57:11.177176 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-2a44cba9-cbb5-41f5-8540-a524f102eb89 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:57:11.177769 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-2a44cba9-cbb5-41f5-8540-a524f102eb89 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] [instance: 6490290c-19e1-49db-9190-3b945ece5145] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:57:11.187249 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-2a44cba9-cbb5-41f5-8540-a524f102eb89 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:57:11.187937 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-2a44cba9-cbb5-41f5-8540-a524f102eb89 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:57:11.188469 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-2a44cba9-cbb5-41f5-8540-a524f102eb89 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:57:11.189164 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-2a44cba9-cbb5-41f5-8540-a524f102eb89 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:57:11.189610 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-2a44cba9-cbb5-41f5-8540-a524f102eb89 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:57:11.190215 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-2a44cba9-cbb5-41f5-8540-a524f102eb89 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:57:11.270464 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.wsgi [None req-2a44cba9-cbb5-41f5-8540-a524f102eb89 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] HTTP exception thrown: Instance 6490290c-19e1-49db-9190-3b945ece5145 is not attached to volume 1290f442-4d94-4f2c-a099-95a6910dc895 Oct 15 13:57:11.282709 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-2a44cba9-cbb5-41f5-8540-a524f102eb89 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Request method failure captured: Oct 15 13:57:11.282709 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: request: DELETE /compute/v2.1/servers/6490290c-19e1-49db-9190-3b945ece5145/os-volume_attachments/1290f442-4d94-4f2c-a099-95a6910dc895 HTTP/1.1 Oct 15 13:57:11.282709 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: Accept: application/json Oct 15 13:57:11.282709 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: Accept-Encoding: identity Oct 15 13:57:11.282709 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: Connection: close Oct 15 13:57:11.282709 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: Content-Length: 0 Oct 15 13:57:11.282709 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: Content-Type: application/json Oct 15 13:57:11.282709 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: Host: 10.222.0.36 Oct 15 13:57:11.282709 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: Openstack-System-Scope: None Oct 15 13:57:11.282709 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: User-Agent: python-urllib3/1.26.12 Oct 15 13:57:11.282709 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Auth-Token: gAAAAABjSrsNSbOo69K33arC2MCP-RPPiRDoFKpAxW6VsXBgtq2iaYJUqodqwrpN6e5UjuywHuxnbGrRcz0Rd7HsrlRnjauGH3aK1orLFlQUIVEMmQlNx1zyedaHaGXykrBvixoCtZgUsMGVlq_xz_ruAJjOdL8o4KL8B28ieC0lBb6cO7UaZKc Oct 15 13:57:11.282709 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Domain-Id: None Oct 15 13:57:11.282709 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Domain-Name: None Oct 15 13:57:11.282709 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Identity-Status: Confirmed Oct 15 13:57:11.282709 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Is-Admin-Project: True Oct 15 13:57:11.282709 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Project-Domain-Id: default Oct 15 13:57:11.282709 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Project-Domain-Name: Default Oct 15 13:57:11.282709 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Project-Id: e752c3aef55649ea98ec1a2f3607c27f Oct 15 13:57:11.282709 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Project-Name: tempest-TestMinimumBasicScenario-2104592170 Oct 15 13:57:11.282709 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Role: member,reader Oct 15 13:57:11.282709 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Roles: member,reader Oct 15 13:57:11.284273 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_e752c3aef55649ea98ec1a2f3607c27f", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e752c3aef55649ea98ec1a2f3607c27f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e752c3aef55649ea98ec1a2f3607c27f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/e752c3aef55649ea98ec1a2f3607c27f"}]}] Oct 15 13:57:11.284273 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Tenant: tempest-TestMinimumBasicScenario-2104592170 Oct 15 13:57:11.284273 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Tenant-Id: e752c3aef55649ea98ec1a2f3607c27f Oct 15 13:57:11.284273 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Tenant-Name: tempest-TestMinimumBasicScenario-2104592170 Oct 15 13:57:11.284273 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-User: tempest-TestMinimumBasicScenario-2104592170-project Oct 15 13:57:11.284273 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-User-Domain-Id: default Oct 15 13:57:11.284273 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-User-Domain-Name: Default Oct 15 13:57:11.284273 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-User-Id: dc83c1c8fce04c57a685de883344b7e6 Oct 15 13:57:11.284273 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-User-Name: tempest-TestMinimumBasicScenario-2104592170-project Oct 15 13:57:11.284273 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: method: > Oct 15 13:57:11.284273 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: exception: Instance 6490290c-19e1-49db-9190-3b945ece5145 is not attached to volume 1290f442-4d94-4f2c-a099-95a6910dc895 Oct 15 13:57:11.284988 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: action_args: {'server_id': '6490290c-19e1-49db-9190-3b945ece5145', 'id': '1290f442-4d94-4f2c-a099-95a6910dc895'} Oct 15 13:57:11.284988 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 15 13:57:11.284988 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 13:57:11.284988 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 15 13:57:11.284988 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 15 13:57:11.284988 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 15 13:57:11.284988 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 15 13:57:11.284988 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 15 13:57:11.284988 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 15 13:57:11.284988 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 1290f442-4d94-4f2c-a099-95a6910dc895. Oct 15 13:57:11.284988 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Oct 15 13:57:11.284988 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 13:57:11.284988 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Oct 15 13:57:11.284988 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 13:57:11.284988 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 13:57:11.284988 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 13:57:11.284988 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 15 13:57:11.284988 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 15 13:57:11.284988 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 15 13:57:11.286224 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 15 13:57:11.286224 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 15 13:57:11.286224 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 15 13:57:11.286224 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6490290c-19e1-49db-9190-3b945ece5145 is not attached to volume 1290f442-4d94-4f2c-a099-95a6910dc895 Oct 15 13:57:11.286224 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Oct 15 13:57:11.286224 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 13:57:11.286224 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Oct 15 13:57:11.286224 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 13:57:11.286224 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 13:57:11.286224 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 13:57:11.286224 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 15 13:57:11.286224 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 15 13:57:11.286224 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6490290c-19e1-49db-9190-3b945ece5145 is not attached to volume 1290f442-4d94-4f2c-a099-95a6910dc895 Oct 15 13:57:11.286224 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Oct 15 13:57:11.286224 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-2a44cba9-cbb5-41f5-8540-a524f102eb89 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Returning 404 to user: Instance 6490290c-19e1-49db-9190-3b945ece5145 is not attached to volume 1290f442-4d94-4f2c-a099-95a6910dc895 {{(pid=125243) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 15 13:57:11.287182 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-2a44cba9-cbb5-41f5-8540-a524f102eb89 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] 10.222.0.36 "DELETE /compute/v2.1/servers/6490290c-19e1-49db-9190-3b945ece5145/os-volume_attachments/1290f442-4d94-4f2c-a099-95a6910dc895" status: 404 len: 154 microversion: 2.1 time: 0.113028 Oct 15 13:57:11.287182 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 440/900] 10.222.0.36 () {58 vars in 1416 bytes} [Sat Oct 15 13:57:11 2022] DELETE /compute/v2.1/servers/6490290c-19e1-49db-9190-3b945ece5145/os-volume_attachments/1290f442-4d94-4f2c-a099-95a6910dc895 => generated 154 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 15 13:57:11.661890 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [req-63c847e2-4e17-40fe-893b-3b8544d8d5dd req-f1995099-d007-4946-a82d-c94ba436a24f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00959d34-6e9e-4c3d-a32b-1dfc66397406", "tag": "ea820bb3-7b18-44f5-9f71-bc5999daab15"}]} {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 13:57:11.671412 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [req-63c847e2-4e17-40fe-893b-3b8544d8d5dd req-f1995099-d007-4946-a82d-c94ba436a24f service nova] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:57:11.672016 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [req-63c847e2-4e17-40fe-893b-3b8544d8d5dd req-f1995099-d007-4946-a82d-c94ba436a24f service nova] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:57:11.672447 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [req-63c847e2-4e17-40fe-893b-3b8544d8d5dd req-f1995099-d007-4946-a82d-c94ba436a24f service nova] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:57:11.686134 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.compute.server_external_events [req-63c847e2-4e17-40fe-893b-3b8544d8d5dd req-f1995099-d007-4946-a82d-c94ba436a24f service nova] Creating event network-changed:ea820bb3-7b18-44f5-9f71-bc5999daab15 for instance 00959d34-6e9e-4c3d-a32b-1dfc66397406 on hv-cinder-86149 Oct 15 13:57:11.691581 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [req-63c847e2-4e17-40fe-893b-3b8544d8d5dd req-f1995099-d007-4946-a82d-c94ba436a24f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033470 Oct 15 13:57:11.692481 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 461/901] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 15 13:57:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 13:57:12.443204 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-87b85aec-6e5b-41c6-beb9-13e43510937b tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:57:12.444107 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-87b85aec-6e5b-41c6-beb9-13e43510937b tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] [instance: 6490290c-19e1-49db-9190-3b945ece5145] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:57:12.450761 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-87b85aec-6e5b-41c6-beb9-13e43510937b tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:57:12.451263 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-87b85aec-6e5b-41c6-beb9-13e43510937b tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:57:12.451702 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-87b85aec-6e5b-41c6-beb9-13e43510937b tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:57:12.452432 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-87b85aec-6e5b-41c6-beb9-13e43510937b tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:57:12.452892 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-87b85aec-6e5b-41c6-beb9-13e43510937b tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:57:12.453317 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-87b85aec-6e5b-41c6-beb9-13e43510937b tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:57:12.483678 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-87b85aec-6e5b-41c6-beb9-13e43510937b tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] [instance: 6490290c-19e1-49db-9190-3b945ece5145] Going to try to terminate instance {{(pid=125243) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 15 13:57:12.574488 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-87b85aec-6e5b-41c6-beb9-13e43510937b tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] 10.222.0.36 "DELETE /compute/v2.1/servers/6490290c-19e1-49db-9190-3b945ece5145" status: 204 len: 0 microversion: 2.1 time: 0.135371 Oct 15 13:57:12.575545 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 441/902] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 15 13:57:12 2022] DELETE /compute/v2.1/servers/6490290c-19e1-49db-9190-3b945ece5145 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 15 13:57:12.585757 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-6377c3f9-a3f8-4c56-a7bd-99bf4f2c52c7 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:57:12.586481 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-6377c3f9-a3f8-4c56-a7bd-99bf4f2c52c7 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] [instance: 6490290c-19e1-49db-9190-3b945ece5145] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:57:12.593548 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-6377c3f9-a3f8-4c56-a7bd-99bf4f2c52c7 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:57:12.594143 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-6377c3f9-a3f8-4c56-a7bd-99bf4f2c52c7 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:57:12.594597 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-6377c3f9-a3f8-4c56-a7bd-99bf4f2c52c7 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:57:12.595343 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-6377c3f9-a3f8-4c56-a7bd-99bf4f2c52c7 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:57:12.595859 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-6377c3f9-a3f8-4c56-a7bd-99bf4f2c52c7 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:57:12.596258 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-6377c3f9-a3f8-4c56-a7bd-99bf4f2c52c7 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:57:12.734742 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-6377c3f9-a3f8-4c56-a7bd-99bf4f2c52c7 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83c1c8fce04c57a685de883344b7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e752c3aef55649ea98ec1a2f3607c27f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:57:12.744279 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-6377c3f9-a3f8-4c56-a7bd-99bf4f2c52c7 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] 10.222.0.36 "GET /compute/v2.1/servers/6490290c-19e1-49db-9190-3b945ece5145" status: 200 len: 1555 microversion: 2.1 time: 0.163006 Oct 15 13:57:12.744867 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 462/903] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:57:12 2022] GET /compute/v2.1/servers/6490290c-19e1-49db-9190-3b945ece5145 => generated 1555 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:57:13.772366 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-6a96e460-cf64-4972-bf70-35a5835dd3bc tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:57:13.773056 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-6a96e460-cf64-4972-bf70-35a5835dd3bc tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] [instance: 6490290c-19e1-49db-9190-3b945ece5145] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:57:13.780397 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-6a96e460-cf64-4972-bf70-35a5835dd3bc tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:57:13.780876 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-6a96e460-cf64-4972-bf70-35a5835dd3bc tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:57:13.781303 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-6a96e460-cf64-4972-bf70-35a5835dd3bc tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:57:13.781994 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-6a96e460-cf64-4972-bf70-35a5835dd3bc tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:57:13.782437 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-6a96e460-cf64-4972-bf70-35a5835dd3bc tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:57:13.782853 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-6a96e460-cf64-4972-bf70-35a5835dd3bc tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:57:13.933069 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-6a96e460-cf64-4972-bf70-35a5835dd3bc tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83c1c8fce04c57a685de883344b7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e752c3aef55649ea98ec1a2f3607c27f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:57:13.948541 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-6a96e460-cf64-4972-bf70-35a5835dd3bc tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] 10.222.0.36 "GET /compute/v2.1/servers/6490290c-19e1-49db-9190-3b945ece5145" status: 200 len: 1555 microversion: 2.1 time: 0.180588 Oct 15 13:57:13.949133 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 442/904] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:57:13 2022] GET /compute/v2.1/servers/6490290c-19e1-49db-9190-3b945ece5145 => generated 1555 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:57:14.972884 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-dc8aab6f-be2f-4f80-82bf-5e6e71c5fa15 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:57:14.973477 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-dc8aab6f-be2f-4f80-82bf-5e6e71c5fa15 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] [instance: 6490290c-19e1-49db-9190-3b945ece5145] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:57:14.980496 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-dc8aab6f-be2f-4f80-82bf-5e6e71c5fa15 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:57:14.981628 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-dc8aab6f-be2f-4f80-82bf-5e6e71c5fa15 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:57:14.982094 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-dc8aab6f-be2f-4f80-82bf-5e6e71c5fa15 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:57:14.982882 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-dc8aab6f-be2f-4f80-82bf-5e6e71c5fa15 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:57:14.983333 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-dc8aab6f-be2f-4f80-82bf-5e6e71c5fa15 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:57:14.983754 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-dc8aab6f-be2f-4f80-82bf-5e6e71c5fa15 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:57:15.129316 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-dc8aab6f-be2f-4f80-82bf-5e6e71c5fa15 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83c1c8fce04c57a685de883344b7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e752c3aef55649ea98ec1a2f3607c27f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:57:15.139983 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-dc8aab6f-be2f-4f80-82bf-5e6e71c5fa15 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] 10.222.0.36 "GET /compute/v2.1/servers/6490290c-19e1-49db-9190-3b945ece5145" status: 200 len: 1555 microversion: 2.1 time: 0.170612 Oct 15 13:57:15.140787 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 463/905] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:57:14 2022] GET /compute/v2.1/servers/6490290c-19e1-49db-9190-3b945ece5145 => generated 1555 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:57:15.236601 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [req-5529ac18-b391-46b9-a4a9-f9a4fa827590 req-4dc3d269-46b2-4cd3-b5dc-ee53845d7606 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6490290c-19e1-49db-9190-3b945ece5145", "name": "network-vif-deleted", "tag": "3f885321-034d-42f2-a8c5-c0315db5a5eb"}]} {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 13:57:15.242496 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG dbcounter [-] [125243] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=125243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:57:15.250406 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [req-5529ac18-b391-46b9-a4a9-f9a4fa827590 req-4dc3d269-46b2-4cd3-b5dc-ee53845d7606 service nova] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:57:15.250908 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [req-5529ac18-b391-46b9-a4a9-f9a4fa827590 req-4dc3d269-46b2-4cd3-b5dc-ee53845d7606 service nova] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:57:15.251326 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [req-5529ac18-b391-46b9-a4a9-f9a4fa827590 req-4dc3d269-46b2-4cd3-b5dc-ee53845d7606 service nova] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:57:15.264555 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.compute.server_external_events [req-5529ac18-b391-46b9-a4a9-f9a4fa827590 req-4dc3d269-46b2-4cd3-b5dc-ee53845d7606 service nova] Creating event network-vif-deleted:3f885321-034d-42f2-a8c5-c0315db5a5eb for instance 6490290c-19e1-49db-9190-3b945ece5145 on hv-cinder-86149 Oct 15 13:57:15.269986 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [req-5529ac18-b391-46b9-a4a9-f9a4fa827590 req-4dc3d269-46b2-4cd3-b5dc-ee53845d7606 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037127 Oct 15 13:57:15.270599 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 443/906] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 15 13:57:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 13:57:16.171276 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-85748457-7534-444e-bcbd-52d3a0eb0440 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:57:16.171831 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-85748457-7534-444e-bcbd-52d3a0eb0440 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] [instance: 6490290c-19e1-49db-9190-3b945ece5145] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:57:16.179008 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-85748457-7534-444e-bcbd-52d3a0eb0440 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:57:16.179499 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-85748457-7534-444e-bcbd-52d3a0eb0440 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:57:16.179960 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-85748457-7534-444e-bcbd-52d3a0eb0440 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:57:16.181057 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-85748457-7534-444e-bcbd-52d3a0eb0440 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:57:16.181784 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-85748457-7534-444e-bcbd-52d3a0eb0440 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:57:16.182587 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-85748457-7534-444e-bcbd-52d3a0eb0440 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:57:16.196604 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.wsgi [None req-85748457-7534-444e-bcbd-52d3a0eb0440 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] HTTP exception thrown: Instance 6490290c-19e1-49db-9190-3b945ece5145 could not be found. Oct 15 13:57:16.198360 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-85748457-7534-444e-bcbd-52d3a0eb0440 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Request method failure captured: Oct 15 13:57:16.198360 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: request: GET /compute/v2.1/servers/6490290c-19e1-49db-9190-3b945ece5145 HTTP/1.1 Oct 15 13:57:16.198360 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Accept: application/json Oct 15 13:57:16.198360 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Accept-Encoding: identity Oct 15 13:57:16.198360 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Connection: close Oct 15 13:57:16.198360 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Content-Length: 0 Oct 15 13:57:16.198360 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Content-Type: application/json Oct 15 13:57:16.198360 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Host: 10.222.0.36 Oct 15 13:57:16.198360 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Openstack-System-Scope: None Oct 15 13:57:16.198360 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: User-Agent: python-urllib3/1.26.12 Oct 15 13:57:16.198360 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Auth-Token: gAAAAABjSrsNSbOo69K33arC2MCP-RPPiRDoFKpAxW6VsXBgtq2iaYJUqodqwrpN6e5UjuywHuxnbGrRcz0Rd7HsrlRnjauGH3aK1orLFlQUIVEMmQlNx1zyedaHaGXykrBvixoCtZgUsMGVlq_xz_ruAJjOdL8o4KL8B28ieC0lBb6cO7UaZKc Oct 15 13:57:16.198360 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Domain-Id: None Oct 15 13:57:16.198360 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Domain-Name: None Oct 15 13:57:16.198360 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Identity-Status: Confirmed Oct 15 13:57:16.198360 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Is-Admin-Project: True Oct 15 13:57:16.198360 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Project-Domain-Id: default Oct 15 13:57:16.198360 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Project-Domain-Name: Default Oct 15 13:57:16.198360 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Project-Id: e752c3aef55649ea98ec1a2f3607c27f Oct 15 13:57:16.198360 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Project-Name: tempest-TestMinimumBasicScenario-2104592170 Oct 15 13:57:16.198360 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Role: member,reader Oct 15 13:57:16.198360 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Roles: member,reader Oct 15 13:57:16.199895 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_e752c3aef55649ea98ec1a2f3607c27f", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e752c3aef55649ea98ec1a2f3607c27f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e752c3aef55649ea98ec1a2f3607c27f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/e752c3aef55649ea98ec1a2f3607c27f"}]}] Oct 15 13:57:16.199895 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Tenant: tempest-TestMinimumBasicScenario-2104592170 Oct 15 13:57:16.199895 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Tenant-Id: e752c3aef55649ea98ec1a2f3607c27f Oct 15 13:57:16.199895 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Tenant-Name: tempest-TestMinimumBasicScenario-2104592170 Oct 15 13:57:16.199895 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-User: tempest-TestMinimumBasicScenario-2104592170-project Oct 15 13:57:16.199895 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-User-Domain-Id: default Oct 15 13:57:16.199895 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-User-Domain-Name: Default Oct 15 13:57:16.199895 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-User-Id: dc83c1c8fce04c57a685de883344b7e6 Oct 15 13:57:16.199895 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-User-Name: tempest-TestMinimumBasicScenario-2104592170-project Oct 15 13:57:16.199895 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: method: > Oct 15 13:57:16.199895 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: exception: Instance 6490290c-19e1-49db-9190-3b945ece5145 could not be found. Oct 15 13:57:16.199895 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: action_args: {'id': '6490290c-19e1-49db-9190-3b945ece5145'} Oct 15 13:57:16.200657 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 15 13:57:16.200657 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 13:57:16.200657 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 15 13:57:16.200657 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 15 13:57:16.200657 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 15 13:57:16.200657 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 15 13:57:16.200657 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 15 13:57:16.200657 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 15 13:57:16.200657 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 15 13:57:16.200657 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 15 13:57:16.200657 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6490290c-19e1-49db-9190-3b945ece5145 could not be found. Oct 15 13:57:16.200657 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Oct 15 13:57:16.200657 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 13:57:16.200657 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Oct 15 13:57:16.200657 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 13:57:16.200657 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 13:57:16.200657 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 13:57:16.200657 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 15 13:57:16.200657 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 15 13:57:16.200657 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 15 13:57:16.201980 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 15 13:57:16.201980 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 15 13:57:16.201980 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 15 13:57:16.201980 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 15 13:57:16.201980 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 15 13:57:16.201980 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 15 13:57:16.201980 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 15 13:57:16.201980 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6490290c-19e1-49db-9190-3b945ece5145 could not be found. Oct 15 13:57:16.201980 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Oct 15 13:57:16.201980 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 13:57:16.201980 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Oct 15 13:57:16.201980 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 13:57:16.201980 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 13:57:16.201980 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 13:57:16.201980 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 15 13:57:16.201980 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 15 13:57:16.201980 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6490290c-19e1-49db-9190-3b945ece5145 could not be found. Oct 15 13:57:16.201980 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Oct 15 13:57:16.203344 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-85748457-7534-444e-bcbd-52d3a0eb0440 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Returning 404 to user: Instance 6490290c-19e1-49db-9190-3b945ece5145 could not be found. {{(pid=125242) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 15 13:57:16.203344 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-85748457-7534-444e-bcbd-52d3a0eb0440 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] 10.222.0.36 "GET /compute/v2.1/servers/6490290c-19e1-49db-9190-3b945ece5145" status: 404 len: 111 microversion: 2.1 time: 0.032674 Oct 15 13:57:16.203344 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 464/907] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:57:16 2022] GET /compute/v2.1/servers/6490290c-19e1-49db-9190-3b945ece5145 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 15 13:57:16.209448 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-437602a0-7f15-4b8f-8efe-5218246ee081 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] Calling method '.version_select at 0x7f1b5e11b3a0>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:57:16.234316 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-437602a0-7f15-4b8f-8efe-5218246ee081 tempest-TestMinimumBasicScenario-2104592170 tempest-TestMinimumBasicScenario-2104592170-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1750106181" status: 202 len: 0 microversion: 2.1 time: 0.028889 Oct 15 13:57:16.235058 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 444/908] 10.222.0.36 () {58 vars in 1272 bytes} [Sat Oct 15 13:57:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1750106181 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 15 13:57:30.767091 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-210db210-0650-4796-96a2-4d16b91598d0 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:57:30.767716 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-210db210-0650-4796-96a2-4d16b91598d0 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] [instance: 9209310f-9812-4e8e-9a64-a46690948204] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:57:30.771015 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG dbcounter [-] [125242] Writing DB stats nova_api:SELECT=53 {{(pid=125242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:57:30.771763 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG dbcounter [-] [125242] Writing DB stats nova_cell1:SELECT=30 {{(pid=125242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:57:30.779611 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-210db210-0650-4796-96a2-4d16b91598d0 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:57:30.780228 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-210db210-0650-4796-96a2-4d16b91598d0 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:57:30.780848 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-210db210-0650-4796-96a2-4d16b91598d0 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:57:30.781790 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-210db210-0650-4796-96a2-4d16b91598d0 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:57:30.782426 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-210db210-0650-4796-96a2-4d16b91598d0 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:57:30.783052 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-210db210-0650-4796-96a2-4d16b91598d0 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:57:30.818385 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-210db210-0650-4796-96a2-4d16b91598d0 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] [instance: 9209310f-9812-4e8e-9a64-a46690948204] Going to try to terminate instance {{(pid=125242) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 15 13:57:30.907110 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-210db210-0650-4796-96a2-4d16b91598d0 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] 10.222.0.36 "DELETE /compute/v2.1/servers/9209310f-9812-4e8e-9a64-a46690948204" status: 204 len: 0 microversion: 2.1 time: 0.145749 Oct 15 13:57:30.907733 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 465/909] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 15 13:57:30 2022] DELETE /compute/v2.1/servers/9209310f-9812-4e8e-9a64-a46690948204 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 15 13:57:30.913809 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG dbcounter [-] [125243] Writing DB stats nova_cell1:SELECT=77,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=125243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:57:30.914663 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG dbcounter [-] [125243] Writing DB stats nova_api:SELECT=4,nova_api:DELETE=1 {{(pid=125243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:57:30.918785 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-e5b10743-ca3a-419b-bcc5-0b025bca9736 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:57:30.919496 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-e5b10743-ca3a-419b-bcc5-0b025bca9736 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] [instance: 9209310f-9812-4e8e-9a64-a46690948204] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:57:30.927137 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-e5b10743-ca3a-419b-bcc5-0b025bca9736 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:57:30.927628 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-e5b10743-ca3a-419b-bcc5-0b025bca9736 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:57:30.928110 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-e5b10743-ca3a-419b-bcc5-0b025bca9736 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:57:30.928833 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-e5b10743-ca3a-419b-bcc5-0b025bca9736 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:57:30.929288 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-e5b10743-ca3a-419b-bcc5-0b025bca9736 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:57:30.929745 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-e5b10743-ca3a-419b-bcc5-0b025bca9736 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:57:31.083858 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-e5b10743-ca3a-419b-bcc5-0b025bca9736 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '193bf7a17f544770a27c07f6b8cc0988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243c0b9b4bd742659061745c8dc4c696', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:57:31.092182 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-e5b10743-ca3a-419b-bcc5-0b025bca9736 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] 10.222.0.36 "GET /compute/v2.1/servers/9209310f-9812-4e8e-9a64-a46690948204" status: 200 len: 1579 microversion: 2.1 time: 0.179883 Oct 15 13:57:31.092818 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 445/910] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:57:30 2022] GET /compute/v2.1/servers/9209310f-9812-4e8e-9a64-a46690948204 => generated 1579 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:57:32.118772 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-231fa680-854f-4e7c-bfbd-ca9fbac049fc tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:57:32.119487 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-231fa680-854f-4e7c-bfbd-ca9fbac049fc tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] [instance: 9209310f-9812-4e8e-9a64-a46690948204] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:57:32.130042 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-231fa680-854f-4e7c-bfbd-ca9fbac049fc tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:57:32.130878 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-231fa680-854f-4e7c-bfbd-ca9fbac049fc tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:57:32.131627 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-231fa680-854f-4e7c-bfbd-ca9fbac049fc tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:57:32.132887 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-231fa680-854f-4e7c-bfbd-ca9fbac049fc tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:57:32.133654 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-231fa680-854f-4e7c-bfbd-ca9fbac049fc tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:57:32.134401 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-231fa680-854f-4e7c-bfbd-ca9fbac049fc tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:57:32.301583 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-231fa680-854f-4e7c-bfbd-ca9fbac049fc tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '193bf7a17f544770a27c07f6b8cc0988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243c0b9b4bd742659061745c8dc4c696', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:57:32.309830 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-231fa680-854f-4e7c-bfbd-ca9fbac049fc tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] 10.222.0.36 "GET /compute/v2.1/servers/9209310f-9812-4e8e-9a64-a46690948204" status: 200 len: 1579 microversion: 2.1 time: 0.195725 Oct 15 13:57:32.310689 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 466/911] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:57:32 2022] GET /compute/v2.1/servers/9209310f-9812-4e8e-9a64-a46690948204 => generated 1579 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:57:33.336959 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-05bdec9a-852b-419b-8be5-2dab38e443c1 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:57:33.337548 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-05bdec9a-852b-419b-8be5-2dab38e443c1 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] [instance: 9209310f-9812-4e8e-9a64-a46690948204] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:57:33.344308 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-05bdec9a-852b-419b-8be5-2dab38e443c1 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:57:33.344812 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-05bdec9a-852b-419b-8be5-2dab38e443c1 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:57:33.345240 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-05bdec9a-852b-419b-8be5-2dab38e443c1 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:57:33.345938 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-05bdec9a-852b-419b-8be5-2dab38e443c1 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:57:33.346378 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-05bdec9a-852b-419b-8be5-2dab38e443c1 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:57:33.346790 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-05bdec9a-852b-419b-8be5-2dab38e443c1 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:57:33.493032 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-05bdec9a-852b-419b-8be5-2dab38e443c1 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '193bf7a17f544770a27c07f6b8cc0988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243c0b9b4bd742659061745c8dc4c696', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:57:33.510648 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-05bdec9a-852b-419b-8be5-2dab38e443c1 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] 10.222.0.36 "GET /compute/v2.1/servers/9209310f-9812-4e8e-9a64-a46690948204" status: 200 len: 1579 microversion: 2.1 time: 0.177439 Oct 15 13:57:33.511578 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 446/912] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:57:33 2022] GET /compute/v2.1/servers/9209310f-9812-4e8e-9a64-a46690948204 => generated 1579 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:57:33.819675 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [req-8623c826-edf6-46ec-94eb-e540ce14beb1 req-a61ad4c5-04a9-49a7-972c-f27e15289f74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9209310f-9812-4e8e-9a64-a46690948204", "name": "network-vif-deleted", "tag": "35cb3e4c-0e68-4b14-9bc8-fb35d5b7a493"}]} {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 13:57:33.841595 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [req-8623c826-edf6-46ec-94eb-e540ce14beb1 req-a61ad4c5-04a9-49a7-972c-f27e15289f74 service nova] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:57:33.842352 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [req-8623c826-edf6-46ec-94eb-e540ce14beb1 req-a61ad4c5-04a9-49a7-972c-f27e15289f74 service nova] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:57:33.842937 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [req-8623c826-edf6-46ec-94eb-e540ce14beb1 req-a61ad4c5-04a9-49a7-972c-f27e15289f74 service nova] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:57:33.855313 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.compute.server_external_events [req-8623c826-edf6-46ec-94eb-e540ce14beb1 req-a61ad4c5-04a9-49a7-972c-f27e15289f74 service nova] Creating event network-vif-deleted:35cb3e4c-0e68-4b14-9bc8-fb35d5b7a493 for instance 9209310f-9812-4e8e-9a64-a46690948204 on hv-cinder-86149 Oct 15 13:57:33.860844 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [req-8623c826-edf6-46ec-94eb-e540ce14beb1 req-a61ad4c5-04a9-49a7-972c-f27e15289f74 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046171 Oct 15 13:57:33.862502 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 467/913] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 15 13:57:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 13:57:34.535331 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-792e5ef0-b25d-4d7a-b0be-51df2fae2199 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:57:34.536045 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-792e5ef0-b25d-4d7a-b0be-51df2fae2199 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] [instance: 9209310f-9812-4e8e-9a64-a46690948204] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:57:34.542921 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-792e5ef0-b25d-4d7a-b0be-51df2fae2199 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:57:34.543405 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-792e5ef0-b25d-4d7a-b0be-51df2fae2199 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:57:34.543851 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-792e5ef0-b25d-4d7a-b0be-51df2fae2199 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:57:34.544613 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-792e5ef0-b25d-4d7a-b0be-51df2fae2199 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:57:34.545025 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-792e5ef0-b25d-4d7a-b0be-51df2fae2199 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:57:34.545542 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-792e5ef0-b25d-4d7a-b0be-51df2fae2199 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:57:34.583767 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-792e5ef0-b25d-4d7a-b0be-51df2fae2199 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:57:34.584309 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-792e5ef0-b25d-4d7a-b0be-51df2fae2199 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:57:34.584747 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-792e5ef0-b25d-4d7a-b0be-51df2fae2199 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:57:34.585205 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.objects.instance [None req-792e5ef0-b25d-4d7a-b0be-51df2fae2199 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lazy-loading 'fault' on Instance uuid 9209310f-9812-4e8e-9a64-a46690948204 {{(pid=125243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 15 13:57:34.636329 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-792e5ef0-b25d-4d7a-b0be-51df2fae2199 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '193bf7a17f544770a27c07f6b8cc0988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243c0b9b4bd742659061745c8dc4c696', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:57:34.645012 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-792e5ef0-b25d-4d7a-b0be-51df2fae2199 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] 10.222.0.36 "GET /compute/v2.1/servers/9209310f-9812-4e8e-9a64-a46690948204" status: 200 len: 1231 microversion: 2.1 time: 0.113445 Oct 15 13:57:34.646040 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 447/914] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:57:34 2022] GET /compute/v2.1/servers/9209310f-9812-4e8e-9a64-a46690948204 => generated 1231 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:57:35.671436 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-1006f975-0faf-4b2c-b064-704ae9e7daea tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:57:35.672179 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-1006f975-0faf-4b2c-b064-704ae9e7daea tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] [instance: 9209310f-9812-4e8e-9a64-a46690948204] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:57:35.679525 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-1006f975-0faf-4b2c-b064-704ae9e7daea tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:57:35.680041 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-1006f975-0faf-4b2c-b064-704ae9e7daea tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:57:35.680480 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-1006f975-0faf-4b2c-b064-704ae9e7daea tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:57:35.681194 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-1006f975-0faf-4b2c-b064-704ae9e7daea tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:57:35.681646 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-1006f975-0faf-4b2c-b064-704ae9e7daea tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:57:35.682222 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-1006f975-0faf-4b2c-b064-704ae9e7daea tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:57:35.697473 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.wsgi [None req-1006f975-0faf-4b2c-b064-704ae9e7daea tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] HTTP exception thrown: Instance 9209310f-9812-4e8e-9a64-a46690948204 could not be found. Oct 15 13:57:35.699209 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-1006f975-0faf-4b2c-b064-704ae9e7daea tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Request method failure captured: Oct 15 13:57:35.699209 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: request: GET /compute/v2.1/servers/9209310f-9812-4e8e-9a64-a46690948204 HTTP/1.1 Oct 15 13:57:35.699209 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Accept: application/json Oct 15 13:57:35.699209 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Accept-Encoding: identity Oct 15 13:57:35.699209 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Connection: close Oct 15 13:57:35.699209 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Content-Length: 0 Oct 15 13:57:35.699209 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Content-Type: application/json Oct 15 13:57:35.699209 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Host: 10.222.0.36 Oct 15 13:57:35.699209 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Openstack-System-Scope: None Oct 15 13:57:35.699209 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: User-Agent: python-urllib3/1.26.12 Oct 15 13:57:35.699209 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Auth-Token: gAAAAABjSrs7akZdeWnKNfbPpL5PIG5mRXFvVXqD3141HrZ4nKb24dpr3EvMeYQ5Hx1nj7byWdB9YJsOPCMXYGIoIvcxe9Ohh7gIQjWQWXZ15vyi14OO7I0M7VeBlrNwCi-ODOHjIC8dn-wksQAcF8z9gIN8hepYOUySXSMp9aSpWIlNjY6cPxk Oct 15 13:57:35.699209 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Domain-Id: None Oct 15 13:57:35.699209 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Domain-Name: None Oct 15 13:57:35.699209 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Identity-Status: Confirmed Oct 15 13:57:35.699209 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Is-Admin-Project: True Oct 15 13:57:35.699209 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Project-Domain-Id: default Oct 15 13:57:35.699209 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Project-Domain-Name: Default Oct 15 13:57:35.699209 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Project-Id: 243c0b9b4bd742659061745c8dc4c696 Oct 15 13:57:35.699209 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Project-Name: tempest-TestVolumeBootPattern-1987600970 Oct 15 13:57:35.699209 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Role: member,reader Oct 15 13:57:35.699209 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Roles: member,reader Oct 15 13:57:35.700792 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_243c0b9b4bd742659061745c8dc4c696", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/243c0b9b4bd742659061745c8dc4c696"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/243c0b9b4bd742659061745c8dc4c696"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/243c0b9b4bd742659061745c8dc4c696"}]}] Oct 15 13:57:35.700792 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Tenant: tempest-TestVolumeBootPattern-1987600970 Oct 15 13:57:35.700792 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Tenant-Id: 243c0b9b4bd742659061745c8dc4c696 Oct 15 13:57:35.700792 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Tenant-Name: tempest-TestVolumeBootPattern-1987600970 Oct 15 13:57:35.700792 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-User: tempest-TestVolumeBootPattern-1987600970-project Oct 15 13:57:35.700792 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-User-Domain-Id: default Oct 15 13:57:35.700792 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-User-Domain-Name: Default Oct 15 13:57:35.700792 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-User-Id: 193bf7a17f544770a27c07f6b8cc0988 Oct 15 13:57:35.700792 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-User-Name: tempest-TestVolumeBootPattern-1987600970-project Oct 15 13:57:35.700792 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: method: > Oct 15 13:57:35.700792 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: exception: Instance 9209310f-9812-4e8e-9a64-a46690948204 could not be found. Oct 15 13:57:35.700792 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: action_args: {'id': '9209310f-9812-4e8e-9a64-a46690948204'} Oct 15 13:57:35.701612 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 15 13:57:35.701612 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 13:57:35.701612 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 15 13:57:35.701612 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 15 13:57:35.701612 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 15 13:57:35.701612 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 15 13:57:35.701612 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 15 13:57:35.701612 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 15 13:57:35.701612 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 15 13:57:35.701612 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 15 13:57:35.701612 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9209310f-9812-4e8e-9a64-a46690948204 could not be found. Oct 15 13:57:35.701612 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Oct 15 13:57:35.701612 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 13:57:35.701612 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Oct 15 13:57:35.701612 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 13:57:35.701612 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 13:57:35.701612 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 13:57:35.701612 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 15 13:57:35.701612 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 15 13:57:35.701612 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 15 13:57:35.703142 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 15 13:57:35.703142 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 15 13:57:35.703142 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 15 13:57:35.703142 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 15 13:57:35.703142 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 15 13:57:35.703142 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 15 13:57:35.703142 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 15 13:57:35.703142 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9209310f-9812-4e8e-9a64-a46690948204 could not be found. Oct 15 13:57:35.703142 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Oct 15 13:57:35.703142 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 13:57:35.703142 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Oct 15 13:57:35.703142 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 13:57:35.703142 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 13:57:35.703142 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 13:57:35.703142 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 15 13:57:35.703142 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 15 13:57:35.703142 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9209310f-9812-4e8e-9a64-a46690948204 could not be found. Oct 15 13:57:35.703142 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Oct 15 13:57:35.704519 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-1006f975-0faf-4b2c-b064-704ae9e7daea tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Returning 404 to user: Instance 9209310f-9812-4e8e-9a64-a46690948204 could not be found. {{(pid=125242) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 15 13:57:35.704519 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-1006f975-0faf-4b2c-b064-704ae9e7daea tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] 10.222.0.36 "GET /compute/v2.1/servers/9209310f-9812-4e8e-9a64-a46690948204" status: 404 len: 111 microversion: 2.1 time: 0.035158 Oct 15 13:57:35.704519 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 468/915] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:57:35 2022] GET /compute/v2.1/servers/9209310f-9812-4e8e-9a64-a46690948204 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 15 13:57:35.834835 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-062c5215-a20b-4d89-9653-7009c09689be tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2016444069", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1731665434", "security_groups": [{"name": "tempest-secgroup-smoke-1562745215"}], "block_device_mapping_v2": [{"uuid": "1f6bfdb6-b799-4267-8305-d4ab4138bb94", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "701b540a-8a09-42dc-a3a2-18dbe248ffc3"}]}} {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 13:57:35.971973 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.network.neutron [None req-062c5215-a20b-4d89-9653-7009c09689be tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] validate_networks() for [('701b540a-8a09-42dc-a3a2-18dbe248ffc3', None, None, None, None, None)] {{(pid=125243) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 15 13:57:36.392452 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.virt.hardware [None req-062c5215-a20b-4d89-9653-7009c09689be tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Flavor limits 0:0:0 {{(pid=125243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 15 13:57:36.392846 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.virt.hardware [None req-062c5215-a20b-4d89-9653-7009c09689be tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Image limits 0:0:0 {{(pid=125243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 15 13:57:36.393441 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.virt.hardware [None req-062c5215-a20b-4d89-9653-7009c09689be tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Flavor pref 0:0:0 {{(pid=125243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 15 13:57:36.393737 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.virt.hardware [None req-062c5215-a20b-4d89-9653-7009c09689be tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Image pref 0:0:0 {{(pid=125243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 15 13:57:36.394385 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.virt.hardware [None req-062c5215-a20b-4d89-9653-7009c09689be tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 15 13:57:36.404309 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-062c5215-a20b-4d89-9653-7009c09689be tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:57:36.404792 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-062c5215-a20b-4d89-9653-7009c09689be tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:57:36.405218 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-062c5215-a20b-4d89-9653-7009c09689be tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:57:36.405962 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-062c5215-a20b-4d89-9653-7009c09689be tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:57:36.406399 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-062c5215-a20b-4d89-9653-7009c09689be tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:57:36.406816 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-062c5215-a20b-4d89-9653-7009c09689be tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:57:36.425046 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.quota [None req-062c5215-a20b-4d89-9653-7009c09689be tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Getting quotas for project 243c0b9b4bd742659061745c8dc4c696. Resources: {'cores', 'ram', 'instances'} {{(pid=125243) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 15 13:57:36.429566 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.quota [None req-062c5215-a20b-4d89-9653-7009c09689be tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Getting quotas for user 193bf7a17f544770a27c07f6b8cc0988 and project 243c0b9b4bd742659061745c8dc4c696. Resources: {'cores', 'ram', 'instances'} {{(pid=125243) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 15 13:57:36.498852 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-062c5215-a20b-4d89-9653-7009c09689be tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Going to run 1 instances... {{(pid=125243) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 15 13:57:36.502148 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-062c5215-a20b-4d89-9653-7009c09689be tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] [instance: bceb7f8c-8854-493e-b707-efe98ac7eb5b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1f6bfdb6-b799-4267-8305-d4ab4138bb94',volume_size=None,volume_type=None)] {{(pid=125243) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 15 13:57:36.646204 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-062c5215-a20b-4d89-9653-7009c09689be tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.816755 Oct 15 13:57:36.646857 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 448/916] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 15 13:57:35 2022] POST /compute/v2.1/servers => generated 406 bytes in 819 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 15 13:57:36.661368 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-988de54e-07c4-4156-940d-82bf33089328 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:57:36.663066 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-988de54e-07c4-4156-940d-82bf33089328 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] [instance: bceb7f8c-8854-493e-b707-efe98ac7eb5b] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:57:36.719208 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-988de54e-07c4-4156-940d-82bf33089328 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '193bf7a17f544770a27c07f6b8cc0988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243c0b9b4bd742659061745c8dc4c696', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:57:36.726665 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-988de54e-07c4-4156-940d-82bf33089328 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] 10.222.0.36 "GET /compute/v2.1/servers/bceb7f8c-8854-493e-b707-efe98ac7eb5b" status: 200 len: 1095 microversion: 2.1 time: 0.071277 Oct 15 13:57:36.727170 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 469/917] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:57:36 2022] GET /compute/v2.1/servers/bceb7f8c-8854-493e-b707-efe98ac7eb5b => generated 1095 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:57:37.751490 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-15824b2d-8bc9-4829-b0db-443ddac9c151 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:57:37.752481 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-15824b2d-8bc9-4829-b0db-443ddac9c151 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] [instance: bceb7f8c-8854-493e-b707-efe98ac7eb5b] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:57:37.759387 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-15824b2d-8bc9-4829-b0db-443ddac9c151 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:57:37.759889 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-15824b2d-8bc9-4829-b0db-443ddac9c151 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:57:37.760460 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-15824b2d-8bc9-4829-b0db-443ddac9c151 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:57:37.761164 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-15824b2d-8bc9-4829-b0db-443ddac9c151 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:57:37.761618 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-15824b2d-8bc9-4829-b0db-443ddac9c151 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:57:37.762041 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-15824b2d-8bc9-4829-b0db-443ddac9c151 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:57:37.837610 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-15824b2d-8bc9-4829-b0db-443ddac9c151 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '193bf7a17f544770a27c07f6b8cc0988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243c0b9b4bd742659061745c8dc4c696', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:57:37.854695 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-15824b2d-8bc9-4829-b0db-443ddac9c151 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] 10.222.0.36 "GET /compute/v2.1/servers/bceb7f8c-8854-493e-b707-efe98ac7eb5b" status: 200 len: 1193 microversion: 2.1 time: 0.107223 Oct 15 13:57:37.865838 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 449/918] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:57:37 2022] GET /compute/v2.1/servers/bceb7f8c-8854-493e-b707-efe98ac7eb5b => generated 1193 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:57:38.880401 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-1f3f286d-6970-4667-b686-8d1f13ab6901 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:57:38.881086 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-1f3f286d-6970-4667-b686-8d1f13ab6901 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] [instance: bceb7f8c-8854-493e-b707-efe98ac7eb5b] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:57:38.893781 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-1f3f286d-6970-4667-b686-8d1f13ab6901 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:57:38.894348 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-1f3f286d-6970-4667-b686-8d1f13ab6901 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:57:38.894878 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-1f3f286d-6970-4667-b686-8d1f13ab6901 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:57:38.895669 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-1f3f286d-6970-4667-b686-8d1f13ab6901 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:57:38.896230 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-1f3f286d-6970-4667-b686-8d1f13ab6901 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:57:38.896741 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-1f3f286d-6970-4667-b686-8d1f13ab6901 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:57:39.034484 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-1f3f286d-6970-4667-b686-8d1f13ab6901 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '193bf7a17f544770a27c07f6b8cc0988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243c0b9b4bd742659061745c8dc4c696', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:57:39.043472 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-1f3f286d-6970-4667-b686-8d1f13ab6901 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] 10.222.0.36 "GET /compute/v2.1/servers/bceb7f8c-8854-493e-b707-efe98ac7eb5b" status: 200 len: 1267 microversion: 2.1 time: 0.166847 Oct 15 13:57:39.044159 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 470/919] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:57:38 2022] GET /compute/v2.1/servers/bceb7f8c-8854-493e-b707-efe98ac7eb5b => generated 1267 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:57:39.347383 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [req-50297143-78c3-431d-ba00-c7250f7ed3df req-905f166f-8564-4642-bc90-551a4f4f9a2f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bceb7f8c-8854-493e-b707-efe98ac7eb5b", "tag": "a8e5516a-30ab-4376-8e26-9efdb40d9c1e"}]} {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 13:57:39.360589 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [req-50297143-78c3-431d-ba00-c7250f7ed3df req-905f166f-8564-4642-bc90-551a4f4f9a2f service nova] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:57:39.361072 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [req-50297143-78c3-431d-ba00-c7250f7ed3df req-905f166f-8564-4642-bc90-551a4f4f9a2f service nova] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:57:39.361599 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [req-50297143-78c3-431d-ba00-c7250f7ed3df req-905f166f-8564-4642-bc90-551a4f4f9a2f service nova] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:57:39.374899 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.compute.server_external_events [req-50297143-78c3-431d-ba00-c7250f7ed3df req-905f166f-8564-4642-bc90-551a4f4f9a2f service nova] Creating event network-changed:a8e5516a-30ab-4376-8e26-9efdb40d9c1e for instance bceb7f8c-8854-493e-b707-efe98ac7eb5b on hv-cinder-86149 Oct 15 13:57:39.381523 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [req-50297143-78c3-431d-ba00-c7250f7ed3df req-905f166f-8564-4642-bc90-551a4f4f9a2f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038323 Oct 15 13:57:39.382242 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 450/920] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 15 13:57:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 13:57:40.068635 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-c53dfc6b-02c5-4584-a9a0-19c8dabfbbf6 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:57:40.069256 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-c53dfc6b-02c5-4584-a9a0-19c8dabfbbf6 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] [instance: bceb7f8c-8854-493e-b707-efe98ac7eb5b] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:57:40.076554 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-c53dfc6b-02c5-4584-a9a0-19c8dabfbbf6 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:57:40.077072 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-c53dfc6b-02c5-4584-a9a0-19c8dabfbbf6 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:57:40.077537 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-c53dfc6b-02c5-4584-a9a0-19c8dabfbbf6 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:57:40.078228 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-c53dfc6b-02c5-4584-a9a0-19c8dabfbbf6 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:57:40.078683 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-c53dfc6b-02c5-4584-a9a0-19c8dabfbbf6 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:57:40.079108 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-c53dfc6b-02c5-4584-a9a0-19c8dabfbbf6 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:57:40.223662 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-c53dfc6b-02c5-4584-a9a0-19c8dabfbbf6 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '193bf7a17f544770a27c07f6b8cc0988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243c0b9b4bd742659061745c8dc4c696', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:57:40.232676 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-c53dfc6b-02c5-4584-a9a0-19c8dabfbbf6 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] 10.222.0.36 "GET /compute/v2.1/servers/bceb7f8c-8854-493e-b707-efe98ac7eb5b" status: 200 len: 1267 microversion: 2.1 time: 0.168191 Oct 15 13:57:40.233268 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 471/921] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:57:40 2022] GET /compute/v2.1/servers/bceb7f8c-8854-493e-b707-efe98ac7eb5b => generated 1267 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:57:41.257141 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-c5675641-f2f8-42c8-ab83-de021b19446e tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:57:41.257856 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-c5675641-f2f8-42c8-ab83-de021b19446e tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] [instance: bceb7f8c-8854-493e-b707-efe98ac7eb5b] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:57:41.265527 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-c5675641-f2f8-42c8-ab83-de021b19446e tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:57:41.266024 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-c5675641-f2f8-42c8-ab83-de021b19446e tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:57:41.266452 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-c5675641-f2f8-42c8-ab83-de021b19446e tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:57:41.267160 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-c5675641-f2f8-42c8-ab83-de021b19446e tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:57:41.267615 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-c5675641-f2f8-42c8-ab83-de021b19446e tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:57:41.268086 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-c5675641-f2f8-42c8-ab83-de021b19446e tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:57:41.425780 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-c5675641-f2f8-42c8-ab83-de021b19446e tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '193bf7a17f544770a27c07f6b8cc0988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243c0b9b4bd742659061745c8dc4c696', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:57:41.433888 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-c5675641-f2f8-42c8-ab83-de021b19446e tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] 10.222.0.36 "GET /compute/v2.1/servers/bceb7f8c-8854-493e-b707-efe98ac7eb5b" status: 200 len: 1267 microversion: 2.1 time: 0.181082 Oct 15 13:57:41.434504 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 451/922] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:57:41 2022] GET /compute/v2.1/servers/bceb7f8c-8854-493e-b707-efe98ac7eb5b => generated 1267 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:57:42.460878 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-8edc298c-d9b1-4a30-b21b-d9e4e269c446 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:57:42.461497 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-8edc298c-d9b1-4a30-b21b-d9e4e269c446 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] [instance: bceb7f8c-8854-493e-b707-efe98ac7eb5b] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:57:42.468335 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-8edc298c-d9b1-4a30-b21b-d9e4e269c446 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:57:42.468823 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-8edc298c-d9b1-4a30-b21b-d9e4e269c446 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:57:42.469258 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-8edc298c-d9b1-4a30-b21b-d9e4e269c446 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:57:42.469959 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-8edc298c-d9b1-4a30-b21b-d9e4e269c446 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:57:42.470419 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-8edc298c-d9b1-4a30-b21b-d9e4e269c446 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:57:42.470837 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-8edc298c-d9b1-4a30-b21b-d9e4e269c446 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:57:42.618644 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-8edc298c-d9b1-4a30-b21b-d9e4e269c446 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '193bf7a17f544770a27c07f6b8cc0988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243c0b9b4bd742659061745c8dc4c696', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:57:42.631028 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-8edc298c-d9b1-4a30-b21b-d9e4e269c446 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] 10.222.0.36 "GET /compute/v2.1/servers/bceb7f8c-8854-493e-b707-efe98ac7eb5b" status: 200 len: 1267 microversion: 2.1 time: 0.176069 Oct 15 13:57:42.631833 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 472/923] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:57:42 2022] GET /compute/v2.1/servers/bceb7f8c-8854-493e-b707-efe98ac7eb5b => generated 1267 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:57:43.258948 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-13e046c2-2365-4a6d-bfde-51892b940070 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:57:43.259605 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-13e046c2-2365-4a6d-bfde-51892b940070 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 161ef6e2-46fb-4c64-bbf0-c178886e0965] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:57:43.267741 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-13e046c2-2365-4a6d-bfde-51892b940070 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:57:43.268267 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-13e046c2-2365-4a6d-bfde-51892b940070 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:57:43.268705 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-13e046c2-2365-4a6d-bfde-51892b940070 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:57:43.269518 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-13e046c2-2365-4a6d-bfde-51892b940070 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:57:43.270206 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-13e046c2-2365-4a6d-bfde-51892b940070 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:57:43.270897 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-13e046c2-2365-4a6d-bfde-51892b940070 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:57:43.299086 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-13e046c2-2365-4a6d-bfde-51892b940070 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/161ef6e2-46fb-4c64-bbf0-c178886e0965/ips" status: 200 len: 153 microversion: 2.20 time: 0.046671 Oct 15 13:57:43.299657 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 452/924] 10.222.0.36 () {60 vars in 1289 bytes} [Sat Oct 15 13:57:43 2022] GET /compute/v2.1/servers/161ef6e2-46fb-4c64-bbf0-c178886e0965/ips => generated 153 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 13:57:43.656290 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-9ff8c0a3-65f1-457e-85a7-a17709111665 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:57:43.656888 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-9ff8c0a3-65f1-457e-85a7-a17709111665 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] [instance: bceb7f8c-8854-493e-b707-efe98ac7eb5b] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:57:43.664049 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-9ff8c0a3-65f1-457e-85a7-a17709111665 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:57:43.664528 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-9ff8c0a3-65f1-457e-85a7-a17709111665 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:57:43.664967 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-9ff8c0a3-65f1-457e-85a7-a17709111665 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:57:43.665663 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-9ff8c0a3-65f1-457e-85a7-a17709111665 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:57:43.666113 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-9ff8c0a3-65f1-457e-85a7-a17709111665 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:57:43.666537 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-9ff8c0a3-65f1-457e-85a7-a17709111665 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:57:43.822546 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-9ff8c0a3-65f1-457e-85a7-a17709111665 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '193bf7a17f544770a27c07f6b8cc0988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243c0b9b4bd742659061745c8dc4c696', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:57:43.830745 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-9ff8c0a3-65f1-457e-85a7-a17709111665 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] 10.222.0.36 "GET /compute/v2.1/servers/bceb7f8c-8854-493e-b707-efe98ac7eb5b" status: 200 len: 1267 microversion: 2.1 time: 0.178471 Oct 15 13:57:43.831336 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 473/925] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:57:43 2022] GET /compute/v2.1/servers/bceb7f8c-8854-493e-b707-efe98ac7eb5b => generated 1267 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:57:44.855071 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-cc06fb8e-434b-4631-a0c6-ce72ccaab15f tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:57:44.855704 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-cc06fb8e-434b-4631-a0c6-ce72ccaab15f tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] [instance: bceb7f8c-8854-493e-b707-efe98ac7eb5b] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:57:44.863224 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-cc06fb8e-434b-4631-a0c6-ce72ccaab15f tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:57:44.863703 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-cc06fb8e-434b-4631-a0c6-ce72ccaab15f tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:57:44.864167 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-cc06fb8e-434b-4631-a0c6-ce72ccaab15f tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:57:44.864854 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-cc06fb8e-434b-4631-a0c6-ce72ccaab15f tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:57:44.865289 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-cc06fb8e-434b-4631-a0c6-ce72ccaab15f tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:57:44.865710 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-cc06fb8e-434b-4631-a0c6-ce72ccaab15f tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:57:45.110736 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-e98aebb8-8069-406d-b920-8d272bb009c1 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 13:57:45.111302 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-e98aebb8-8069-406d-b920-8d272bb009c1 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 161ef6e2-46fb-4c64-bbf0-c178886e0965] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:57:45.120372 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-e98aebb8-8069-406d-b920-8d272bb009c1 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:57:45.120871 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-e98aebb8-8069-406d-b920-8d272bb009c1 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:57:45.121325 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-e98aebb8-8069-406d-b920-8d272bb009c1 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:57:45.122051 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-e98aebb8-8069-406d-b920-8d272bb009c1 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:57:45.122507 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-e98aebb8-8069-406d-b920-8d272bb009c1 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:57:45.123080 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-e98aebb8-8069-406d-b920-8d272bb009c1 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:57:45.150187 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.objects.instance [None req-e98aebb8-8069-406d-b920-8d272bb009c1 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lazy-loading 'flavor' on Instance uuid 161ef6e2-46fb-4c64-bbf0-c178886e0965 {{(pid=125242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 15 13:57:45.168115 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-cc06fb8e-434b-4631-a0c6-ce72ccaab15f tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '193bf7a17f544770a27c07f6b8cc0988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243c0b9b4bd742659061745c8dc4c696', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:57:45.176742 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-cc06fb8e-434b-4631-a0c6-ce72ccaab15f tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] 10.222.0.36 "GET /compute/v2.1/servers/bceb7f8c-8854-493e-b707-efe98ac7eb5b" status: 200 len: 1267 microversion: 2.1 time: 0.325702 Oct 15 13:57:45.177330 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 453/926] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:57:44 2022] GET /compute/v2.1/servers/bceb7f8c-8854-493e-b707-efe98ac7eb5b => generated 1267 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:57:45.353824 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-e98aebb8-8069-406d-b920-8d272bb009c1 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "POST /compute/v2.1/servers/161ef6e2-46fb-4c64-bbf0-c178886e0965/action" status: 202 len: 0 microversion: 2.20 time: 0.247861 Oct 15 13:57:45.354505 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 474/927] 10.222.0.36 () {62 vars in 1319 bytes} [Sat Oct 15 13:57:45 2022] POST /compute/v2.1/servers/161ef6e2-46fb-4c64-bbf0-c178886e0965/action => generated 0 bytes in 250 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 15 13:57:45.364280 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-50d64cb2-9d5b-4ff6-b9d0-a040ecf09374 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:57:45.364895 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-50d64cb2-9d5b-4ff6-b9d0-a040ecf09374 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 161ef6e2-46fb-4c64-bbf0-c178886e0965] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:57:45.371206 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-50d64cb2-9d5b-4ff6-b9d0-a040ecf09374 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:57:45.371697 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-50d64cb2-9d5b-4ff6-b9d0-a040ecf09374 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:57:45.372225 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-50d64cb2-9d5b-4ff6-b9d0-a040ecf09374 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:57:45.372923 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-50d64cb2-9d5b-4ff6-b9d0-a040ecf09374 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:57:45.373393 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-50d64cb2-9d5b-4ff6-b9d0-a040ecf09374 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:57:45.373827 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-50d64cb2-9d5b-4ff6-b9d0-a040ecf09374 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:57:45.525037 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-50d64cb2-9d5b-4ff6-b9d0-a040ecf09374 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:57:45.533542 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-50d64cb2-9d5b-4ff6-b9d0-a040ecf09374 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:57:45.535200 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-50d64cb2-9d5b-4ff6-b9d0-a040ecf09374 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:57:45.536498 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-50d64cb2-9d5b-4ff6-b9d0-a040ecf09374 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/161ef6e2-46fb-4c64-bbf0-c178886e0965" status: 200 len: 1726 microversion: 2.20 time: 0.176339 Oct 15 13:57:45.537272 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 454/928] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:57:45 2022] GET /compute/v2.1/servers/161ef6e2-46fb-4c64-bbf0-c178886e0965 => generated 1726 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 13:57:46.202458 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-6f875605-cb2b-41fd-932b-ad96875561a4 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:57:46.203202 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-6f875605-cb2b-41fd-932b-ad96875561a4 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] [instance: bceb7f8c-8854-493e-b707-efe98ac7eb5b] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:57:46.210387 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-6f875605-cb2b-41fd-932b-ad96875561a4 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:57:46.210966 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-6f875605-cb2b-41fd-932b-ad96875561a4 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:57:46.211531 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-6f875605-cb2b-41fd-932b-ad96875561a4 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:57:46.212322 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-6f875605-cb2b-41fd-932b-ad96875561a4 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:57:46.212784 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-6f875605-cb2b-41fd-932b-ad96875561a4 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:57:46.213220 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-6f875605-cb2b-41fd-932b-ad96875561a4 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:57:46.365630 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-6f875605-cb2b-41fd-932b-ad96875561a4 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '193bf7a17f544770a27c07f6b8cc0988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243c0b9b4bd742659061745c8dc4c696', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:57:46.374427 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-6f875605-cb2b-41fd-932b-ad96875561a4 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] 10.222.0.36 "GET /compute/v2.1/servers/bceb7f8c-8854-493e-b707-efe98ac7eb5b" status: 200 len: 1267 microversion: 2.1 time: 0.176968 Oct 15 13:57:46.375030 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 475/929] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:57:46 2022] GET /compute/v2.1/servers/bceb7f8c-8854-493e-b707-efe98ac7eb5b => generated 1267 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:57:46.565063 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-fe8e5326-7d71-4c43-9999-e5ac2e25cf4d tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:57:46.565728 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-fe8e5326-7d71-4c43-9999-e5ac2e25cf4d tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 161ef6e2-46fb-4c64-bbf0-c178886e0965] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:57:46.568032 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG dbcounter [-] [125243] Writing DB stats nova_cell0:SELECT=2 {{(pid=125243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:57:46.568730 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG dbcounter [-] [125243] Writing DB stats nova_cell0:SELECT=6 {{(pid=125243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:57:46.575415 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-fe8e5326-7d71-4c43-9999-e5ac2e25cf4d tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:57:46.575903 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-fe8e5326-7d71-4c43-9999-e5ac2e25cf4d tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:57:46.576370 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-fe8e5326-7d71-4c43-9999-e5ac2e25cf4d tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:57:46.577066 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-fe8e5326-7d71-4c43-9999-e5ac2e25cf4d tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:57:46.577516 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-fe8e5326-7d71-4c43-9999-e5ac2e25cf4d tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:57:46.577941 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-fe8e5326-7d71-4c43-9999-e5ac2e25cf4d tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:57:46.714487 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-fe8e5326-7d71-4c43-9999-e5ac2e25cf4d tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:57:46.723117 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-fe8e5326-7d71-4c43-9999-e5ac2e25cf4d tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:57:46.724800 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-fe8e5326-7d71-4c43-9999-e5ac2e25cf4d tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:57:46.726050 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-fe8e5326-7d71-4c43-9999-e5ac2e25cf4d tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/161ef6e2-46fb-4c64-bbf0-c178886e0965" status: 200 len: 1726 microversion: 2.20 time: 0.165140 Oct 15 13:57:46.726739 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 455/930] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:57:46 2022] GET /compute/v2.1/servers/161ef6e2-46fb-4c64-bbf0-c178886e0965 => generated 1726 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 13:57:47.402560 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-8785f530-0581-4374-a63d-ea0e2e454c36 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:57:47.403277 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-8785f530-0581-4374-a63d-ea0e2e454c36 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] [instance: bceb7f8c-8854-493e-b707-efe98ac7eb5b] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:57:47.405461 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG dbcounter [-] [125242] Writing DB stats nova_cell0:SELECT=2 {{(pid=125242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:57:47.411758 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-8785f530-0581-4374-a63d-ea0e2e454c36 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:57:47.412275 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-8785f530-0581-4374-a63d-ea0e2e454c36 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:57:47.412717 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-8785f530-0581-4374-a63d-ea0e2e454c36 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:57:47.413452 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-8785f530-0581-4374-a63d-ea0e2e454c36 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:57:47.413940 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-8785f530-0581-4374-a63d-ea0e2e454c36 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:57:47.414426 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-8785f530-0581-4374-a63d-ea0e2e454c36 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:57:47.560383 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-8785f530-0581-4374-a63d-ea0e2e454c36 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '193bf7a17f544770a27c07f6b8cc0988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243c0b9b4bd742659061745c8dc4c696', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:57:47.568712 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-8785f530-0581-4374-a63d-ea0e2e454c36 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] 10.222.0.36 "GET /compute/v2.1/servers/bceb7f8c-8854-493e-b707-efe98ac7eb5b" status: 200 len: 1267 microversion: 2.1 time: 0.173362 Oct 15 13:57:47.569296 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 476/931] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:57:47 2022] GET /compute/v2.1/servers/bceb7f8c-8854-493e-b707-efe98ac7eb5b => generated 1267 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:57:47.752634 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-ee8575cf-fa7a-4fa5-8ae1-0f65bc298141 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:57:47.753507 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-ee8575cf-fa7a-4fa5-8ae1-0f65bc298141 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 161ef6e2-46fb-4c64-bbf0-c178886e0965] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:57:47.763167 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-ee8575cf-fa7a-4fa5-8ae1-0f65bc298141 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:57:47.763718 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-ee8575cf-fa7a-4fa5-8ae1-0f65bc298141 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:57:47.764321 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-ee8575cf-fa7a-4fa5-8ae1-0f65bc298141 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:57:47.765267 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-ee8575cf-fa7a-4fa5-8ae1-0f65bc298141 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:57:47.765918 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-ee8575cf-fa7a-4fa5-8ae1-0f65bc298141 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:57:47.766551 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-ee8575cf-fa7a-4fa5-8ae1-0f65bc298141 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:57:47.921396 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-ee8575cf-fa7a-4fa5-8ae1-0f65bc298141 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:57:47.932195 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-ee8575cf-fa7a-4fa5-8ae1-0f65bc298141 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:57:47.933651 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-ee8575cf-fa7a-4fa5-8ae1-0f65bc298141 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:57:47.934823 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-ee8575cf-fa7a-4fa5-8ae1-0f65bc298141 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/161ef6e2-46fb-4c64-bbf0-c178886e0965" status: 200 len: 1726 microversion: 2.20 time: 0.186468 Oct 15 13:57:47.935382 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 456/932] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:57:47 2022] GET /compute/v2.1/servers/161ef6e2-46fb-4c64-bbf0-c178886e0965 => generated 1726 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 13:57:48.595759 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-bbe41857-65fb-45af-9a89-d6e5d0d1684b tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:57:48.596665 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-bbe41857-65fb-45af-9a89-d6e5d0d1684b tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] [instance: bceb7f8c-8854-493e-b707-efe98ac7eb5b] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:57:48.605764 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-bbe41857-65fb-45af-9a89-d6e5d0d1684b tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:57:48.606666 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-bbe41857-65fb-45af-9a89-d6e5d0d1684b tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:57:48.607226 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-bbe41857-65fb-45af-9a89-d6e5d0d1684b tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:57:48.608284 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-bbe41857-65fb-45af-9a89-d6e5d0d1684b tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:57:48.608992 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-bbe41857-65fb-45af-9a89-d6e5d0d1684b tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:57:48.609561 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-bbe41857-65fb-45af-9a89-d6e5d0d1684b tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:57:48.756052 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-bbe41857-65fb-45af-9a89-d6e5d0d1684b tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '193bf7a17f544770a27c07f6b8cc0988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243c0b9b4bd742659061745c8dc4c696', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:57:48.767494 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-bbe41857-65fb-45af-9a89-d6e5d0d1684b tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] 10.222.0.36 "GET /compute/v2.1/servers/bceb7f8c-8854-493e-b707-efe98ac7eb5b" status: 200 len: 1267 microversion: 2.1 time: 0.177115 Oct 15 13:57:48.768534 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 477/933] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:57:48 2022] GET /compute/v2.1/servers/bceb7f8c-8854-493e-b707-efe98ac7eb5b => generated 1267 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:57:48.966972 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-8cf55d4f-3e17-468c-8fe8-1b354cb2e196 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:57:48.967539 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-8cf55d4f-3e17-468c-8fe8-1b354cb2e196 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 161ef6e2-46fb-4c64-bbf0-c178886e0965] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:57:48.974753 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-8cf55d4f-3e17-468c-8fe8-1b354cb2e196 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:57:48.975245 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-8cf55d4f-3e17-468c-8fe8-1b354cb2e196 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:57:48.975673 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-8cf55d4f-3e17-468c-8fe8-1b354cb2e196 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:57:48.976418 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-8cf55d4f-3e17-468c-8fe8-1b354cb2e196 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:57:48.977157 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-8cf55d4f-3e17-468c-8fe8-1b354cb2e196 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:57:48.977562 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-8cf55d4f-3e17-468c-8fe8-1b354cb2e196 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:57:49.119750 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-8cf55d4f-3e17-468c-8fe8-1b354cb2e196 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:57:49.127897 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-8cf55d4f-3e17-468c-8fe8-1b354cb2e196 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:57:49.129338 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-8cf55d4f-3e17-468c-8fe8-1b354cb2e196 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:57:49.130503 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-8cf55d4f-3e17-468c-8fe8-1b354cb2e196 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/161ef6e2-46fb-4c64-bbf0-c178886e0965" status: 200 len: 1726 microversion: 2.20 time: 0.167614 Oct 15 13:57:49.131066 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 457/934] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:57:48 2022] GET /compute/v2.1/servers/161ef6e2-46fb-4c64-bbf0-c178886e0965 => generated 1726 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 13:57:49.794787 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-2a2d60c0-682c-4467-bfc2-3a611b995a5f tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:57:49.795580 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-2a2d60c0-682c-4467-bfc2-3a611b995a5f tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] [instance: bceb7f8c-8854-493e-b707-efe98ac7eb5b] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:57:49.802608 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-2a2d60c0-682c-4467-bfc2-3a611b995a5f tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:57:49.803106 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-2a2d60c0-682c-4467-bfc2-3a611b995a5f tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:57:49.803545 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-2a2d60c0-682c-4467-bfc2-3a611b995a5f tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:57:49.804308 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-2a2d60c0-682c-4467-bfc2-3a611b995a5f tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:57:49.804765 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-2a2d60c0-682c-4467-bfc2-3a611b995a5f tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:57:49.805187 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-2a2d60c0-682c-4467-bfc2-3a611b995a5f tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:57:49.960520 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-2a2d60c0-682c-4467-bfc2-3a611b995a5f tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '193bf7a17f544770a27c07f6b8cc0988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243c0b9b4bd742659061745c8dc4c696', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:57:49.969928 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-2a2d60c0-682c-4467-bfc2-3a611b995a5f tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] 10.222.0.36 "GET /compute/v2.1/servers/bceb7f8c-8854-493e-b707-efe98ac7eb5b" status: 200 len: 1267 microversion: 2.1 time: 0.179205 Oct 15 13:57:49.970662 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 478/935] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:57:49 2022] GET /compute/v2.1/servers/bceb7f8c-8854-493e-b707-efe98ac7eb5b => generated 1267 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:57:50.155712 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-b2f1deea-19ad-4ffd-bd03-ca09880e45b6 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:57:50.156386 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-b2f1deea-19ad-4ffd-bd03-ca09880e45b6 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 161ef6e2-46fb-4c64-bbf0-c178886e0965] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:57:50.163499 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-b2f1deea-19ad-4ffd-bd03-ca09880e45b6 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:57:50.164176 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-b2f1deea-19ad-4ffd-bd03-ca09880e45b6 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:57:50.164625 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-b2f1deea-19ad-4ffd-bd03-ca09880e45b6 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:57:50.165336 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-b2f1deea-19ad-4ffd-bd03-ca09880e45b6 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:57:50.165787 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-b2f1deea-19ad-4ffd-bd03-ca09880e45b6 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:57:50.166230 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-b2f1deea-19ad-4ffd-bd03-ca09880e45b6 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:57:50.325079 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-b2f1deea-19ad-4ffd-bd03-ca09880e45b6 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:57:50.339791 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-b2f1deea-19ad-4ffd-bd03-ca09880e45b6 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:57:50.342611 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-b2f1deea-19ad-4ffd-bd03-ca09880e45b6 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:57:50.344716 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-b2f1deea-19ad-4ffd-bd03-ca09880e45b6 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/161ef6e2-46fb-4c64-bbf0-c178886e0965" status: 200 len: 1726 microversion: 2.20 time: 0.192883 Oct 15 13:57:50.345677 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 458/936] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:57:50 2022] GET /compute/v2.1/servers/161ef6e2-46fb-4c64-bbf0-c178886e0965 => generated 1726 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 13:57:50.995322 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-0e82dc06-f37a-4eb2-994e-657c3444bd55 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:57:50.996013 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-0e82dc06-f37a-4eb2-994e-657c3444bd55 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] [instance: bceb7f8c-8854-493e-b707-efe98ac7eb5b] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:57:51.003168 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-0e82dc06-f37a-4eb2-994e-657c3444bd55 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:57:51.003745 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-0e82dc06-f37a-4eb2-994e-657c3444bd55 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:57:51.004228 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-0e82dc06-f37a-4eb2-994e-657c3444bd55 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:57:51.004945 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-0e82dc06-f37a-4eb2-994e-657c3444bd55 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:57:51.005374 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-0e82dc06-f37a-4eb2-994e-657c3444bd55 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:57:51.005837 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-0e82dc06-f37a-4eb2-994e-657c3444bd55 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:57:51.148636 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-0e82dc06-f37a-4eb2-994e-657c3444bd55 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '193bf7a17f544770a27c07f6b8cc0988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243c0b9b4bd742659061745c8dc4c696', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:57:51.157546 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-0e82dc06-f37a-4eb2-994e-657c3444bd55 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] 10.222.0.36 "GET /compute/v2.1/servers/bceb7f8c-8854-493e-b707-efe98ac7eb5b" status: 200 len: 1267 microversion: 2.1 time: 0.166788 Oct 15 13:57:51.158350 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 479/937] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:57:50 2022] GET /compute/v2.1/servers/bceb7f8c-8854-493e-b707-efe98ac7eb5b => generated 1267 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:57:51.383776 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-b9c38374-8886-4f73-b0ba-511bd05b17df tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:57:51.384416 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-b9c38374-8886-4f73-b0ba-511bd05b17df tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 161ef6e2-46fb-4c64-bbf0-c178886e0965] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:57:51.391289 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-b9c38374-8886-4f73-b0ba-511bd05b17df tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:57:51.391765 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-b9c38374-8886-4f73-b0ba-511bd05b17df tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:57:51.392272 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-b9c38374-8886-4f73-b0ba-511bd05b17df tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:57:51.393028 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-b9c38374-8886-4f73-b0ba-511bd05b17df tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:57:51.393485 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-b9c38374-8886-4f73-b0ba-511bd05b17df tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:57:51.393992 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-b9c38374-8886-4f73-b0ba-511bd05b17df tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:57:51.544544 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-b9c38374-8886-4f73-b0ba-511bd05b17df tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:57:51.553301 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-b9c38374-8886-4f73-b0ba-511bd05b17df tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:57:51.554882 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-b9c38374-8886-4f73-b0ba-511bd05b17df tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:57:51.556158 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-b9c38374-8886-4f73-b0ba-511bd05b17df tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/161ef6e2-46fb-4c64-bbf0-c178886e0965" status: 200 len: 1726 microversion: 2.20 time: 0.176426 Oct 15 13:57:51.556724 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 459/938] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:57:51 2022] GET /compute/v2.1/servers/161ef6e2-46fb-4c64-bbf0-c178886e0965 => generated 1726 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 13:57:51.880847 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [req-2f44566e-753b-4905-a770-a20fea1f7183 req-82a28324-18e6-4238-a8e5-b42dfa5f0db9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bceb7f8c-8854-493e-b707-efe98ac7eb5b", "name": "network-vif-plugged", "status": "completed", "tag": "a8e5516a-30ab-4376-8e26-9efdb40d9c1e"}]} {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 13:57:51.891318 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [req-2f44566e-753b-4905-a770-a20fea1f7183 req-82a28324-18e6-4238-a8e5-b42dfa5f0db9 service nova] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:57:51.892066 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [req-2f44566e-753b-4905-a770-a20fea1f7183 req-82a28324-18e6-4238-a8e5-b42dfa5f0db9 service nova] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:57:51.892528 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [req-2f44566e-753b-4905-a770-a20fea1f7183 req-82a28324-18e6-4238-a8e5-b42dfa5f0db9 service nova] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:57:51.897072 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG dbcounter [-] [125242] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=125242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:57:51.909583 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.compute.server_external_events [req-2f44566e-753b-4905-a770-a20fea1f7183 req-82a28324-18e6-4238-a8e5-b42dfa5f0db9 service nova] Creating event network-vif-plugged:a8e5516a-30ab-4376-8e26-9efdb40d9c1e for instance bceb7f8c-8854-493e-b707-efe98ac7eb5b on hv-cinder-86149 Oct 15 13:57:51.915619 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [req-2f44566e-753b-4905-a770-a20fea1f7183 req-82a28324-18e6-4238-a8e5-b42dfa5f0db9 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038627 Oct 15 13:57:51.916293 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 480/939] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 15 13:57:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 13:57:52.182663 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-6a298421-4798-48e5-96c5-df57926127dc tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:57:52.183288 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-6a298421-4798-48e5-96c5-df57926127dc tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] [instance: bceb7f8c-8854-493e-b707-efe98ac7eb5b] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:57:52.189761 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-6a298421-4798-48e5-96c5-df57926127dc tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:57:52.190274 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-6a298421-4798-48e5-96c5-df57926127dc tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:57:52.190790 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-6a298421-4798-48e5-96c5-df57926127dc tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:57:52.191501 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-6a298421-4798-48e5-96c5-df57926127dc tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:57:52.191998 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-6a298421-4798-48e5-96c5-df57926127dc tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:57:52.192546 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-6a298421-4798-48e5-96c5-df57926127dc tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:57:52.347630 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-6a298421-4798-48e5-96c5-df57926127dc tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '193bf7a17f544770a27c07f6b8cc0988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243c0b9b4bd742659061745c8dc4c696', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:57:52.356720 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-6a298421-4798-48e5-96c5-df57926127dc tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] 10.222.0.36 "GET /compute/v2.1/servers/bceb7f8c-8854-493e-b707-efe98ac7eb5b" status: 200 len: 1267 microversion: 2.1 time: 0.177740 Oct 15 13:57:52.357315 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 460/940] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:57:52 2022] GET /compute/v2.1/servers/bceb7f8c-8854-493e-b707-efe98ac7eb5b => generated 1267 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:57:52.585401 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-35d5a432-a228-44c5-8056-d834595c6ce8 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:57:52.586117 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-35d5a432-a228-44c5-8056-d834595c6ce8 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 161ef6e2-46fb-4c64-bbf0-c178886e0965] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:57:52.594074 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-35d5a432-a228-44c5-8056-d834595c6ce8 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:57:52.594571 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-35d5a432-a228-44c5-8056-d834595c6ce8 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:57:52.595043 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-35d5a432-a228-44c5-8056-d834595c6ce8 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:57:52.595844 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-35d5a432-a228-44c5-8056-d834595c6ce8 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:57:52.596330 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-35d5a432-a228-44c5-8056-d834595c6ce8 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:57:52.596756 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-35d5a432-a228-44c5-8056-d834595c6ce8 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:57:52.747653 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-35d5a432-a228-44c5-8056-d834595c6ce8 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:57:52.756290 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-35d5a432-a228-44c5-8056-d834595c6ce8 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:57:52.757757 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-35d5a432-a228-44c5-8056-d834595c6ce8 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:57:52.759009 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-35d5a432-a228-44c5-8056-d834595c6ce8 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/161ef6e2-46fb-4c64-bbf0-c178886e0965" status: 200 len: 1726 microversion: 2.20 time: 0.180857 Oct 15 13:57:52.759570 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 481/941] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:57:52 2022] GET /compute/v2.1/servers/161ef6e2-46fb-4c64-bbf0-c178886e0965 => generated 1726 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 13:57:53.382288 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-4ffec32b-be87-4cb6-886b-6f31374d1660 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:57:53.382934 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-4ffec32b-be87-4cb6-886b-6f31374d1660 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] [instance: bceb7f8c-8854-493e-b707-efe98ac7eb5b] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:57:53.389962 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-4ffec32b-be87-4cb6-886b-6f31374d1660 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:57:53.390464 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-4ffec32b-be87-4cb6-886b-6f31374d1660 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:57:53.390898 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-4ffec32b-be87-4cb6-886b-6f31374d1660 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:57:53.391616 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-4ffec32b-be87-4cb6-886b-6f31374d1660 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:57:53.392112 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-4ffec32b-be87-4cb6-886b-6f31374d1660 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:57:53.392616 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-4ffec32b-be87-4cb6-886b-6f31374d1660 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:57:53.546633 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-4ffec32b-be87-4cb6-886b-6f31374d1660 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '193bf7a17f544770a27c07f6b8cc0988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243c0b9b4bd742659061745c8dc4c696', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:57:53.554739 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-4ffec32b-be87-4cb6-886b-6f31374d1660 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] 10.222.0.36 "GET /compute/v2.1/servers/bceb7f8c-8854-493e-b707-efe98ac7eb5b" status: 200 len: 1267 microversion: 2.1 time: 0.176448 Oct 15 13:57:53.555346 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 461/942] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:57:53 2022] GET /compute/v2.1/servers/bceb7f8c-8854-493e-b707-efe98ac7eb5b => generated 1267 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:57:53.787190 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-101a0ceb-55a6-4891-8cfa-c53195793ce8 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:57:53.788025 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-101a0ceb-55a6-4891-8cfa-c53195793ce8 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 161ef6e2-46fb-4c64-bbf0-c178886e0965] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:57:53.795896 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-101a0ceb-55a6-4891-8cfa-c53195793ce8 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:57:53.796414 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-101a0ceb-55a6-4891-8cfa-c53195793ce8 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:57:53.796845 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-101a0ceb-55a6-4891-8cfa-c53195793ce8 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:57:53.797560 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-101a0ceb-55a6-4891-8cfa-c53195793ce8 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:57:53.798015 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-101a0ceb-55a6-4891-8cfa-c53195793ce8 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:57:53.798446 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-101a0ceb-55a6-4891-8cfa-c53195793ce8 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:57:53.942358 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-101a0ceb-55a6-4891-8cfa-c53195793ce8 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:57:53.951599 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-101a0ceb-55a6-4891-8cfa-c53195793ce8 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:57:53.953117 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-101a0ceb-55a6-4891-8cfa-c53195793ce8 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:57:53.954309 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-101a0ceb-55a6-4891-8cfa-c53195793ce8 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/161ef6e2-46fb-4c64-bbf0-c178886e0965" status: 200 len: 1726 microversion: 2.20 time: 0.171529 Oct 15 13:57:53.954885 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 482/943] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:57:53 2022] GET /compute/v2.1/servers/161ef6e2-46fb-4c64-bbf0-c178886e0965 => generated 1726 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 13:57:54.579422 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-c9ac7b6a-8bc8-43ad-9440-20f2ecb21c34 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:57:54.580881 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-c9ac7b6a-8bc8-43ad-9440-20f2ecb21c34 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] [instance: bceb7f8c-8854-493e-b707-efe98ac7eb5b] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:57:54.590752 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-c9ac7b6a-8bc8-43ad-9440-20f2ecb21c34 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:57:54.591475 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-c9ac7b6a-8bc8-43ad-9440-20f2ecb21c34 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:57:54.592091 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-c9ac7b6a-8bc8-43ad-9440-20f2ecb21c34 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:57:54.592947 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-c9ac7b6a-8bc8-43ad-9440-20f2ecb21c34 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:57:54.593521 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-c9ac7b6a-8bc8-43ad-9440-20f2ecb21c34 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:57:54.594078 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-c9ac7b6a-8bc8-43ad-9440-20f2ecb21c34 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:57:54.739084 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-c9ac7b6a-8bc8-43ad-9440-20f2ecb21c34 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '193bf7a17f544770a27c07f6b8cc0988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243c0b9b4bd742659061745c8dc4c696', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:57:54.745520 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG dbcounter [-] [125243] Writing DB stats nova_cell1:SELECT=100 {{(pid=125243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:57:54.755546 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-c9ac7b6a-8bc8-43ad-9440-20f2ecb21c34 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] 10.222.0.36 "GET /compute/v2.1/servers/bceb7f8c-8854-493e-b707-efe98ac7eb5b" status: 200 len: 1454 microversion: 2.1 time: 0.179922 Oct 15 13:57:54.756672 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 462/944] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:57:54 2022] GET /compute/v2.1/servers/bceb7f8c-8854-493e-b707-efe98ac7eb5b => generated 1454 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:57:54.791224 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-b378f099-fecc-4a4d-bf27-4656e4cf567a tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:57:54.791854 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-b378f099-fecc-4a4d-bf27-4656e4cf567a tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] [instance: bceb7f8c-8854-493e-b707-efe98ac7eb5b] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:57:54.799333 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-b378f099-fecc-4a4d-bf27-4656e4cf567a tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:57:54.799821 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-b378f099-fecc-4a4d-bf27-4656e4cf567a tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:57:54.800287 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-b378f099-fecc-4a4d-bf27-4656e4cf567a tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:57:54.801016 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-b378f099-fecc-4a4d-bf27-4656e4cf567a tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:57:54.801448 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-b378f099-fecc-4a4d-bf27-4656e4cf567a tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:57:54.801870 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-b378f099-fecc-4a4d-bf27-4656e4cf567a tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:57:54.950524 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-b378f099-fecc-4a4d-bf27-4656e4cf567a tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '193bf7a17f544770a27c07f6b8cc0988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243c0b9b4bd742659061745c8dc4c696', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:57:54.958840 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-b378f099-fecc-4a4d-bf27-4656e4cf567a tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] 10.222.0.36 "GET /compute/v2.1/servers/bceb7f8c-8854-493e-b707-efe98ac7eb5b" status: 200 len: 1454 microversion: 2.1 time: 0.171812 Oct 15 13:57:54.959455 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 483/945] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:57:54 2022] GET /compute/v2.1/servers/bceb7f8c-8854-493e-b707-efe98ac7eb5b => generated 1454 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:57:54.981274 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-0656a62b-186b-48eb-9a3b-4eb7dc4a47ae tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:57:54.982407 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-0656a62b-186b-48eb-9a3b-4eb7dc4a47ae tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 161ef6e2-46fb-4c64-bbf0-c178886e0965] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:57:54.988782 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-0656a62b-186b-48eb-9a3b-4eb7dc4a47ae tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:57:54.989275 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-0656a62b-186b-48eb-9a3b-4eb7dc4a47ae tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:57:54.989736 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-0656a62b-186b-48eb-9a3b-4eb7dc4a47ae tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:57:54.990435 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-0656a62b-186b-48eb-9a3b-4eb7dc4a47ae tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:57:54.990882 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-0656a62b-186b-48eb-9a3b-4eb7dc4a47ae tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:57:54.991298 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-0656a62b-186b-48eb-9a3b-4eb7dc4a47ae tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:57:55.212621 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-0656a62b-186b-48eb-9a3b-4eb7dc4a47ae tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:57:55.221578 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-0656a62b-186b-48eb-9a3b-4eb7dc4a47ae tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:57:55.223118 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-0656a62b-186b-48eb-9a3b-4eb7dc4a47ae tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:57:55.224452 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-0656a62b-186b-48eb-9a3b-4eb7dc4a47ae tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/161ef6e2-46fb-4c64-bbf0-c178886e0965" status: 200 len: 1726 microversion: 2.20 time: 0.247933 Oct 15 13:57:55.225019 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 463/946] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:57:54 2022] GET /compute/v2.1/servers/161ef6e2-46fb-4c64-bbf0-c178886e0965 => generated 1726 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 13:57:56.250642 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-1bcb9d3d-3ad7-4bfe-ba0f-bf8dc58540e3 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:57:56.251455 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-1bcb9d3d-3ad7-4bfe-ba0f-bf8dc58540e3 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 161ef6e2-46fb-4c64-bbf0-c178886e0965] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:57:56.258103 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-1bcb9d3d-3ad7-4bfe-ba0f-bf8dc58540e3 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:57:56.258637 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-1bcb9d3d-3ad7-4bfe-ba0f-bf8dc58540e3 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:57:56.259078 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-1bcb9d3d-3ad7-4bfe-ba0f-bf8dc58540e3 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:57:56.259778 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-1bcb9d3d-3ad7-4bfe-ba0f-bf8dc58540e3 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:57:56.260297 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-1bcb9d3d-3ad7-4bfe-ba0f-bf8dc58540e3 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:57:56.260702 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-1bcb9d3d-3ad7-4bfe-ba0f-bf8dc58540e3 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:57:56.495936 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-1bcb9d3d-3ad7-4bfe-ba0f-bf8dc58540e3 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:57:56.505156 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-1bcb9d3d-3ad7-4bfe-ba0f-bf8dc58540e3 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:57:56.506853 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-1bcb9d3d-3ad7-4bfe-ba0f-bf8dc58540e3 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:57:56.508122 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-1bcb9d3d-3ad7-4bfe-ba0f-bf8dc58540e3 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/161ef6e2-46fb-4c64-bbf0-c178886e0965" status: 200 len: 1726 microversion: 2.20 time: 0.261519 Oct 15 13:57:56.508744 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 484/947] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:57:56 2022] GET /compute/v2.1/servers/161ef6e2-46fb-4c64-bbf0-c178886e0965 => generated 1726 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 13:57:57.136782 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [req-10555fd4-d29f-4fb5-963f-28f8494ce618 req-bb1d64c5-3ae4-4293-8571-8672cc8d7701 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bceb7f8c-8854-493e-b707-efe98ac7eb5b", "tag": "a8e5516a-30ab-4376-8e26-9efdb40d9c1e"}]} {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 13:57:57.155047 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [req-10555fd4-d29f-4fb5-963f-28f8494ce618 req-bb1d64c5-3ae4-4293-8571-8672cc8d7701 service nova] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:57:57.155774 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [req-10555fd4-d29f-4fb5-963f-28f8494ce618 req-bb1d64c5-3ae4-4293-8571-8672cc8d7701 service nova] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:57:57.156342 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [req-10555fd4-d29f-4fb5-963f-28f8494ce618 req-bb1d64c5-3ae4-4293-8571-8672cc8d7701 service nova] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:57:57.169286 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.compute.server_external_events [req-10555fd4-d29f-4fb5-963f-28f8494ce618 req-bb1d64c5-3ae4-4293-8571-8672cc8d7701 service nova] Creating event network-changed:a8e5516a-30ab-4376-8e26-9efdb40d9c1e for instance bceb7f8c-8854-493e-b707-efe98ac7eb5b on hv-cinder-86149 Oct 15 13:57:57.174454 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [req-10555fd4-d29f-4fb5-963f-28f8494ce618 req-bb1d64c5-3ae4-4293-8571-8672cc8d7701 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043179 Oct 15 13:57:57.175067 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 464/948] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 15 13:57:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 13:57:57.533734 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-cd2d4d7c-10ba-4a4c-b492-ba76414d51c6 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:57:57.534343 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-cd2d4d7c-10ba-4a4c-b492-ba76414d51c6 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 161ef6e2-46fb-4c64-bbf0-c178886e0965] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:57:57.541818 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-cd2d4d7c-10ba-4a4c-b492-ba76414d51c6 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:57:57.542584 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-cd2d4d7c-10ba-4a4c-b492-ba76414d51c6 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:57:57.543177 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-cd2d4d7c-10ba-4a4c-b492-ba76414d51c6 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:57:57.544075 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-cd2d4d7c-10ba-4a4c-b492-ba76414d51c6 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:57:57.544672 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-cd2d4d7c-10ba-4a4c-b492-ba76414d51c6 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:57:57.545267 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-cd2d4d7c-10ba-4a4c-b492-ba76414d51c6 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:57:57.687109 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-cd2d4d7c-10ba-4a4c-b492-ba76414d51c6 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:57:57.695707 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-cd2d4d7c-10ba-4a4c-b492-ba76414d51c6 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:57:57.697532 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-cd2d4d7c-10ba-4a4c-b492-ba76414d51c6 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:57:57.698743 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-cd2d4d7c-10ba-4a4c-b492-ba76414d51c6 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/161ef6e2-46fb-4c64-bbf0-c178886e0965" status: 200 len: 1747 microversion: 2.20 time: 0.169312 Oct 15 13:57:57.699318 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 485/949] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:57:57 2022] GET /compute/v2.1/servers/161ef6e2-46fb-4c64-bbf0-c178886e0965 => generated 1747 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 13:57:58.725896 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-50239b35-4efc-4437-83cc-d24444bbcbbf tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:57:58.726595 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-50239b35-4efc-4437-83cc-d24444bbcbbf tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 161ef6e2-46fb-4c64-bbf0-c178886e0965] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:57:58.736101 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-50239b35-4efc-4437-83cc-d24444bbcbbf tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:57:58.736829 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-50239b35-4efc-4437-83cc-d24444bbcbbf tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:57:58.737670 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-50239b35-4efc-4437-83cc-d24444bbcbbf tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:57:58.738365 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-50239b35-4efc-4437-83cc-d24444bbcbbf tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:57:58.738810 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-50239b35-4efc-4437-83cc-d24444bbcbbf tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:57:58.739234 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-50239b35-4efc-4437-83cc-d24444bbcbbf tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:57:58.882294 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-50239b35-4efc-4437-83cc-d24444bbcbbf tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:57:58.891648 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-50239b35-4efc-4437-83cc-d24444bbcbbf tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:57:58.893156 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-50239b35-4efc-4437-83cc-d24444bbcbbf tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:57:58.894339 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-50239b35-4efc-4437-83cc-d24444bbcbbf tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/161ef6e2-46fb-4c64-bbf0-c178886e0965" status: 200 len: 1747 microversion: 2.20 time: 0.174234 Oct 15 13:57:58.894965 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 465/950] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:57:58 2022] GET /compute/v2.1/servers/161ef6e2-46fb-4c64-bbf0-c178886e0965 => generated 1747 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 13:57:59.921153 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-8b212d48-5e14-4ca3-909b-3de24c1b37c6 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:57:59.921786 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-8b212d48-5e14-4ca3-909b-3de24c1b37c6 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 161ef6e2-46fb-4c64-bbf0-c178886e0965] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:57:59.928696 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-8b212d48-5e14-4ca3-909b-3de24c1b37c6 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:57:59.929198 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-8b212d48-5e14-4ca3-909b-3de24c1b37c6 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:57:59.929666 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-8b212d48-5e14-4ca3-909b-3de24c1b37c6 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:57:59.930426 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-8b212d48-5e14-4ca3-909b-3de24c1b37c6 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:57:59.931278 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-8b212d48-5e14-4ca3-909b-3de24c1b37c6 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:57:59.931698 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-8b212d48-5e14-4ca3-909b-3de24c1b37c6 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:58:00.089296 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-8b212d48-5e14-4ca3-909b-3de24c1b37c6 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:58:00.098200 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-8b212d48-5e14-4ca3-909b-3de24c1b37c6 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:58:00.099768 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-8b212d48-5e14-4ca3-909b-3de24c1b37c6 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:58:00.101037 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-8b212d48-5e14-4ca3-909b-3de24c1b37c6 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/161ef6e2-46fb-4c64-bbf0-c178886e0965" status: 200 len: 1747 microversion: 2.20 time: 0.184244 Oct 15 13:58:00.101603 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 486/951] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:57:59 2022] GET /compute/v2.1/servers/161ef6e2-46fb-4c64-bbf0-c178886e0965 => generated 1747 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 13:58:01.128029 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-878e38c9-a0fa-4304-9109-1641504467df tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:58:01.128617 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-878e38c9-a0fa-4304-9109-1641504467df tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 161ef6e2-46fb-4c64-bbf0-c178886e0965] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:58:01.130986 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG dbcounter [-] [125243] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=3 {{(pid=125243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:58:01.136827 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-878e38c9-a0fa-4304-9109-1641504467df tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:58:01.137317 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-878e38c9-a0fa-4304-9109-1641504467df tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:58:01.137736 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-878e38c9-a0fa-4304-9109-1641504467df tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:58:01.138432 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-878e38c9-a0fa-4304-9109-1641504467df tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:58:01.138886 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-878e38c9-a0fa-4304-9109-1641504467df tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:58:01.139305 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-878e38c9-a0fa-4304-9109-1641504467df tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:58:01.283249 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-878e38c9-a0fa-4304-9109-1641504467df tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:58:01.293210 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-878e38c9-a0fa-4304-9109-1641504467df tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:58:01.294656 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-878e38c9-a0fa-4304-9109-1641504467df tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:58:01.295822 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-878e38c9-a0fa-4304-9109-1641504467df tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/161ef6e2-46fb-4c64-bbf0-c178886e0965" status: 200 len: 1747 microversion: 2.20 time: 0.171995 Oct 15 13:58:01.296468 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 466/952] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:58:01 2022] GET /compute/v2.1/servers/161ef6e2-46fb-4c64-bbf0-c178886e0965 => generated 1747 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 13:58:01.896994 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [req-c14dcf88-13d3-46ee-8373-fc55faf740d9 req-288731bd-85e5-453f-800e-89488c0a01a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "161ef6e2-46fb-4c64-bbf0-c178886e0965", "name": "network-vif-plugged", "status": "completed", "tag": "b7f79f6d-d3ad-4794-bbcd-8936f95ed2b8"}]} {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 13:58:01.902352 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG dbcounter [-] [125242] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1 {{(pid=125242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:58:01.910638 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [req-c14dcf88-13d3-46ee-8373-fc55faf740d9 req-288731bd-85e5-453f-800e-89488c0a01a3 service nova] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:58:01.911157 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [req-c14dcf88-13d3-46ee-8373-fc55faf740d9 req-288731bd-85e5-453f-800e-89488c0a01a3 service nova] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:58:01.911921 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [req-c14dcf88-13d3-46ee-8373-fc55faf740d9 req-288731bd-85e5-453f-800e-89488c0a01a3 service nova] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:58:01.925577 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.compute.server_external_events [req-c14dcf88-13d3-46ee-8373-fc55faf740d9 req-288731bd-85e5-453f-800e-89488c0a01a3 service nova] Creating event network-vif-plugged:b7f79f6d-d3ad-4794-bbcd-8936f95ed2b8 for instance 161ef6e2-46fb-4c64-bbf0-c178886e0965 on hv-cinder-86149 Oct 15 13:58:01.931207 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [req-c14dcf88-13d3-46ee-8373-fc55faf740d9 req-288731bd-85e5-453f-800e-89488c0a01a3 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038606 Oct 15 13:58:01.931772 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 487/953] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 15 13:58:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 13:58:02.329843 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-317daddc-2f4a-4589-a79a-f8b20af7d032 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:58:02.330470 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-317daddc-2f4a-4589-a79a-f8b20af7d032 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 161ef6e2-46fb-4c64-bbf0-c178886e0965] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:58:02.337058 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-317daddc-2f4a-4589-a79a-f8b20af7d032 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:58:02.337635 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-317daddc-2f4a-4589-a79a-f8b20af7d032 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:58:02.338095 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-317daddc-2f4a-4589-a79a-f8b20af7d032 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:58:02.338779 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-317daddc-2f4a-4589-a79a-f8b20af7d032 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:58:02.339230 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-317daddc-2f4a-4589-a79a-f8b20af7d032 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:58:02.339641 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-317daddc-2f4a-4589-a79a-f8b20af7d032 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:58:02.493099 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-317daddc-2f4a-4589-a79a-f8b20af7d032 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:58:02.502130 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-317daddc-2f4a-4589-a79a-f8b20af7d032 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:58:02.503593 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-317daddc-2f4a-4589-a79a-f8b20af7d032 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:58:02.504803 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-317daddc-2f4a-4589-a79a-f8b20af7d032 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/161ef6e2-46fb-4c64-bbf0-c178886e0965" status: 200 len: 1747 microversion: 2.20 time: 0.186857 Oct 15 13:58:02.505432 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 467/954] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:58:02 2022] GET /compute/v2.1/servers/161ef6e2-46fb-4c64-bbf0-c178886e0965 => generated 1747 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 13:58:03.536069 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-9c65e647-e037-4f52-be28-08b691a82b16 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:58:03.537688 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-9c65e647-e037-4f52-be28-08b691a82b16 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 161ef6e2-46fb-4c64-bbf0-c178886e0965] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:58:03.545963 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-9c65e647-e037-4f52-be28-08b691a82b16 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:58:03.546742 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-9c65e647-e037-4f52-be28-08b691a82b16 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:58:03.547215 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-9c65e647-e037-4f52-be28-08b691a82b16 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:58:03.547941 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-9c65e647-e037-4f52-be28-08b691a82b16 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:58:03.548393 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-9c65e647-e037-4f52-be28-08b691a82b16 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:58:03.548995 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-9c65e647-e037-4f52-be28-08b691a82b16 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:58:03.714059 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-9c65e647-e037-4f52-be28-08b691a82b16 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:58:03.723295 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-9c65e647-e037-4f52-be28-08b691a82b16 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:58:03.725173 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-9c65e647-e037-4f52-be28-08b691a82b16 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:58:03.726445 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-9c65e647-e037-4f52-be28-08b691a82b16 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/161ef6e2-46fb-4c64-bbf0-c178886e0965" status: 200 len: 1742 microversion: 2.20 time: 0.195198 Oct 15 13:58:03.727126 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 488/955] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:58:03 2022] GET /compute/v2.1/servers/161ef6e2-46fb-4c64-bbf0-c178886e0965 => generated 1742 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 13:58:04.755892 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-9b49ae8c-f213-46ee-8541-b520270eb6af tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:58:04.756484 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-9b49ae8c-f213-46ee-8541-b520270eb6af tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 161ef6e2-46fb-4c64-bbf0-c178886e0965] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:58:04.763770 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-9b49ae8c-f213-46ee-8541-b520270eb6af tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:58:04.764285 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-9b49ae8c-f213-46ee-8541-b520270eb6af tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:58:04.764729 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-9b49ae8c-f213-46ee-8541-b520270eb6af tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:58:04.765410 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-9b49ae8c-f213-46ee-8541-b520270eb6af tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:58:04.766107 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-9b49ae8c-f213-46ee-8541-b520270eb6af tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:58:04.766728 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-9b49ae8c-f213-46ee-8541-b520270eb6af tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:58:04.943394 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-9b49ae8c-f213-46ee-8541-b520270eb6af tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:58:04.952185 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-9b49ae8c-f213-46ee-8541-b520270eb6af tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:58:04.953790 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-9b49ae8c-f213-46ee-8541-b520270eb6af tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:58:04.956024 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-9b49ae8c-f213-46ee-8541-b520270eb6af tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/161ef6e2-46fb-4c64-bbf0-c178886e0965" status: 200 len: 1742 microversion: 2.20 time: 0.203061 Oct 15 13:58:04.956578 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 468/956] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:58:04 2022] GET /compute/v2.1/servers/161ef6e2-46fb-4c64-bbf0-c178886e0965 => generated 1742 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 13:58:05.984083 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-2c906f9b-54d5-42bf-b5b7-421d6fb872fa tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:58:05.984806 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-2c906f9b-54d5-42bf-b5b7-421d6fb872fa tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 161ef6e2-46fb-4c64-bbf0-c178886e0965] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:58:05.992753 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-2c906f9b-54d5-42bf-b5b7-421d6fb872fa tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:58:05.993255 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-2c906f9b-54d5-42bf-b5b7-421d6fb872fa tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:58:05.993706 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-2c906f9b-54d5-42bf-b5b7-421d6fb872fa tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:58:05.994458 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-2c906f9b-54d5-42bf-b5b7-421d6fb872fa tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:58:05.994920 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-2c906f9b-54d5-42bf-b5b7-421d6fb872fa tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:58:05.995347 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-2c906f9b-54d5-42bf-b5b7-421d6fb872fa tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:58:06.161994 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-2c906f9b-54d5-42bf-b5b7-421d6fb872fa tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:58:06.171739 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-2c906f9b-54d5-42bf-b5b7-421d6fb872fa tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:58:06.173257 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-2c906f9b-54d5-42bf-b5b7-421d6fb872fa tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:58:06.174453 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-2c906f9b-54d5-42bf-b5b7-421d6fb872fa tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/161ef6e2-46fb-4c64-bbf0-c178886e0965" status: 200 len: 1742 microversion: 2.20 time: 0.195461 Oct 15 13:58:06.175026 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 489/957] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:58:05 2022] GET /compute/v2.1/servers/161ef6e2-46fb-4c64-bbf0-c178886e0965 => generated 1742 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 13:58:07.202797 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-393e97b5-b578-4409-b472-6195ab58704b tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:58:07.205364 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-393e97b5-b578-4409-b472-6195ab58704b tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 161ef6e2-46fb-4c64-bbf0-c178886e0965] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:58:07.213829 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-393e97b5-b578-4409-b472-6195ab58704b tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:58:07.214320 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-393e97b5-b578-4409-b472-6195ab58704b tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:58:07.214790 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-393e97b5-b578-4409-b472-6195ab58704b tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:58:07.215508 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-393e97b5-b578-4409-b472-6195ab58704b tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:58:07.216005 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-393e97b5-b578-4409-b472-6195ab58704b tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:58:07.216433 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-393e97b5-b578-4409-b472-6195ab58704b tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:58:07.424276 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-393e97b5-b578-4409-b472-6195ab58704b tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:58:07.439822 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-393e97b5-b578-4409-b472-6195ab58704b tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:58:07.441394 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-393e97b5-b578-4409-b472-6195ab58704b tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:58:07.442875 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-393e97b5-b578-4409-b472-6195ab58704b tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/161ef6e2-46fb-4c64-bbf0-c178886e0965" status: 200 len: 1742 microversion: 2.20 time: 0.245794 Oct 15 13:58:07.456603 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 469/958] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:58:07 2022] GET /compute/v2.1/servers/161ef6e2-46fb-4c64-bbf0-c178886e0965 => generated 1742 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 13:58:08.475772 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-8ab21a74-0f26-4fa7-9c12-b0d055751db0 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:58:08.476327 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-8ab21a74-0f26-4fa7-9c12-b0d055751db0 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 161ef6e2-46fb-4c64-bbf0-c178886e0965] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:58:08.488153 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-8ab21a74-0f26-4fa7-9c12-b0d055751db0 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:58:08.488654 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-8ab21a74-0f26-4fa7-9c12-b0d055751db0 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:58:08.489091 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-8ab21a74-0f26-4fa7-9c12-b0d055751db0 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:58:08.489809 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-8ab21a74-0f26-4fa7-9c12-b0d055751db0 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:58:08.490247 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-8ab21a74-0f26-4fa7-9c12-b0d055751db0 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:58:08.490669 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-8ab21a74-0f26-4fa7-9c12-b0d055751db0 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:58:08.636090 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-8ab21a74-0f26-4fa7-9c12-b0d055751db0 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:58:08.645792 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-8ab21a74-0f26-4fa7-9c12-b0d055751db0 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:58:08.647911 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-8ab21a74-0f26-4fa7-9c12-b0d055751db0 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:58:08.649087 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-8ab21a74-0f26-4fa7-9c12-b0d055751db0 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/161ef6e2-46fb-4c64-bbf0-c178886e0965" status: 200 len: 1742 microversion: 2.20 time: 0.177601 Oct 15 13:58:08.649830 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 490/959] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:58:08 2022] GET /compute/v2.1/servers/161ef6e2-46fb-4c64-bbf0-c178886e0965 => generated 1742 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 15 13:58:09.678088 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-d2d52735-6a79-476e-8cc6-65ca261c6944 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:58:09.678859 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-d2d52735-6a79-476e-8cc6-65ca261c6944 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 161ef6e2-46fb-4c64-bbf0-c178886e0965] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:58:09.686740 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-d2d52735-6a79-476e-8cc6-65ca261c6944 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:58:09.687237 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-d2d52735-6a79-476e-8cc6-65ca261c6944 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:58:09.687679 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-d2d52735-6a79-476e-8cc6-65ca261c6944 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:58:09.688431 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-d2d52735-6a79-476e-8cc6-65ca261c6944 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:58:09.688880 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-d2d52735-6a79-476e-8cc6-65ca261c6944 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:58:09.689334 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-d2d52735-6a79-476e-8cc6-65ca261c6944 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:58:09.880819 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-d2d52735-6a79-476e-8cc6-65ca261c6944 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:58:09.903743 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-d2d52735-6a79-476e-8cc6-65ca261c6944 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:58:09.905243 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-d2d52735-6a79-476e-8cc6-65ca261c6944 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:58:09.906441 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-d2d52735-6a79-476e-8cc6-65ca261c6944 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/161ef6e2-46fb-4c64-bbf0-c178886e0965" status: 200 len: 1742 microversion: 2.20 time: 0.232565 Oct 15 13:58:09.907019 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 470/960] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:58:09 2022] GET /compute/v2.1/servers/161ef6e2-46fb-4c64-bbf0-c178886e0965 => generated 1742 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 13:58:10.935248 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-1cfb840b-441e-49f9-8cfb-3846a9c48c99 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:58:10.936244 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-1cfb840b-441e-49f9-8cfb-3846a9c48c99 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 161ef6e2-46fb-4c64-bbf0-c178886e0965] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:58:10.946384 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-1cfb840b-441e-49f9-8cfb-3846a9c48c99 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:58:10.947102 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-1cfb840b-441e-49f9-8cfb-3846a9c48c99 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:58:10.947547 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-1cfb840b-441e-49f9-8cfb-3846a9c48c99 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:58:10.948620 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-1cfb840b-441e-49f9-8cfb-3846a9c48c99 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:58:10.949572 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-1cfb840b-441e-49f9-8cfb-3846a9c48c99 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:58:10.950344 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-1cfb840b-441e-49f9-8cfb-3846a9c48c99 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:58:11.155982 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-1cfb840b-441e-49f9-8cfb-3846a9c48c99 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:58:11.170107 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-1cfb840b-441e-49f9-8cfb-3846a9c48c99 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:58:11.172789 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-1cfb840b-441e-49f9-8cfb-3846a9c48c99 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:58:11.174583 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-1cfb840b-441e-49f9-8cfb-3846a9c48c99 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/161ef6e2-46fb-4c64-bbf0-c178886e0965" status: 200 len: 1742 microversion: 2.20 time: 0.243487 Oct 15 13:58:11.175328 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 491/961] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:58:10 2022] GET /compute/v2.1/servers/161ef6e2-46fb-4c64-bbf0-c178886e0965 => generated 1742 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 13:58:12.207957 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-75032735-195d-4944-b833-45fecaded122 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:58:12.209095 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-75032735-195d-4944-b833-45fecaded122 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 161ef6e2-46fb-4c64-bbf0-c178886e0965] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:58:12.222261 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-75032735-195d-4944-b833-45fecaded122 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:58:12.223135 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-75032735-195d-4944-b833-45fecaded122 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:58:12.223959 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-75032735-195d-4944-b833-45fecaded122 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:58:12.225223 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-75032735-195d-4944-b833-45fecaded122 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:58:12.226050 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-75032735-195d-4944-b833-45fecaded122 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:58:12.226802 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-75032735-195d-4944-b833-45fecaded122 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:58:12.419547 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-75032735-195d-4944-b833-45fecaded122 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:58:12.432606 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-75032735-195d-4944-b833-45fecaded122 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:58:12.434099 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-75032735-195d-4944-b833-45fecaded122 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:58:12.435573 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-75032735-195d-4944-b833-45fecaded122 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/161ef6e2-46fb-4c64-bbf0-c178886e0965" status: 200 len: 1742 microversion: 2.20 time: 0.235566 Oct 15 13:58:12.436355 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 471/962] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:58:12 2022] GET /compute/v2.1/servers/161ef6e2-46fb-4c64-bbf0-c178886e0965 => generated 1742 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 13:58:13.462566 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-af732e34-74a2-4395-b793-28522edc9679 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:58:13.463286 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-af732e34-74a2-4395-b793-28522edc9679 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 161ef6e2-46fb-4c64-bbf0-c178886e0965] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:58:13.470800 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-af732e34-74a2-4395-b793-28522edc9679 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:58:13.471357 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-af732e34-74a2-4395-b793-28522edc9679 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:58:13.472138 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-af732e34-74a2-4395-b793-28522edc9679 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:58:13.472911 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-af732e34-74a2-4395-b793-28522edc9679 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:58:13.473445 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-af732e34-74a2-4395-b793-28522edc9679 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:58:13.473937 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-af732e34-74a2-4395-b793-28522edc9679 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:58:13.624145 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-af732e34-74a2-4395-b793-28522edc9679 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:58:13.632405 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-af732e34-74a2-4395-b793-28522edc9679 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:58:13.633884 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-af732e34-74a2-4395-b793-28522edc9679 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:58:13.635071 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-af732e34-74a2-4395-b793-28522edc9679 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/161ef6e2-46fb-4c64-bbf0-c178886e0965" status: 200 len: 1742 microversion: 2.20 time: 0.176620 Oct 15 13:58:13.635638 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 492/963] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:58:13 2022] GET /compute/v2.1/servers/161ef6e2-46fb-4c64-bbf0-c178886e0965 => generated 1742 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 13:58:14.662065 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-fbe934eb-1e5e-446d-b9cd-ed9bd079d8db tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:58:14.662708 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-fbe934eb-1e5e-446d-b9cd-ed9bd079d8db tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 161ef6e2-46fb-4c64-bbf0-c178886e0965] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:58:14.670151 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-fbe934eb-1e5e-446d-b9cd-ed9bd079d8db tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:58:14.670637 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-fbe934eb-1e5e-446d-b9cd-ed9bd079d8db tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:58:14.671075 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-fbe934eb-1e5e-446d-b9cd-ed9bd079d8db tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:58:14.671778 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-fbe934eb-1e5e-446d-b9cd-ed9bd079d8db tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:58:14.672303 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-fbe934eb-1e5e-446d-b9cd-ed9bd079d8db tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:58:14.672699 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-fbe934eb-1e5e-446d-b9cd-ed9bd079d8db tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:58:14.811940 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-fbe934eb-1e5e-446d-b9cd-ed9bd079d8db tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:58:14.823972 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-fbe934eb-1e5e-446d-b9cd-ed9bd079d8db tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:58:14.825974 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-fbe934eb-1e5e-446d-b9cd-ed9bd079d8db tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:58:14.827154 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-fbe934eb-1e5e-446d-b9cd-ed9bd079d8db tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/161ef6e2-46fb-4c64-bbf0-c178886e0965" status: 200 len: 1724 microversion: 2.20 time: 0.169351 Oct 15 13:58:14.827732 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 472/964] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:58:14 2022] GET /compute/v2.1/servers/161ef6e2-46fb-4c64-bbf0-c178886e0965 => generated 1724 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 13:58:15.852964 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-f425a11d-f4c8-4e9d-b2fe-d2162e89ec85 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:58:15.853585 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-f425a11d-f4c8-4e9d-b2fe-d2162e89ec85 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 161ef6e2-46fb-4c64-bbf0-c178886e0965] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:58:15.861411 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-f425a11d-f4c8-4e9d-b2fe-d2162e89ec85 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:58:15.862021 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-f425a11d-f4c8-4e9d-b2fe-d2162e89ec85 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:58:15.862684 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-f425a11d-f4c8-4e9d-b2fe-d2162e89ec85 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:58:15.863756 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-f425a11d-f4c8-4e9d-b2fe-d2162e89ec85 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:58:15.864473 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-f425a11d-f4c8-4e9d-b2fe-d2162e89ec85 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:58:15.865104 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-f425a11d-f4c8-4e9d-b2fe-d2162e89ec85 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:58:16.012689 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-f425a11d-f4c8-4e9d-b2fe-d2162e89ec85 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:58:16.021131 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-f425a11d-f4c8-4e9d-b2fe-d2162e89ec85 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:58:16.022581 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-f425a11d-f4c8-4e9d-b2fe-d2162e89ec85 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:58:16.023761 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-f425a11d-f4c8-4e9d-b2fe-d2162e89ec85 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/161ef6e2-46fb-4c64-bbf0-c178886e0965" status: 200 len: 1724 microversion: 2.20 time: 0.174911 Oct 15 13:58:16.025106 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 493/965] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:58:15 2022] GET /compute/v2.1/servers/161ef6e2-46fb-4c64-bbf0-c178886e0965 => generated 1724 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 13:58:17.054349 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-280083a8-f61d-426a-80ad-9d17fab9dfca tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:58:17.054979 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-280083a8-f61d-426a-80ad-9d17fab9dfca tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 161ef6e2-46fb-4c64-bbf0-c178886e0965] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:58:17.062494 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-280083a8-f61d-426a-80ad-9d17fab9dfca tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:58:17.062977 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-280083a8-f61d-426a-80ad-9d17fab9dfca tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:58:17.063411 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-280083a8-f61d-426a-80ad-9d17fab9dfca tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:58:17.064166 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-280083a8-f61d-426a-80ad-9d17fab9dfca tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:58:17.064598 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-280083a8-f61d-426a-80ad-9d17fab9dfca tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:58:17.065012 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-280083a8-f61d-426a-80ad-9d17fab9dfca tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:58:17.206811 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-280083a8-f61d-426a-80ad-9d17fab9dfca tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:58:17.215980 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-280083a8-f61d-426a-80ad-9d17fab9dfca tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:58:17.217392 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-280083a8-f61d-426a-80ad-9d17fab9dfca tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:58:17.218592 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-280083a8-f61d-426a-80ad-9d17fab9dfca tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/161ef6e2-46fb-4c64-bbf0-c178886e0965" status: 200 len: 1667 microversion: 2.20 time: 0.168322 Oct 15 13:58:17.219173 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 473/966] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:58:17 2022] GET /compute/v2.1/servers/161ef6e2-46fb-4c64-bbf0-c178886e0965 => generated 1667 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 13:58:17.244696 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-af197e2b-fd94-4597-8e23-237dccfb75d8 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6f75a6ad-b7b3-46e2-ad3a-1a361aad709c"}} {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 13:58:17.247661 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-af197e2b-fd94-4597-8e23-237dccfb75d8 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 161ef6e2-46fb-4c64-bbf0-c178886e0965] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:58:17.254735 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-af197e2b-fd94-4597-8e23-237dccfb75d8 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:58:17.255224 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-af197e2b-fd94-4597-8e23-237dccfb75d8 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:58:17.255659 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-af197e2b-fd94-4597-8e23-237dccfb75d8 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:58:17.256391 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-af197e2b-fd94-4597-8e23-237dccfb75d8 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:58:17.256837 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-af197e2b-fd94-4597-8e23-237dccfb75d8 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:58:17.257283 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-af197e2b-fd94-4597-8e23-237dccfb75d8 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:58:17.579566 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-af197e2b-fd94-4597-8e23-237dccfb75d8 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "POST /compute/v2.1/servers/161ef6e2-46fb-4c64-bbf0-c178886e0965/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.338964 Oct 15 13:58:17.580213 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 494/967] 10.222.0.36 () {62 vars in 1364 bytes} [Sat Oct 15 13:58:17 2022] POST /compute/v2.1/servers/161ef6e2-46fb-4c64-bbf0-c178886e0965/os-volume_attachments => generated 188 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 13:58:17.731609 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-9c9b9106-e1c3-449d-a1e3-02f753690f80 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:58:17.732518 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-9c9b9106-e1c3-449d-a1e3-02f753690f80 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 161ef6e2-46fb-4c64-bbf0-c178886e0965] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:58:17.739303 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-9c9b9106-e1c3-449d-a1e3-02f753690f80 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:58:17.739798 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-9c9b9106-e1c3-449d-a1e3-02f753690f80 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:58:17.740263 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-9c9b9106-e1c3-449d-a1e3-02f753690f80 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:58:17.740984 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-9c9b9106-e1c3-449d-a1e3-02f753690f80 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:58:17.741430 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-9c9b9106-e1c3-449d-a1e3-02f753690f80 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:58:17.741833 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-9c9b9106-e1c3-449d-a1e3-02f753690f80 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:58:17.957884 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [req-ed359269-052a-42e4-b5a1-bfae4f588ce3 req-5a70b756-d6df-470e-b831-da7b732145c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "161ef6e2-46fb-4c64-bbf0-c178886e0965", "name": "network-vif-unplugged", "status": "completed", "tag": "b7f79f6d-d3ad-4794-bbcd-8936f95ed2b8"}]} {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 13:58:17.969233 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [req-ed359269-052a-42e4-b5a1-bfae4f588ce3 req-5a70b756-d6df-470e-b831-da7b732145c9 service nova] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:58:17.970028 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [req-ed359269-052a-42e4-b5a1-bfae4f588ce3 req-5a70b756-d6df-470e-b831-da7b732145c9 service nova] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:58:17.970622 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [req-ed359269-052a-42e4-b5a1-bfae4f588ce3 req-5a70b756-d6df-470e-b831-da7b732145c9 service nova] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:58:17.984920 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.compute.server_external_events [req-ed359269-052a-42e4-b5a1-bfae4f588ce3 req-5a70b756-d6df-470e-b831-da7b732145c9 service nova] Unable to find a host for instance 161ef6e2-46fb-4c64-bbf0-c178886e0965. Dropping event network-vif-unplugged {{(pid=125242) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 15 13:58:17.985954 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [req-ed359269-052a-42e4-b5a1-bfae4f588ce3 req-5a70b756-d6df-470e-b831-da7b732145c9 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.032183 Oct 15 13:58:17.986624 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 495/968] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 15 13:58:17 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 33 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 15 13:58:18.017475 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-9c9b9106-e1c3-449d-a1e3-02f753690f80 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "DELETE /compute/v2.1/servers/161ef6e2-46fb-4c64-bbf0-c178886e0965/os-volume_attachments/6f75a6ad-b7b3-46e2-ad3a-1a361aad709c" status: 202 len: 0 microversion: 2.20 time: 0.289824 Oct 15 13:58:18.018167 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 474/969] 10.222.0.36 () {60 vars in 1457 bytes} [Sat Oct 15 13:58:17 2022] DELETE /compute/v2.1/servers/161ef6e2-46fb-4c64-bbf0-c178886e0965/os-volume_attachments/6f75a6ad-b7b3-46e2-ad3a-1a361aad709c => generated 0 bytes in 291 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 15 13:58:18.088035 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-fdf0a5c4-bf85-456b-9439-477c545a9650 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 13:58:18.088632 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-fdf0a5c4-bf85-456b-9439-477c545a9650 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 161ef6e2-46fb-4c64-bbf0-c178886e0965] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:58:18.094872 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-fdf0a5c4-bf85-456b-9439-477c545a9650 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:58:18.095364 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-fdf0a5c4-bf85-456b-9439-477c545a9650 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:58:18.095800 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-fdf0a5c4-bf85-456b-9439-477c545a9650 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:58:18.096533 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-fdf0a5c4-bf85-456b-9439-477c545a9650 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:58:18.096986 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-fdf0a5c4-bf85-456b-9439-477c545a9650 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:58:18.097409 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-fdf0a5c4-bf85-456b-9439-477c545a9650 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:58:18.101410 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG dbcounter [-] [125242] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=125242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:58:18.130566 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-fdf0a5c4-bf85-456b-9439-477c545a9650 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 161ef6e2-46fb-4c64-bbf0-c178886e0965] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=125242) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 15 13:58:18.210394 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-fdf0a5c4-bf85-456b-9439-477c545a9650 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "POST /compute/v2.1/servers/161ef6e2-46fb-4c64-bbf0-c178886e0965/action" status: 202 len: 0 microversion: 2.20 time: 0.125941 Oct 15 13:58:18.214822 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 496/970] 10.222.0.36 () {62 vars in 1319 bytes} [Sat Oct 15 13:58:18 2022] POST /compute/v2.1/servers/161ef6e2-46fb-4c64-bbf0-c178886e0965/action => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 15 13:58:18.224380 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-949667d5-7f63-458b-8457-d4096a63218c tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:58:18.225469 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-949667d5-7f63-458b-8457-d4096a63218c tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 161ef6e2-46fb-4c64-bbf0-c178886e0965] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:58:18.235580 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-949667d5-7f63-458b-8457-d4096a63218c tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:58:18.236278 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-949667d5-7f63-458b-8457-d4096a63218c tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:58:18.236712 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-949667d5-7f63-458b-8457-d4096a63218c tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:58:18.237411 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-949667d5-7f63-458b-8457-d4096a63218c tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:58:18.237846 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-949667d5-7f63-458b-8457-d4096a63218c tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:58:18.238295 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-949667d5-7f63-458b-8457-d4096a63218c tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:58:18.384955 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-949667d5-7f63-458b-8457-d4096a63218c tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:58:18.394773 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-949667d5-7f63-458b-8457-d4096a63218c tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:58:18.396655 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-949667d5-7f63-458b-8457-d4096a63218c tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:58:18.398611 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-949667d5-7f63-458b-8457-d4096a63218c tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/161ef6e2-46fb-4c64-bbf0-c178886e0965" status: 200 len: 1675 microversion: 2.20 time: 0.181561 Oct 15 13:58:18.399456 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 475/971] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:58:18 2022] GET /compute/v2.1/servers/161ef6e2-46fb-4c64-bbf0-c178886e0965 => generated 1675 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 13:58:19.427680 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-a39fe3c0-05e6-4537-9974-d3a02988f2e6 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:58:19.428386 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-a39fe3c0-05e6-4537-9974-d3a02988f2e6 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 161ef6e2-46fb-4c64-bbf0-c178886e0965] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:58:19.435185 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-a39fe3c0-05e6-4537-9974-d3a02988f2e6 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:58:19.435693 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-a39fe3c0-05e6-4537-9974-d3a02988f2e6 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:58:19.436168 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-a39fe3c0-05e6-4537-9974-d3a02988f2e6 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:58:19.436885 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-a39fe3c0-05e6-4537-9974-d3a02988f2e6 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:58:19.437330 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-a39fe3c0-05e6-4537-9974-d3a02988f2e6 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:58:19.437758 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-a39fe3c0-05e6-4537-9974-d3a02988f2e6 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:58:19.577908 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-a39fe3c0-05e6-4537-9974-d3a02988f2e6 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:58:19.586472 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-a39fe3c0-05e6-4537-9974-d3a02988f2e6 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:58:19.587938 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-a39fe3c0-05e6-4537-9974-d3a02988f2e6 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:58:19.589127 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-a39fe3c0-05e6-4537-9974-d3a02988f2e6 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/161ef6e2-46fb-4c64-bbf0-c178886e0965" status: 200 len: 1733 microversion: 2.20 time: 0.167379 Oct 15 13:58:19.589908 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 497/972] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:58:19 2022] GET /compute/v2.1/servers/161ef6e2-46fb-4c64-bbf0-c178886e0965 => generated 1733 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 13:58:20.616889 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-ac9dada2-97f7-4801-978a-4b53bcea10c8 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:58:20.617859 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-ac9dada2-97f7-4801-978a-4b53bcea10c8 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 161ef6e2-46fb-4c64-bbf0-c178886e0965] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:58:20.624880 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-ac9dada2-97f7-4801-978a-4b53bcea10c8 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:58:20.625525 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-ac9dada2-97f7-4801-978a-4b53bcea10c8 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:58:20.626202 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-ac9dada2-97f7-4801-978a-4b53bcea10c8 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:58:20.626923 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-ac9dada2-97f7-4801-978a-4b53bcea10c8 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:58:20.627381 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-ac9dada2-97f7-4801-978a-4b53bcea10c8 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:58:20.627834 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-ac9dada2-97f7-4801-978a-4b53bcea10c8 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:58:20.794826 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-ac9dada2-97f7-4801-978a-4b53bcea10c8 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:58:20.803668 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-ac9dada2-97f7-4801-978a-4b53bcea10c8 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:58:20.805153 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-ac9dada2-97f7-4801-978a-4b53bcea10c8 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:58:20.806457 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-ac9dada2-97f7-4801-978a-4b53bcea10c8 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/161ef6e2-46fb-4c64-bbf0-c178886e0965" status: 200 len: 1733 microversion: 2.20 time: 0.195871 Oct 15 13:58:20.807037 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 476/973] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:58:20 2022] GET /compute/v2.1/servers/161ef6e2-46fb-4c64-bbf0-c178886e0965 => generated 1733 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 13:58:21.392011 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-7eec3bf9-db05-4d8c-9a6d-af34723cb864 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:58:21.392735 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-7eec3bf9-db05-4d8c-9a6d-af34723cb864 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] [instance: 191fca7f-a39d-4a31-9be0-b655f49aea35] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:58:21.400625 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-7eec3bf9-db05-4d8c-9a6d-af34723cb864 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:58:21.400964 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-7eec3bf9-db05-4d8c-9a6d-af34723cb864 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:58:21.401611 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-7eec3bf9-db05-4d8c-9a6d-af34723cb864 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:58:21.402545 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-7eec3bf9-db05-4d8c-9a6d-af34723cb864 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:58:21.403004 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-7eec3bf9-db05-4d8c-9a6d-af34723cb864 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:58:21.403431 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-7eec3bf9-db05-4d8c-9a6d-af34723cb864 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:58:21.432262 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-7eec3bf9-db05-4d8c-9a6d-af34723cb864 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] 10.222.0.36 "GET /compute/v2.1/servers/191fca7f-a39d-4a31-9be0-b655f49aea35/ips" status: 200 len: 146 microversion: 2.1 time: 0.044359 Oct 15 13:58:21.432862 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 498/974] 10.222.0.36 () {58 vars in 1248 bytes} [Sat Oct 15 13:58:21 2022] GET /compute/v2.1/servers/191fca7f-a39d-4a31-9be0-b655f49aea35/ips => generated 146 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 13:58:21.833073 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-0c8050fb-295f-4915-bdb5-d67781c9bc07 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:58:21.833698 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-0c8050fb-295f-4915-bdb5-d67781c9bc07 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 161ef6e2-46fb-4c64-bbf0-c178886e0965] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:58:21.841102 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-0c8050fb-295f-4915-bdb5-d67781c9bc07 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:58:21.842021 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-0c8050fb-295f-4915-bdb5-d67781c9bc07 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:58:21.842609 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-0c8050fb-295f-4915-bdb5-d67781c9bc07 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:58:21.843801 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-0c8050fb-295f-4915-bdb5-d67781c9bc07 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:58:21.845153 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-0c8050fb-295f-4915-bdb5-d67781c9bc07 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:58:21.845999 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-0c8050fb-295f-4915-bdb5-d67781c9bc07 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:58:22.011655 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-0c8050fb-295f-4915-bdb5-d67781c9bc07 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:58:22.014148 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG dbcounter [-] [125243] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=125243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:58:22.022138 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-0c8050fb-295f-4915-bdb5-d67781c9bc07 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:58:22.023583 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-0c8050fb-295f-4915-bdb5-d67781c9bc07 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:58:22.024779 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-0c8050fb-295f-4915-bdb5-d67781c9bc07 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/161ef6e2-46fb-4c64-bbf0-c178886e0965" status: 200 len: 1733 microversion: 2.20 time: 0.196115 Oct 15 13:58:22.025355 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 477/975] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:58:21 2022] GET /compute/v2.1/servers/161ef6e2-46fb-4c64-bbf0-c178886e0965 => generated 1733 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 13:58:22.812813 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-680a39d8-62fd-414d-beba-2c330898233d tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "103ba8e5-45d0-43e1-beaa-7d8b5a0e0ab9"}} {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 13:58:22.815423 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-680a39d8-62fd-414d-beba-2c330898233d tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] [instance: 191fca7f-a39d-4a31-9be0-b655f49aea35] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:58:22.822512 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-680a39d8-62fd-414d-beba-2c330898233d tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:58:22.823001 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-680a39d8-62fd-414d-beba-2c330898233d tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:58:22.823437 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-680a39d8-62fd-414d-beba-2c330898233d tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:58:22.824205 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-680a39d8-62fd-414d-beba-2c330898233d tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:58:22.824661 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-680a39d8-62fd-414d-beba-2c330898233d tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:58:22.825080 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-680a39d8-62fd-414d-beba-2c330898233d tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:58:23.051819 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-965edb6c-9e01-4274-b7c9-c554ac74b92a tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:58:23.052826 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-965edb6c-9e01-4274-b7c9-c554ac74b92a tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 161ef6e2-46fb-4c64-bbf0-c178886e0965] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:58:23.062426 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-965edb6c-9e01-4274-b7c9-c554ac74b92a tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:58:23.063439 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-965edb6c-9e01-4274-b7c9-c554ac74b92a tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:58:23.063859 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-965edb6c-9e01-4274-b7c9-c554ac74b92a tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:58:23.064626 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-965edb6c-9e01-4274-b7c9-c554ac74b92a tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:58:23.065086 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-965edb6c-9e01-4274-b7c9-c554ac74b92a tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:58:23.065478 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-965edb6c-9e01-4274-b7c9-c554ac74b92a tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:58:23.212310 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-965edb6c-9e01-4274-b7c9-c554ac74b92a tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:58:23.222524 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-965edb6c-9e01-4274-b7c9-c554ac74b92a tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:58:23.224708 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-965edb6c-9e01-4274-b7c9-c554ac74b92a tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:58:23.226332 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-965edb6c-9e01-4274-b7c9-c554ac74b92a tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/161ef6e2-46fb-4c64-bbf0-c178886e0965" status: 200 len: 1733 microversion: 2.20 time: 0.179621 Oct 15 13:58:23.237333 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 478/976] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:58:23 2022] GET /compute/v2.1/servers/161ef6e2-46fb-4c64-bbf0-c178886e0965 => generated 1733 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 13:58:24.256203 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-8b955588-018e-418a-a199-8a7bfefe70a2 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:58:24.256834 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-8b955588-018e-418a-a199-8a7bfefe70a2 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 161ef6e2-46fb-4c64-bbf0-c178886e0965] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:58:24.266378 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-8b955588-018e-418a-a199-8a7bfefe70a2 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:58:24.267026 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-8b955588-018e-418a-a199-8a7bfefe70a2 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:58:24.267463 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-8b955588-018e-418a-a199-8a7bfefe70a2 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:58:24.268186 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-8b955588-018e-418a-a199-8a7bfefe70a2 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:58:24.268673 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-8b955588-018e-418a-a199-8a7bfefe70a2 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:58:24.269087 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-8b955588-018e-418a-a199-8a7bfefe70a2 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:58:24.418234 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-8b955588-018e-418a-a199-8a7bfefe70a2 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:58:24.427975 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-8b955588-018e-418a-a199-8a7bfefe70a2 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:58:24.429738 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-8b955588-018e-418a-a199-8a7bfefe70a2 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:58:24.431268 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-8b955588-018e-418a-a199-8a7bfefe70a2 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/161ef6e2-46fb-4c64-bbf0-c178886e0965" status: 200 len: 1733 microversion: 2.20 time: 0.181787 Oct 15 13:58:24.432575 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 479/977] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:58:24 2022] GET /compute/v2.1/servers/161ef6e2-46fb-4c64-bbf0-c178886e0965 => generated 1733 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 13:58:25.458308 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-b2a0fb90-fbf0-40c3-9b6b-5a578cec76dd tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:58:25.459035 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-b2a0fb90-fbf0-40c3-9b6b-5a578cec76dd tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 161ef6e2-46fb-4c64-bbf0-c178886e0965] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:58:25.465631 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-b2a0fb90-fbf0-40c3-9b6b-5a578cec76dd tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:58:25.466113 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-b2a0fb90-fbf0-40c3-9b6b-5a578cec76dd tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:58:25.466541 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-b2a0fb90-fbf0-40c3-9b6b-5a578cec76dd tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:58:25.467230 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-b2a0fb90-fbf0-40c3-9b6b-5a578cec76dd tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:58:25.467672 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-b2a0fb90-fbf0-40c3-9b6b-5a578cec76dd tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:58:25.468118 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-b2a0fb90-fbf0-40c3-9b6b-5a578cec76dd tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:58:25.618838 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-b2a0fb90-fbf0-40c3-9b6b-5a578cec76dd tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:58:25.632213 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-b2a0fb90-fbf0-40c3-9b6b-5a578cec76dd tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:58:25.633798 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-b2a0fb90-fbf0-40c3-9b6b-5a578cec76dd tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:58:25.634989 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-b2a0fb90-fbf0-40c3-9b6b-5a578cec76dd tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/161ef6e2-46fb-4c64-bbf0-c178886e0965" status: 200 len: 1733 microversion: 2.20 time: 0.180973 Oct 15 13:58:25.635536 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 480/978] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:58:25 2022] GET /compute/v2.1/servers/161ef6e2-46fb-4c64-bbf0-c178886e0965 => generated 1733 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 13:58:26.661269 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-4262097b-bb57-47b2-ad52-f187bacf554b tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:58:26.661967 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-4262097b-bb57-47b2-ad52-f187bacf554b tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 161ef6e2-46fb-4c64-bbf0-c178886e0965] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:58:26.668909 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-4262097b-bb57-47b2-ad52-f187bacf554b tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:58:26.669402 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-4262097b-bb57-47b2-ad52-f187bacf554b tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:58:26.669841 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-4262097b-bb57-47b2-ad52-f187bacf554b tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:58:26.670546 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-4262097b-bb57-47b2-ad52-f187bacf554b tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:58:26.671002 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-4262097b-bb57-47b2-ad52-f187bacf554b tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:58:26.671499 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-4262097b-bb57-47b2-ad52-f187bacf554b tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:58:26.824889 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-4262097b-bb57-47b2-ad52-f187bacf554b tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:58:26.836492 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-4262097b-bb57-47b2-ad52-f187bacf554b tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:58:26.838571 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-4262097b-bb57-47b2-ad52-f187bacf554b tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:58:26.840813 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-4262097b-bb57-47b2-ad52-f187bacf554b tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/161ef6e2-46fb-4c64-bbf0-c178886e0965" status: 200 len: 1733 microversion: 2.20 time: 0.183351 Oct 15 13:58:26.851583 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 481/979] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:58:26 2022] GET /compute/v2.1/servers/161ef6e2-46fb-4c64-bbf0-c178886e0965 => generated 1733 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 13:58:27.871823 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-3967ab01-9393-4dd5-a04f-b0df26010700 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:58:27.871823 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-3967ab01-9393-4dd5-a04f-b0df26010700 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 161ef6e2-46fb-4c64-bbf0-c178886e0965] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:58:27.886966 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-3967ab01-9393-4dd5-a04f-b0df26010700 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:58:27.887421 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-3967ab01-9393-4dd5-a04f-b0df26010700 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:58:27.888076 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-3967ab01-9393-4dd5-a04f-b0df26010700 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:58:27.889085 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-3967ab01-9393-4dd5-a04f-b0df26010700 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:58:27.889992 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-3967ab01-9393-4dd5-a04f-b0df26010700 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:58:27.890418 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-3967ab01-9393-4dd5-a04f-b0df26010700 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:58:28.068339 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-3967ab01-9393-4dd5-a04f-b0df26010700 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:58:28.079367 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-3967ab01-9393-4dd5-a04f-b0df26010700 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:58:28.081298 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-3967ab01-9393-4dd5-a04f-b0df26010700 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:58:28.083402 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-3967ab01-9393-4dd5-a04f-b0df26010700 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/161ef6e2-46fb-4c64-bbf0-c178886e0965" status: 200 len: 1733 microversion: 2.20 time: 0.217831 Oct 15 13:58:28.084574 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 482/980] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:58:27 2022] GET /compute/v2.1/servers/161ef6e2-46fb-4c64-bbf0-c178886e0965 => generated 1733 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 13:58:29.111258 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-e8721ff0-1c8c-492f-a8de-39cb0304b512 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:58:29.112089 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-e8721ff0-1c8c-492f-a8de-39cb0304b512 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 161ef6e2-46fb-4c64-bbf0-c178886e0965] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:58:29.118819 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-e8721ff0-1c8c-492f-a8de-39cb0304b512 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:58:29.119304 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-e8721ff0-1c8c-492f-a8de-39cb0304b512 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:58:29.119733 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-e8721ff0-1c8c-492f-a8de-39cb0304b512 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:58:29.120452 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-e8721ff0-1c8c-492f-a8de-39cb0304b512 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:58:29.120895 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-e8721ff0-1c8c-492f-a8de-39cb0304b512 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:58:29.121309 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-e8721ff0-1c8c-492f-a8de-39cb0304b512 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:58:29.279481 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-e8721ff0-1c8c-492f-a8de-39cb0304b512 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:58:29.292609 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-e8721ff0-1c8c-492f-a8de-39cb0304b512 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:58:29.294609 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-e8721ff0-1c8c-492f-a8de-39cb0304b512 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:58:29.296378 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-e8721ff0-1c8c-492f-a8de-39cb0304b512 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/161ef6e2-46fb-4c64-bbf0-c178886e0965" status: 200 len: 1733 microversion: 2.20 time: 0.189713 Oct 15 13:58:29.297101 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 483/981] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:58:29 2022] GET /compute/v2.1/servers/161ef6e2-46fb-4c64-bbf0-c178886e0965 => generated 1733 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 15 13:58:30.323398 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-5fa541b4-1968-4df8-abaa-e94b2dc762b2 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:58:30.324157 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-5fa541b4-1968-4df8-abaa-e94b2dc762b2 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 161ef6e2-46fb-4c64-bbf0-c178886e0965] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:58:30.333650 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-5fa541b4-1968-4df8-abaa-e94b2dc762b2 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:58:30.334352 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-5fa541b4-1968-4df8-abaa-e94b2dc762b2 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:58:30.335008 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-5fa541b4-1968-4df8-abaa-e94b2dc762b2 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:58:30.335839 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-5fa541b4-1968-4df8-abaa-e94b2dc762b2 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:58:30.336504 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-5fa541b4-1968-4df8-abaa-e94b2dc762b2 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:58:30.337133 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-5fa541b4-1968-4df8-abaa-e94b2dc762b2 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:58:30.491801 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-5fa541b4-1968-4df8-abaa-e94b2dc762b2 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:58:30.500449 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-5fa541b4-1968-4df8-abaa-e94b2dc762b2 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:58:30.501909 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-5fa541b4-1968-4df8-abaa-e94b2dc762b2 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:58:30.503078 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-5fa541b4-1968-4df8-abaa-e94b2dc762b2 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/161ef6e2-46fb-4c64-bbf0-c178886e0965" status: 200 len: 1733 microversion: 2.20 time: 0.184454 Oct 15 13:58:30.503646 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 484/982] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:58:30 2022] GET /compute/v2.1/servers/161ef6e2-46fb-4c64-bbf0-c178886e0965 => generated 1733 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 13:58:31.536174 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-4c27e031-4585-4290-b881-af44f25caaa8 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:58:31.536914 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-4c27e031-4585-4290-b881-af44f25caaa8 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 161ef6e2-46fb-4c64-bbf0-c178886e0965] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:58:31.539148 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG dbcounter [-] [125243] Writing DB stats nova_api:SELECT=38 {{(pid=125243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:58:31.544824 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-4c27e031-4585-4290-b881-af44f25caaa8 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:58:31.545317 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-4c27e031-4585-4290-b881-af44f25caaa8 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:58:31.545753 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-4c27e031-4585-4290-b881-af44f25caaa8 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:58:31.546472 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-4c27e031-4585-4290-b881-af44f25caaa8 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:58:31.546926 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-4c27e031-4585-4290-b881-af44f25caaa8 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:58:31.547350 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-4c27e031-4585-4290-b881-af44f25caaa8 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:58:31.698286 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-4c27e031-4585-4290-b881-af44f25caaa8 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:58:31.707118 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-4c27e031-4585-4290-b881-af44f25caaa8 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:58:31.708619 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-4c27e031-4585-4290-b881-af44f25caaa8 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:58:31.709784 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-4c27e031-4585-4290-b881-af44f25caaa8 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/161ef6e2-46fb-4c64-bbf0-c178886e0965" status: 200 len: 1733 microversion: 2.20 time: 0.177708 Oct 15 13:58:31.711015 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 485/983] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:58:31 2022] GET /compute/v2.1/servers/161ef6e2-46fb-4c64-bbf0-c178886e0965 => generated 1733 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 13:58:32.737641 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-8ca8ffad-f9cc-4a5a-b0e1-c023ba12e847 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:58:32.738374 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-8ca8ffad-f9cc-4a5a-b0e1-c023ba12e847 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 161ef6e2-46fb-4c64-bbf0-c178886e0965] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:58:32.747649 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-8ca8ffad-f9cc-4a5a-b0e1-c023ba12e847 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:58:32.748174 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-8ca8ffad-f9cc-4a5a-b0e1-c023ba12e847 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:58:32.748635 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-8ca8ffad-f9cc-4a5a-b0e1-c023ba12e847 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:58:32.749344 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-8ca8ffad-f9cc-4a5a-b0e1-c023ba12e847 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:58:32.749841 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-8ca8ffad-f9cc-4a5a-b0e1-c023ba12e847 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:58:32.750262 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-8ca8ffad-f9cc-4a5a-b0e1-c023ba12e847 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:58:32.819896 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG dbcounter [-] [125242] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=1 {{(pid=125242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:58:32.914678 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG dbcounter [-] [125242] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:58:33.072298 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-8ca8ffad-f9cc-4a5a-b0e1-c023ba12e847 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:58:33.083673 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-8ca8ffad-f9cc-4a5a-b0e1-c023ba12e847 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:58:33.085920 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-8ca8ffad-f9cc-4a5a-b0e1-c023ba12e847 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:58:33.087308 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-8ca8ffad-f9cc-4a5a-b0e1-c023ba12e847 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/161ef6e2-46fb-4c64-bbf0-c178886e0965" status: 200 len: 1733 microversion: 2.20 time: 0.356125 Oct 15 13:58:33.087887 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 486/984] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:58:32 2022] GET /compute/v2.1/servers/161ef6e2-46fb-4c64-bbf0-c178886e0965 => generated 1733 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 13:58:34.120610 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-0bbef8e5-66ee-4abe-98f8-ffeba11d7cda tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:58:34.121723 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-0bbef8e5-66ee-4abe-98f8-ffeba11d7cda tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 161ef6e2-46fb-4c64-bbf0-c178886e0965] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:58:34.131111 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-0bbef8e5-66ee-4abe-98f8-ffeba11d7cda tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:58:34.131605 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-0bbef8e5-66ee-4abe-98f8-ffeba11d7cda tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:58:34.132056 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-0bbef8e5-66ee-4abe-98f8-ffeba11d7cda tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:58:34.132794 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-0bbef8e5-66ee-4abe-98f8-ffeba11d7cda tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:58:34.133245 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-0bbef8e5-66ee-4abe-98f8-ffeba11d7cda tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:58:34.133672 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-0bbef8e5-66ee-4abe-98f8-ffeba11d7cda tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:58:34.300789 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-0bbef8e5-66ee-4abe-98f8-ffeba11d7cda tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:58:34.314544 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-0bbef8e5-66ee-4abe-98f8-ffeba11d7cda tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:58:34.316954 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-0bbef8e5-66ee-4abe-98f8-ffeba11d7cda tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:58:34.319329 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-0bbef8e5-66ee-4abe-98f8-ffeba11d7cda tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/161ef6e2-46fb-4c64-bbf0-c178886e0965" status: 200 len: 1733 microversion: 2.20 time: 0.203677 Oct 15 13:58:34.320391 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 487/985] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:58:34 2022] GET /compute/v2.1/servers/161ef6e2-46fb-4c64-bbf0-c178886e0965 => generated 1733 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 13:58:35.194747 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-680a39d8-62fd-414d-beba-2c330898233d tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] 10.222.0.36 "POST /compute/v2.1/servers/191fca7f-a39d-4a31-9be0-b655f49aea35/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 12.385980 Oct 15 13:58:35.199000 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 499/986] 10.222.0.36 () {60 vars in 1323 bytes} [Sat Oct 15 13:58:22 2022] POST /compute/v2.1/servers/191fca7f-a39d-4a31-9be0-b655f49aea35/os-volume_attachments => generated 194 bytes in 12388 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 15 13:58:35.351169 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-0d83f13a-d6e8-4c92-b08b-88b9bc84ad00 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:58:35.352011 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-0d83f13a-d6e8-4c92-b08b-88b9bc84ad00 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 161ef6e2-46fb-4c64-bbf0-c178886e0965] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:58:35.361016 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-0d83f13a-d6e8-4c92-b08b-88b9bc84ad00 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:58:35.361531 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-0d83f13a-d6e8-4c92-b08b-88b9bc84ad00 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:58:35.361933 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-0d83f13a-d6e8-4c92-b08b-88b9bc84ad00 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:58:35.362875 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-0d83f13a-d6e8-4c92-b08b-88b9bc84ad00 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:58:35.363297 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-0d83f13a-d6e8-4c92-b08b-88b9bc84ad00 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:58:35.363720 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-0d83f13a-d6e8-4c92-b08b-88b9bc84ad00 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:58:35.526376 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-0d83f13a-d6e8-4c92-b08b-88b9bc84ad00 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:58:35.534738 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-0d83f13a-d6e8-4c92-b08b-88b9bc84ad00 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:58:35.536214 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-0d83f13a-d6e8-4c92-b08b-88b9bc84ad00 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:58:35.537377 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-0d83f13a-d6e8-4c92-b08b-88b9bc84ad00 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/161ef6e2-46fb-4c64-bbf0-c178886e0965" status: 200 len: 1733 microversion: 2.20 time: 0.193324 Oct 15 13:58:35.537954 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 488/987] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:58:35 2022] GET /compute/v2.1/servers/161ef6e2-46fb-4c64-bbf0-c178886e0965 => generated 1733 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 13:58:36.564438 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-d7141867-bff1-42d8-9127-674928e1b17a tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:58:36.565152 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-d7141867-bff1-42d8-9127-674928e1b17a tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 161ef6e2-46fb-4c64-bbf0-c178886e0965] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:58:36.572186 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-d7141867-bff1-42d8-9127-674928e1b17a tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:58:36.572768 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-d7141867-bff1-42d8-9127-674928e1b17a tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:58:36.573245 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-d7141867-bff1-42d8-9127-674928e1b17a tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:58:36.574229 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-d7141867-bff1-42d8-9127-674928e1b17a tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:58:36.574704 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-d7141867-bff1-42d8-9127-674928e1b17a tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:58:36.575192 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-d7141867-bff1-42d8-9127-674928e1b17a tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:58:36.722123 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-d7141867-bff1-42d8-9127-674928e1b17a tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:58:36.735162 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-d7141867-bff1-42d8-9127-674928e1b17a tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:58:36.737058 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-d7141867-bff1-42d8-9127-674928e1b17a tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:58:36.738136 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-d7141867-bff1-42d8-9127-674928e1b17a tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/161ef6e2-46fb-4c64-bbf0-c178886e0965" status: 200 len: 1733 microversion: 2.20 time: 0.178803 Oct 15 13:58:36.738742 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 500/988] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:58:36 2022] GET /compute/v2.1/servers/161ef6e2-46fb-4c64-bbf0-c178886e0965 => generated 1733 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 13:58:37.765173 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-2d6c8628-d42a-4c1b-ba44-17815a185ca0 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:58:37.765861 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-2d6c8628-d42a-4c1b-ba44-17815a185ca0 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 161ef6e2-46fb-4c64-bbf0-c178886e0965] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:58:37.773931 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-2d6c8628-d42a-4c1b-ba44-17815a185ca0 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:58:37.774424 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-2d6c8628-d42a-4c1b-ba44-17815a185ca0 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:58:37.774868 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-2d6c8628-d42a-4c1b-ba44-17815a185ca0 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:58:37.775570 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-2d6c8628-d42a-4c1b-ba44-17815a185ca0 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:58:37.776061 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-2d6c8628-d42a-4c1b-ba44-17815a185ca0 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:58:37.776495 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-2d6c8628-d42a-4c1b-ba44-17815a185ca0 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:58:37.920607 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-2d6c8628-d42a-4c1b-ba44-17815a185ca0 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:58:37.929503 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-2d6c8628-d42a-4c1b-ba44-17815a185ca0 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:58:37.930989 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-2d6c8628-d42a-4c1b-ba44-17815a185ca0 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:58:37.932239 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-2d6c8628-d42a-4c1b-ba44-17815a185ca0 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/161ef6e2-46fb-4c64-bbf0-c178886e0965" status: 200 len: 1733 microversion: 2.20 time: 0.172686 Oct 15 13:58:37.932813 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 489/989] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:58:37 2022] GET /compute/v2.1/servers/161ef6e2-46fb-4c64-bbf0-c178886e0965 => generated 1733 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 13:58:38.122625 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [req-bdf16e34-e5ae-4105-ab72-47baacac93bc req-ae5da5a8-fb5a-4bb5-9e45-54475773c031 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "161ef6e2-46fb-4c64-bbf0-c178886e0965", "name": "network-vif-plugged", "status": "completed", "tag": "b7f79f6d-d3ad-4794-bbcd-8936f95ed2b8"}]} {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 13:58:38.134241 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [req-bdf16e34-e5ae-4105-ab72-47baacac93bc req-ae5da5a8-fb5a-4bb5-9e45-54475773c031 service nova] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:58:38.134797 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [req-bdf16e34-e5ae-4105-ab72-47baacac93bc req-ae5da5a8-fb5a-4bb5-9e45-54475773c031 service nova] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:58:38.135227 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [req-bdf16e34-e5ae-4105-ab72-47baacac93bc req-ae5da5a8-fb5a-4bb5-9e45-54475773c031 service nova] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:58:38.147350 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.compute.server_external_events [req-bdf16e34-e5ae-4105-ab72-47baacac93bc req-ae5da5a8-fb5a-4bb5-9e45-54475773c031 service nova] Creating event network-vif-plugged:b7f79f6d-d3ad-4794-bbcd-8936f95ed2b8 for instance 161ef6e2-46fb-4c64-bbf0-c178886e0965 on hv-cinder-86149 Oct 15 13:58:38.152684 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [req-bdf16e34-e5ae-4105-ab72-47baacac93bc req-ae5da5a8-fb5a-4bb5-9e45-54475773c031 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034364 Oct 15 13:58:38.153333 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 501/990] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 15 13:58:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 13:58:38.958409 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-e8828b0a-af54-4ea0-9d93-d30aaadb448f tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:58:38.959082 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-e8828b0a-af54-4ea0-9d93-d30aaadb448f tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 161ef6e2-46fb-4c64-bbf0-c178886e0965] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:58:38.965927 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-e8828b0a-af54-4ea0-9d93-d30aaadb448f tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:58:38.966441 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-e8828b0a-af54-4ea0-9d93-d30aaadb448f tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:58:38.966878 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-e8828b0a-af54-4ea0-9d93-d30aaadb448f tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:58:38.967596 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-e8828b0a-af54-4ea0-9d93-d30aaadb448f tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:58:38.968068 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-e8828b0a-af54-4ea0-9d93-d30aaadb448f tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:58:38.968495 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-e8828b0a-af54-4ea0-9d93-d30aaadb448f tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:58:39.229897 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-e8828b0a-af54-4ea0-9d93-d30aaadb448f tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:58:39.240032 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-e8828b0a-af54-4ea0-9d93-d30aaadb448f tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:58:39.241455 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-e8828b0a-af54-4ea0-9d93-d30aaadb448f tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:58:39.242762 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-e8828b0a-af54-4ea0-9d93-d30aaadb448f tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/161ef6e2-46fb-4c64-bbf0-c178886e0965" status: 200 len: 1733 microversion: 2.20 time: 0.288771 Oct 15 13:58:39.243335 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 490/991] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:58:38 2022] GET /compute/v2.1/servers/161ef6e2-46fb-4c64-bbf0-c178886e0965 => generated 1733 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 13:58:39.561913 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-e61aded1-f35d-4e7e-80a6-b146ae213cb6 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:58:39.562715 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-e61aded1-f35d-4e7e-80a6-b146ae213cb6 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] [instance: 1413aaed-46c7-4807-9d3b-957616dd4047] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:58:39.564064 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [req-01fb8665-f250-4138-bf91-cddd57471415 req-14c223f6-fa42-405c-aa90-cd4bc6238a19 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1413aaed-46c7-4807-9d3b-957616dd4047", "tag": "4b0e8bf4-1aae-4e0a-be03-f2d19fe48439"}]} {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 13:58:39.571061 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-e61aded1-f35d-4e7e-80a6-b146ae213cb6 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:58:39.571660 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-e61aded1-f35d-4e7e-80a6-b146ae213cb6 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:58:39.572353 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-e61aded1-f35d-4e7e-80a6-b146ae213cb6 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:58:39.573287 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-e61aded1-f35d-4e7e-80a6-b146ae213cb6 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:58:39.573950 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-e61aded1-f35d-4e7e-80a6-b146ae213cb6 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:58:39.574222 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [req-01fb8665-f250-4138-bf91-cddd57471415 req-14c223f6-fa42-405c-aa90-cd4bc6238a19 service nova] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:58:39.574497 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-e61aded1-f35d-4e7e-80a6-b146ae213cb6 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:58:39.574725 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [req-01fb8665-f250-4138-bf91-cddd57471415 req-14c223f6-fa42-405c-aa90-cd4bc6238a19 service nova] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:58:39.575142 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [req-01fb8665-f250-4138-bf91-cddd57471415 req-14c223f6-fa42-405c-aa90-cd4bc6238a19 service nova] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:58:39.586645 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.compute.server_external_events [req-01fb8665-f250-4138-bf91-cddd57471415 req-14c223f6-fa42-405c-aa90-cd4bc6238a19 service nova] Creating event network-changed:4b0e8bf4-1aae-4e0a-be03-f2d19fe48439 for instance 1413aaed-46c7-4807-9d3b-957616dd4047 on hv-cinder-86149 Oct 15 13:58:39.592222 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [req-01fb8665-f250-4138-bf91-cddd57471415 req-14c223f6-fa42-405c-aa90-cd4bc6238a19 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032667 Oct 15 13:58:39.592834 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 491/992] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 15 13:58:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 13:58:39.607321 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-e61aded1-f35d-4e7e-80a6-b146ae213cb6 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] [instance: 1413aaed-46c7-4807-9d3b-957616dd4047] Going to try to terminate instance {{(pid=125242) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 15 13:58:39.694881 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-e61aded1-f35d-4e7e-80a6-b146ae213cb6 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] 10.222.0.36 "DELETE /compute/v2.1/servers/1413aaed-46c7-4807-9d3b-957616dd4047" status: 204 len: 0 microversion: 2.1 time: 0.137265 Oct 15 13:58:39.695547 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 502/993] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 15 13:58:39 2022] DELETE /compute/v2.1/servers/1413aaed-46c7-4807-9d3b-957616dd4047 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 15 13:58:39.704797 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-5d9da562-31ba-40c1-a8de-f857a55fd0a3 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:58:39.705602 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-5d9da562-31ba-40c1-a8de-f857a55fd0a3 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] [instance: 1413aaed-46c7-4807-9d3b-957616dd4047] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:58:39.712209 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-5d9da562-31ba-40c1-a8de-f857a55fd0a3 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:58:39.712704 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-5d9da562-31ba-40c1-a8de-f857a55fd0a3 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:58:39.713143 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-5d9da562-31ba-40c1-a8de-f857a55fd0a3 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:58:39.713849 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-5d9da562-31ba-40c1-a8de-f857a55fd0a3 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:58:39.714300 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-5d9da562-31ba-40c1-a8de-f857a55fd0a3 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:58:39.714724 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-5d9da562-31ba-40c1-a8de-f857a55fd0a3 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:58:39.861259 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-5d9da562-31ba-40c1-a8de-f857a55fd0a3 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e530c3f544748bd3ffc256b1630b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a6be8e43c7742be84f4dc3c95a990e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:58:39.869327 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-5d9da562-31ba-40c1-a8de-f857a55fd0a3 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] 10.222.0.36 "GET /compute/v2.1/servers/1413aaed-46c7-4807-9d3b-957616dd4047" status: 200 len: 1568 microversion: 2.1 time: 0.168990 Oct 15 13:58:39.884036 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 492/994] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:58:39 2022] GET /compute/v2.1/servers/1413aaed-46c7-4807-9d3b-957616dd4047 => generated 1568 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:58:40.269949 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-cb09b4a0-64c6-4a36-ae0b-77d581e21b18 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:58:40.270656 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-cb09b4a0-64c6-4a36-ae0b-77d581e21b18 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 161ef6e2-46fb-4c64-bbf0-c178886e0965] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:58:40.277788 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-cb09b4a0-64c6-4a36-ae0b-77d581e21b18 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:58:40.278273 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-cb09b4a0-64c6-4a36-ae0b-77d581e21b18 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:58:40.278710 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-cb09b4a0-64c6-4a36-ae0b-77d581e21b18 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:58:40.279430 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-cb09b4a0-64c6-4a36-ae0b-77d581e21b18 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:58:40.279900 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-cb09b4a0-64c6-4a36-ae0b-77d581e21b18 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:58:40.280340 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-cb09b4a0-64c6-4a36-ae0b-77d581e21b18 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:58:40.443117 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-cb09b4a0-64c6-4a36-ae0b-77d581e21b18 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:58:40.451703 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-cb09b4a0-64c6-4a36-ae0b-77d581e21b18 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:58:40.453212 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-cb09b4a0-64c6-4a36-ae0b-77d581e21b18 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:58:40.454955 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-cb09b4a0-64c6-4a36-ae0b-77d581e21b18 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/161ef6e2-46fb-4c64-bbf0-c178886e0965" status: 200 len: 1733 microversion: 2.20 time: 0.189395 Oct 15 13:58:40.455967 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 503/995] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:58:40 2022] GET /compute/v2.1/servers/161ef6e2-46fb-4c64-bbf0-c178886e0965 => generated 1733 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 13:58:40.895544 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-fe7b32fc-5db3-45e1-bbaa-0d16d976dcb8 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:58:40.896193 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-fe7b32fc-5db3-45e1-bbaa-0d16d976dcb8 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] [instance: 1413aaed-46c7-4807-9d3b-957616dd4047] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:58:40.903144 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-fe7b32fc-5db3-45e1-bbaa-0d16d976dcb8 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:58:40.903633 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-fe7b32fc-5db3-45e1-bbaa-0d16d976dcb8 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:58:40.904113 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-fe7b32fc-5db3-45e1-bbaa-0d16d976dcb8 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:58:40.904812 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-fe7b32fc-5db3-45e1-bbaa-0d16d976dcb8 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:58:40.905290 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-fe7b32fc-5db3-45e1-bbaa-0d16d976dcb8 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:58:40.905788 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-fe7b32fc-5db3-45e1-bbaa-0d16d976dcb8 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:58:41.054750 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-fe7b32fc-5db3-45e1-bbaa-0d16d976dcb8 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e530c3f544748bd3ffc256b1630b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a6be8e43c7742be84f4dc3c95a990e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:58:41.062800 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-fe7b32fc-5db3-45e1-bbaa-0d16d976dcb8 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] 10.222.0.36 "GET /compute/v2.1/servers/1413aaed-46c7-4807-9d3b-957616dd4047" status: 200 len: 1568 microversion: 2.1 time: 0.171587 Oct 15 13:58:41.063746 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 493/996] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:58:40 2022] GET /compute/v2.1/servers/1413aaed-46c7-4807-9d3b-957616dd4047 => generated 1568 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:58:41.483672 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-fba49564-8dd7-4266-903c-e2508260f7cd tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:58:41.484344 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-fba49564-8dd7-4266-903c-e2508260f7cd tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 161ef6e2-46fb-4c64-bbf0-c178886e0965] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:58:41.491728 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-fba49564-8dd7-4266-903c-e2508260f7cd tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:58:41.492665 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-fba49564-8dd7-4266-903c-e2508260f7cd tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:58:41.493223 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-fba49564-8dd7-4266-903c-e2508260f7cd tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:58:41.494645 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-fba49564-8dd7-4266-903c-e2508260f7cd tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:58:41.494767 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-43fd92f2-7cd8-4371-8862-e03d5ad208ef tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:58:41.494859 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-fba49564-8dd7-4266-903c-e2508260f7cd tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:58:41.494938 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-43fd92f2-7cd8-4371-8862-e03d5ad208ef tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] [instance: 00959d34-6e9e-4c3d-a32b-1dfc66397406] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:58:41.495025 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-fba49564-8dd7-4266-903c-e2508260f7cd tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:58:41.501427 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-43fd92f2-7cd8-4371-8862-e03d5ad208ef tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:58:41.501930 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-43fd92f2-7cd8-4371-8862-e03d5ad208ef tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:58:41.502343 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-43fd92f2-7cd8-4371-8862-e03d5ad208ef tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:58:41.503033 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-43fd92f2-7cd8-4371-8862-e03d5ad208ef tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:58:41.503746 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-43fd92f2-7cd8-4371-8862-e03d5ad208ef tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:58:41.504191 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-43fd92f2-7cd8-4371-8862-e03d5ad208ef tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:58:41.532690 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-43fd92f2-7cd8-4371-8862-e03d5ad208ef tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] 10.222.0.36 "GET /compute/v2.1/servers/00959d34-6e9e-4c3d-a32b-1dfc66397406/ips" status: 200 len: 150 microversion: 2.1 time: 0.042567 Oct 15 13:58:41.533867 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 494/997] 10.222.0.36 () {58 vars in 1248 bytes} [Sat Oct 15 13:58:41 2022] GET /compute/v2.1/servers/00959d34-6e9e-4c3d-a32b-1dfc66397406/ips => generated 150 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 13:58:41.653372 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-fba49564-8dd7-4266-903c-e2508260f7cd tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:58:41.653372 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-fba49564-8dd7-4266-903c-e2508260f7cd tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:58:41.654108 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-fba49564-8dd7-4266-903c-e2508260f7cd tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:58:41.655287 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-fba49564-8dd7-4266-903c-e2508260f7cd tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/161ef6e2-46fb-4c64-bbf0-c178886e0965" status: 200 len: 1733 microversion: 2.20 time: 0.176423 Oct 15 13:58:41.655860 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 504/998] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:58:41 2022] GET /compute/v2.1/servers/161ef6e2-46fb-4c64-bbf0-c178886e0965 => generated 1733 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 13:58:42.089224 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-5bfce5cf-d708-439c-ab4a-eb522eda197d tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:58:42.089811 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-5bfce5cf-d708-439c-ab4a-eb522eda197d tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] [instance: 1413aaed-46c7-4807-9d3b-957616dd4047] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:58:42.097224 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-5bfce5cf-d708-439c-ab4a-eb522eda197d tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:58:42.097850 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-5bfce5cf-d708-439c-ab4a-eb522eda197d tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:58:42.098294 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-5bfce5cf-d708-439c-ab4a-eb522eda197d tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:58:42.099338 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-5bfce5cf-d708-439c-ab4a-eb522eda197d tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:58:42.100070 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-5bfce5cf-d708-439c-ab4a-eb522eda197d tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:58:42.100614 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-5bfce5cf-d708-439c-ab4a-eb522eda197d tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:58:42.119069 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG dbcounter [-] [125243] Writing DB stats nova_cell1:SELECT=100 {{(pid=125243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:58:42.245011 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-5bfce5cf-d708-439c-ab4a-eb522eda197d tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e530c3f544748bd3ffc256b1630b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a6be8e43c7742be84f4dc3c95a990e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:58:42.252845 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-5bfce5cf-d708-439c-ab4a-eb522eda197d tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] 10.222.0.36 "GET /compute/v2.1/servers/1413aaed-46c7-4807-9d3b-957616dd4047" status: 200 len: 1568 microversion: 2.1 time: 0.169395 Oct 15 13:58:42.253393 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 495/999] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:58:42 2022] GET /compute/v2.1/servers/1413aaed-46c7-4807-9d3b-957616dd4047 => generated 1568 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:58:42.695536 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-d8c246f8-f61d-4546-af38-2edde1ba06f1 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:58:42.696644 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-d8c246f8-f61d-4546-af38-2edde1ba06f1 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 161ef6e2-46fb-4c64-bbf0-c178886e0965] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:58:42.713948 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-d8c246f8-f61d-4546-af38-2edde1ba06f1 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:58:42.714788 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-d8c246f8-f61d-4546-af38-2edde1ba06f1 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:58:42.715558 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-d8c246f8-f61d-4546-af38-2edde1ba06f1 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:58:42.716820 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-d8c246f8-f61d-4546-af38-2edde1ba06f1 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:58:42.717704 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-d8c246f8-f61d-4546-af38-2edde1ba06f1 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:58:42.718440 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-d8c246f8-f61d-4546-af38-2edde1ba06f1 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:58:42.822608 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-db09d741-8aa7-4544-819a-c2f816fc9b4c tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:58:42.824930 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-db09d741-8aa7-4544-819a-c2f816fc9b4c tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] [instance: 191fca7f-a39d-4a31-9be0-b655f49aea35] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:58:42.831365 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-db09d741-8aa7-4544-819a-c2f816fc9b4c tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:58:42.832194 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-db09d741-8aa7-4544-819a-c2f816fc9b4c tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:58:42.832809 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-db09d741-8aa7-4544-819a-c2f816fc9b4c tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:58:42.833726 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-db09d741-8aa7-4544-819a-c2f816fc9b4c tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:58:42.834177 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-db09d741-8aa7-4544-819a-c2f816fc9b4c tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:58:42.834626 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-db09d741-8aa7-4544-819a-c2f816fc9b4c tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:58:42.871698 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-db09d741-8aa7-4544-819a-c2f816fc9b4c tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] 10.222.0.36 "GET /compute/v2.1/servers/191fca7f-a39d-4a31-9be0-b655f49aea35/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052625 Oct 15 13:58:42.873639 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 496/1000] 10.222.0.36 () {58 vars in 1302 bytes} [Sat Oct 15 13:58:42 2022] GET /compute/v2.1/servers/191fca7f-a39d-4a31-9be0-b655f49aea35/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 15 13:58:42.889093 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-d6d71085-dd06-459a-b4c2-7337ad3f77f7 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:58:42.889832 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-d6d71085-dd06-459a-b4c2-7337ad3f77f7 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] [instance: 191fca7f-a39d-4a31-9be0-b655f49aea35] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:58:42.897511 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-d6d71085-dd06-459a-b4c2-7337ad3f77f7 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:58:42.898076 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-d6d71085-dd06-459a-b4c2-7337ad3f77f7 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:58:42.898573 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-d6d71085-dd06-459a-b4c2-7337ad3f77f7 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:58:42.899344 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-d6d71085-dd06-459a-b4c2-7337ad3f77f7 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:58:42.899922 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-d6d71085-dd06-459a-b4c2-7337ad3f77f7 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:58:42.900521 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-d6d71085-dd06-459a-b4c2-7337ad3f77f7 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:58:42.936526 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-d6d71085-dd06-459a-b4c2-7337ad3f77f7 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] 10.222.0.36 "GET /compute/v2.1/servers/191fca7f-a39d-4a31-9be0-b655f49aea35/os-volume_attachments/103ba8e5-45d0-43e1-beaa-7d8b5a0e0ab9" status: 200 len: 194 microversion: 2.1 time: 0.054187 Oct 15 13:58:42.937411 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 497/1001] 10.222.0.36 () {58 vars in 1413 bytes} [Sat Oct 15 13:58:42 2022] GET /compute/v2.1/servers/191fca7f-a39d-4a31-9be0-b655f49aea35/os-volume_attachments/103ba8e5-45d0-43e1-beaa-7d8b5a0e0ab9 => generated 194 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 13:58:42.942313 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-7da25403-e42b-441b-9e5c-2657ada787a5 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3f610ed0-3c89-42cd-b494-e8c57fb46ede"}} {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 13:58:42.946140 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-7da25403-e42b-441b-9e5c-2657ada787a5 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] [instance: 00959d34-6e9e-4c3d-a32b-1dfc66397406] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:58:42.952209 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-7da25403-e42b-441b-9e5c-2657ada787a5 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:58:42.952696 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-7da25403-e42b-441b-9e5c-2657ada787a5 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:58:42.953299 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-7da25403-e42b-441b-9e5c-2657ada787a5 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:58:42.954052 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-7da25403-e42b-441b-9e5c-2657ada787a5 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:58:42.954446 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-7da25403-e42b-441b-9e5c-2657ada787a5 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:58:42.955252 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-7da25403-e42b-441b-9e5c-2657ada787a5 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:58:43.024004 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-d8c246f8-f61d-4546-af38-2edde1ba06f1 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:58:43.038656 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-d8c246f8-f61d-4546-af38-2edde1ba06f1 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:58:43.040459 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-d8c246f8-f61d-4546-af38-2edde1ba06f1 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:58:43.042972 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-d8c246f8-f61d-4546-af38-2edde1ba06f1 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/161ef6e2-46fb-4c64-bbf0-c178886e0965" status: 200 len: 1720 microversion: 2.20 time: 0.365891 Oct 15 13:58:43.043868 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 505/1002] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:58:42 2022] GET /compute/v2.1/servers/161ef6e2-46fb-4c64-bbf0-c178886e0965 => generated 1720 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 13:58:43.280087 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-d76a9fa0-f4e8-42a1-92b6-32d3e1f6daf1 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:58:43.280087 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-d76a9fa0-f4e8-42a1-92b6-32d3e1f6daf1 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] [instance: 1413aaed-46c7-4807-9d3b-957616dd4047] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:58:43.291337 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-d76a9fa0-f4e8-42a1-92b6-32d3e1f6daf1 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:58:43.291927 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-d76a9fa0-f4e8-42a1-92b6-32d3e1f6daf1 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:58:43.292374 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-d76a9fa0-f4e8-42a1-92b6-32d3e1f6daf1 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:58:43.293105 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-d76a9fa0-f4e8-42a1-92b6-32d3e1f6daf1 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:58:43.293605 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-d76a9fa0-f4e8-42a1-92b6-32d3e1f6daf1 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:58:43.296602 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-d76a9fa0-f4e8-42a1-92b6-32d3e1f6daf1 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:58:43.297284 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-7da25403-e42b-441b-9e5c-2657ada787a5 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] 10.222.0.36 "POST /compute/v2.1/servers/00959d34-6e9e-4c3d-a32b-1dfc66397406/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.358757 Oct 15 13:58:43.313599 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 498/1003] 10.222.0.36 () {60 vars in 1323 bytes} [Sat Oct 15 13:58:42 2022] POST /compute/v2.1/servers/00959d34-6e9e-4c3d-a32b-1dfc66397406/os-volume_attachments => generated 194 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 13:58:43.324752 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [req-647fea55-6b6d-46d5-8edf-e5af64676b06 req-6e5ed3a2-4074-4845-8d7d-2c82a0021b62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1413aaed-46c7-4807-9d3b-957616dd4047", "name": "network-vif-deleted", "tag": "4b0e8bf4-1aae-4e0a-be03-f2d19fe48439"}]} {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 13:58:43.341926 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [req-647fea55-6b6d-46d5-8edf-e5af64676b06 req-6e5ed3a2-4074-4845-8d7d-2c82a0021b62 service nova] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:58:43.342416 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [req-647fea55-6b6d-46d5-8edf-e5af64676b06 req-6e5ed3a2-4074-4845-8d7d-2c82a0021b62 service nova] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:58:43.343939 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [req-647fea55-6b6d-46d5-8edf-e5af64676b06 req-6e5ed3a2-4074-4845-8d7d-2c82a0021b62 service nova] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:58:43.358868 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.compute.server_external_events [req-647fea55-6b6d-46d5-8edf-e5af64676b06 req-6e5ed3a2-4074-4845-8d7d-2c82a0021b62 service nova] Creating event network-vif-deleted:4b0e8bf4-1aae-4e0a-be03-f2d19fe48439 for instance 1413aaed-46c7-4807-9d3b-957616dd4047 on hv-cinder-86149 Oct 15 13:58:43.365419 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [req-647fea55-6b6d-46d5-8edf-e5af64676b06 req-6e5ed3a2-4074-4845-8d7d-2c82a0021b62 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049645 Oct 15 13:58:43.366289 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 499/1004] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 15 13:58:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 13:58:43.406450 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-d76a9fa0-f4e8-42a1-92b6-32d3e1f6daf1 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e530c3f544748bd3ffc256b1630b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a6be8e43c7742be84f4dc3c95a990e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:58:43.417195 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-d76a9fa0-f4e8-42a1-92b6-32d3e1f6daf1 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] 10.222.0.36 "GET /compute/v2.1/servers/1413aaed-46c7-4807-9d3b-957616dd4047" status: 200 len: 1383 microversion: 2.1 time: 0.144224 Oct 15 13:58:43.417795 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 506/1005] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:58:43 2022] GET /compute/v2.1/servers/1413aaed-46c7-4807-9d3b-957616dd4047 => generated 1383 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 13:58:44.370990 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-8b22d0f6-681e-4795-ac32-ef27888b4f96 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ceb8a09d-b672-4452-b4c4-5465e7a8da07"}} {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 13:58:44.372542 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-8b22d0f6-681e-4795-ac32-ef27888b4f96 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] [instance: 191fca7f-a39d-4a31-9be0-b655f49aea35] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:58:44.381591 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-8b22d0f6-681e-4795-ac32-ef27888b4f96 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:58:44.382559 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-8b22d0f6-681e-4795-ac32-ef27888b4f96 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:58:44.383201 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-8b22d0f6-681e-4795-ac32-ef27888b4f96 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:58:44.384677 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-8b22d0f6-681e-4795-ac32-ef27888b4f96 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:58:44.385208 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-8b22d0f6-681e-4795-ac32-ef27888b4f96 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:58:44.385705 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-8b22d0f6-681e-4795-ac32-ef27888b4f96 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:58:44.441044 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-89647abd-604f-4e87-92c7-f3cfdf59c1ec tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:58:44.441641 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-89647abd-604f-4e87-92c7-f3cfdf59c1ec tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] [instance: 1413aaed-46c7-4807-9d3b-957616dd4047] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:58:44.449095 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-89647abd-604f-4e87-92c7-f3cfdf59c1ec tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:58:44.449682 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-89647abd-604f-4e87-92c7-f3cfdf59c1ec tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:58:44.450619 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-89647abd-604f-4e87-92c7-f3cfdf59c1ec tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:58:44.451757 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-89647abd-604f-4e87-92c7-f3cfdf59c1ec tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:58:44.452338 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-89647abd-604f-4e87-92c7-f3cfdf59c1ec tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:58:44.453007 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-89647abd-604f-4e87-92c7-f3cfdf59c1ec tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:58:44.493364 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-89647abd-604f-4e87-92c7-f3cfdf59c1ec tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:58:44.493849 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-89647abd-604f-4e87-92c7-f3cfdf59c1ec tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:58:44.494322 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-89647abd-604f-4e87-92c7-f3cfdf59c1ec tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:58:44.494796 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.objects.instance [None req-89647abd-604f-4e87-92c7-f3cfdf59c1ec tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lazy-loading 'fault' on Instance uuid 1413aaed-46c7-4807-9d3b-957616dd4047 {{(pid=125242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 15 13:58:44.542724 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-89647abd-604f-4e87-92c7-f3cfdf59c1ec tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e530c3f544748bd3ffc256b1630b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a6be8e43c7742be84f4dc3c95a990e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:58:44.551935 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-89647abd-604f-4e87-92c7-f3cfdf59c1ec tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] 10.222.0.36 "GET /compute/v2.1/servers/1413aaed-46c7-4807-9d3b-957616dd4047" status: 200 len: 1224 microversion: 2.1 time: 0.115266 Oct 15 13:58:44.552746 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 507/1006] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:58:44 2022] GET /compute/v2.1/servers/1413aaed-46c7-4807-9d3b-957616dd4047 => generated 1224 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:58:44.935557 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-8b22d0f6-681e-4795-ac32-ef27888b4f96 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] 10.222.0.36 "POST /compute/v2.1/servers/191fca7f-a39d-4a31-9be0-b655f49aea35/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.569942 Oct 15 13:58:44.936230 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 500/1007] 10.222.0.36 () {60 vars in 1323 bytes} [Sat Oct 15 13:58:44 2022] POST /compute/v2.1/servers/191fca7f-a39d-4a31-9be0-b655f49aea35/os-volume_attachments => generated 194 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 13:58:45.577691 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-a93e68f6-2c38-4442-86c7-a7464e434246 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:58:45.578294 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-a93e68f6-2c38-4442-86c7-a7464e434246 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] [instance: 1413aaed-46c7-4807-9d3b-957616dd4047] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:58:45.585519 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-a93e68f6-2c38-4442-86c7-a7464e434246 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:58:45.586090 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-a93e68f6-2c38-4442-86c7-a7464e434246 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:58:45.586521 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-a93e68f6-2c38-4442-86c7-a7464e434246 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:58:45.587228 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-a93e68f6-2c38-4442-86c7-a7464e434246 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:58:45.587723 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-a93e68f6-2c38-4442-86c7-a7464e434246 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:58:45.588151 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-a93e68f6-2c38-4442-86c7-a7464e434246 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:58:45.603068 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.wsgi [None req-a93e68f6-2c38-4442-86c7-a7464e434246 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] HTTP exception thrown: Instance 1413aaed-46c7-4807-9d3b-957616dd4047 could not be found. Oct 15 13:58:45.604855 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-a93e68f6-2c38-4442-86c7-a7464e434246 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Request method failure captured: Oct 15 13:58:45.604855 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: request: GET /compute/v2.1/servers/1413aaed-46c7-4807-9d3b-957616dd4047 HTTP/1.1 Oct 15 13:58:45.604855 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Accept: application/json Oct 15 13:58:45.604855 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Accept-Encoding: identity Oct 15 13:58:45.604855 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Connection: close Oct 15 13:58:45.604855 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Content-Length: 0 Oct 15 13:58:45.604855 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Content-Type: application/json Oct 15 13:58:45.604855 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Host: 10.222.0.36 Oct 15 13:58:45.604855 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Openstack-System-Scope: None Oct 15 13:58:45.604855 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: User-Agent: python-urllib3/1.26.12 Oct 15 13:58:45.604855 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Auth-Token: gAAAAABjSrreAnr-4CkTFEJcvuuBLerpVWq_tvtO59I95whv0hn5IRB5S87v3ZstU95KycwBsp21v8xymN4dgOZiIdJFNXH3JBKa4DDcIa2Opvy36MgIAcW-vOwVFObwPl4NWj1oliQYq1lD1kZjAFWsil_ekyxGH5BeCDn_aScukNO20G1oXPo Oct 15 13:58:45.604855 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Domain-Id: None Oct 15 13:58:45.604855 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Domain-Name: None Oct 15 13:58:45.604855 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Identity-Status: Confirmed Oct 15 13:58:45.604855 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Is-Admin-Project: True Oct 15 13:58:45.604855 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Project-Domain-Id: default Oct 15 13:58:45.604855 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Project-Domain-Name: Default Oct 15 13:58:45.604855 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Project-Id: 9a6be8e43c7742be84f4dc3c95a990e5 Oct 15 13:58:45.604855 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Project-Name: tempest-TestShelveInstance-1752229947 Oct 15 13:58:45.604855 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Role: member,reader Oct 15 13:58:45.604855 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Roles: member,reader Oct 15 13:58:45.606652 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_9a6be8e43c7742be84f4dc3c95a990e5", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/9a6be8e43c7742be84f4dc3c95a990e5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/9a6be8e43c7742be84f4dc3c95a990e5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/9a6be8e43c7742be84f4dc3c95a990e5"}]}] Oct 15 13:58:45.606652 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Tenant: tempest-TestShelveInstance-1752229947 Oct 15 13:58:45.606652 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Tenant-Id: 9a6be8e43c7742be84f4dc3c95a990e5 Oct 15 13:58:45.606652 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Tenant-Name: tempest-TestShelveInstance-1752229947 Oct 15 13:58:45.606652 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-User: tempest-TestShelveInstance-1752229947-project Oct 15 13:58:45.606652 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-User-Domain-Id: default Oct 15 13:58:45.606652 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-User-Domain-Name: Default Oct 15 13:58:45.606652 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-User-Id: ed6e530c3f544748bd3ffc256b1630b6 Oct 15 13:58:45.606652 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-User-Name: tempest-TestShelveInstance-1752229947-project Oct 15 13:58:45.606652 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: method: > Oct 15 13:58:45.606652 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: exception: Instance 1413aaed-46c7-4807-9d3b-957616dd4047 could not be found. Oct 15 13:58:45.606652 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: action_args: {'id': '1413aaed-46c7-4807-9d3b-957616dd4047'} Oct 15 13:58:45.607986 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 15 13:58:45.607986 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 13:58:45.607986 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 15 13:58:45.607986 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 15 13:58:45.607986 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 15 13:58:45.607986 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 15 13:58:45.607986 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 15 13:58:45.607986 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 15 13:58:45.607986 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 15 13:58:45.607986 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 15 13:58:45.607986 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1413aaed-46c7-4807-9d3b-957616dd4047 could not be found. Oct 15 13:58:45.607986 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Oct 15 13:58:45.607986 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 13:58:45.607986 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Oct 15 13:58:45.607986 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 13:58:45.607986 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 13:58:45.607986 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 13:58:45.607986 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 15 13:58:45.607986 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 15 13:58:45.607986 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 15 13:58:45.609539 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 15 13:58:45.609539 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 15 13:58:45.609539 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 15 13:58:45.609539 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 15 13:58:45.609539 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 15 13:58:45.609539 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 15 13:58:45.609539 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 15 13:58:45.609539 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1413aaed-46c7-4807-9d3b-957616dd4047 could not be found. Oct 15 13:58:45.609539 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Oct 15 13:58:45.609539 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 13:58:45.609539 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Oct 15 13:58:45.609539 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 13:58:45.609539 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 13:58:45.609539 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 13:58:45.609539 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 15 13:58:45.609539 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 15 13:58:45.609539 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1413aaed-46c7-4807-9d3b-957616dd4047 could not be found. Oct 15 13:58:45.609539 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Oct 15 13:58:45.610892 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-a93e68f6-2c38-4442-86c7-a7464e434246 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Returning 404 to user: Instance 1413aaed-46c7-4807-9d3b-957616dd4047 could not be found. {{(pid=125242) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 15 13:58:45.610892 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-a93e68f6-2c38-4442-86c7-a7464e434246 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] 10.222.0.36 "GET /compute/v2.1/servers/1413aaed-46c7-4807-9d3b-957616dd4047" status: 404 len: 111 microversion: 2.1 time: 0.032822 Oct 15 13:58:45.610892 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 508/1008] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:58:45 2022] GET /compute/v2.1/servers/1413aaed-46c7-4807-9d3b-957616dd4047 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 15 13:58:45.779333 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-2046b1cb-ef66-4775-b839-81bab6cf3ee5 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] Calling method '.version_select at 0x7f1b5e11b4c0>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:58:45.802186 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-2046b1cb-ef66-4775-b839-81bab6cf3ee5 tempest-TestShelveInstance-1752229947 tempest-TestShelveInstance-1752229947-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-492113451" status: 202 len: 0 microversion: 2.1 time: 0.027302 Oct 15 13:58:45.802706 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 501/1009] 10.222.0.36 () {58 vars in 1251 bytes} [Sat Oct 15 13:58:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-492113451 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 15 13:58:51.043071 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-52e35ff7-6317-4f63-9788-bb11543da7cc tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Action: 'create', calling method: .version_select at 0x7f1b5e3f0ee0>, body: {"keypair": {"name": "tempest-keypair-1861952530", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGzf1cdwRsPXMjaixCz1/s2aMeDXVtvna01lEecYz0PWoai2KtSNwoadeAAetayxHryDzKCRkNKi5sOdn9tYJZIy+p131DyJ3PmEcDNnMgJFiAraVRcFEX6k5dqdXolVqg=="}} {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 13:58:51.062016 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.quota [None req-52e35ff7-6317-4f63-9788-bb11543da7cc tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Getting quotas for project 1976b27e84a4484ba9d46a4244b08699. Resources: {'key_pairs'} {{(pid=125242) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 15 13:58:51.066211 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.quota [None req-52e35ff7-6317-4f63-9788-bb11543da7cc tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Getting quotas for user a10fc1a48c9c41eaa1bf3ff2e4109657 and project 1976b27e84a4484ba9d46a4244b08699. Resources: {'key_pairs'} {{(pid=125242) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 15 13:58:51.083948 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR oslo.messaging._drivers.impl_rabbit [None req-52e35ff7-6317-4f63-9788-bb11543da7cc tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] [61df2d69-7a06-4a27-aa1e-aaa1c931bf01] AMQP server on 10.222.0.36:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 15 13:58:52.095375 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO oslo.messaging._drivers.impl_rabbit [None req-52e35ff7-6317-4f63-9788-bb11543da7cc tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] [61df2d69-7a06-4a27-aa1e-aaa1c931bf01] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 47462. Oct 15 13:58:52.117385 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-52e35ff7-6317-4f63-9788-bb11543da7cc tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.078110 Oct 15 13:58:52.119266 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 509/1010] 10.222.0.36 () {60 vars in 1159 bytes} [Sat Oct 15 13:58:51 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 13:58:53.835626 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-2fa92f15-1454-4ea6-9c40-a716ea367e87 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-447430323", "imageRef": "26e64909-1cae-49ca-af5e-adea40c062d7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b6c514f8-1a01-4cc0-b2b4-f8ec3eab2ef0"}], "security_groups": [{"name": "tempest-securitygroup--608723527"}], "key_name": "tempest-keypair-1861952530", "user_data": "}} {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 13:58:54.023492 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.network.neutron [None req-2fa92f15-1454-4ea6-9c40-a716ea367e87 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] validate_networks() for [('b6c514f8-1a01-4cc0-b2b4-f8ec3eab2ef0', None, None, None, None, None)] {{(pid=125243) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 15 13:58:54.483476 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.virt.hardware [None req-2fa92f15-1454-4ea6-9c40-a716ea367e87 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Flavor limits 0:0:0 {{(pid=125243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 15 13:58:54.484341 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.virt.hardware [None req-2fa92f15-1454-4ea6-9c40-a716ea367e87 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Image limits 0:0:0 {{(pid=125243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 15 13:58:54.484471 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.virt.hardware [None req-2fa92f15-1454-4ea6-9c40-a716ea367e87 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Flavor pref 0:0:0 {{(pid=125243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 15 13:58:54.484816 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.virt.hardware [None req-2fa92f15-1454-4ea6-9c40-a716ea367e87 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Image pref 0:0:0 {{(pid=125243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 15 13:58:54.485225 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.virt.hardware [None req-2fa92f15-1454-4ea6-9c40-a716ea367e87 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 15 13:58:54.495007 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-2fa92f15-1454-4ea6-9c40-a716ea367e87 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:58:54.495492 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-2fa92f15-1454-4ea6-9c40-a716ea367e87 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:58:54.495958 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-2fa92f15-1454-4ea6-9c40-a716ea367e87 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:58:54.496900 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-2fa92f15-1454-4ea6-9c40-a716ea367e87 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:58:54.497386 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-2fa92f15-1454-4ea6-9c40-a716ea367e87 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:58:54.497780 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-2fa92f15-1454-4ea6-9c40-a716ea367e87 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:58:54.516811 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.quota [None req-2fa92f15-1454-4ea6-9c40-a716ea367e87 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Getting quotas for project 1976b27e84a4484ba9d46a4244b08699. Resources: {'cores', 'ram', 'instances'} {{(pid=125243) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 15 13:58:54.520995 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.quota [None req-2fa92f15-1454-4ea6-9c40-a716ea367e87 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Getting quotas for user a10fc1a48c9c41eaa1bf3ff2e4109657 and project 1976b27e84a4484ba9d46a4244b08699. Resources: {'cores', 'ram', 'instances'} {{(pid=125243) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 15 13:58:54.532426 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-2fa92f15-1454-4ea6-9c40-a716ea367e87 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Going to run 1 instances... {{(pid=125243) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 15 13:58:54.535243 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-2fa92f15-1454-4ea6-9c40-a716ea367e87 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] [instance: 1c2ec1ba-e381-4083-a794-c8ff83beb391] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='26e64909-1cae-49ca-af5e-adea40c062d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125243) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 15 13:58:54.591546 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-2fa92f15-1454-4ea6-9c40-a716ea367e87 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.761335 Oct 15 13:58:54.599171 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 502/1011] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 15 13:58:53 2022] POST /compute/v2.1/servers => generated 401 bytes in 763 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 15 13:58:54.605456 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-289dfb9b-f3e9-424c-a860-a31a6cbbc879 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:58:54.606184 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-289dfb9b-f3e9-424c-a860-a31a6cbbc879 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] [instance: 1c2ec1ba-e381-4083-a794-c8ff83beb391] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:58:54.696158 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-289dfb9b-f3e9-424c-a860-a31a6cbbc879 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10fc1a48c9c41eaa1bf3ff2e4109657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1976b27e84a4484ba9d46a4244b08699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:58:54.704177 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-289dfb9b-f3e9-424c-a860-a31a6cbbc879 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] 10.222.0.36 "GET /compute/v2.1/servers/1c2ec1ba-e381-4083-a794-c8ff83beb391" status: 200 len: 1241 microversion: 2.1 time: 0.103705 Oct 15 13:58:54.705136 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 510/1012] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:58:54 2022] GET /compute/v2.1/servers/1c2ec1ba-e381-4083-a794-c8ff83beb391 => generated 1241 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:58:55.729963 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-ad36a564-cfff-44b9-bee5-aaaadd6e7a4f tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:58:55.730635 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-ad36a564-cfff-44b9-bee5-aaaadd6e7a4f tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] [instance: 1c2ec1ba-e381-4083-a794-c8ff83beb391] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:58:55.738272 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-ad36a564-cfff-44b9-bee5-aaaadd6e7a4f tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:58:55.738763 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-ad36a564-cfff-44b9-bee5-aaaadd6e7a4f tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:58:55.739229 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-ad36a564-cfff-44b9-bee5-aaaadd6e7a4f tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:58:55.739976 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-ad36a564-cfff-44b9-bee5-aaaadd6e7a4f tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:58:55.740437 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-ad36a564-cfff-44b9-bee5-aaaadd6e7a4f tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:58:55.740917 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-ad36a564-cfff-44b9-bee5-aaaadd6e7a4f tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:58:55.810552 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-ad36a564-cfff-44b9-bee5-aaaadd6e7a4f tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10fc1a48c9c41eaa1bf3ff2e4109657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1976b27e84a4484ba9d46a4244b08699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:58:55.819672 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-ad36a564-cfff-44b9-bee5-aaaadd6e7a4f tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] 10.222.0.36 "GET /compute/v2.1/servers/1c2ec1ba-e381-4083-a794-c8ff83beb391" status: 200 len: 1293 microversion: 2.1 time: 0.093897 Oct 15 13:58:55.820372 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 503/1013] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:58:55 2022] GET /compute/v2.1/servers/1c2ec1ba-e381-4083-a794-c8ff83beb391 => generated 1293 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:58:56.842916 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-381a26dc-712d-4ae4-af1b-f3c0fd4d5c23 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:58:56.843514 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-381a26dc-712d-4ae4-af1b-f3c0fd4d5c23 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] [instance: 1c2ec1ba-e381-4083-a794-c8ff83beb391] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:58:56.845693 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG dbcounter [-] [125242] Writing DB stats nova_cell1:SELECT=61,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=125242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:58:56.852076 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-381a26dc-712d-4ae4-af1b-f3c0fd4d5c23 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:58:56.852565 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-381a26dc-712d-4ae4-af1b-f3c0fd4d5c23 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:58:56.852994 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-381a26dc-712d-4ae4-af1b-f3c0fd4d5c23 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:58:56.853703 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-381a26dc-712d-4ae4-af1b-f3c0fd4d5c23 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:58:56.854161 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-381a26dc-712d-4ae4-af1b-f3c0fd4d5c23 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:58:56.854584 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-381a26dc-712d-4ae4-af1b-f3c0fd4d5c23 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:58:56.975655 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-381a26dc-712d-4ae4-af1b-f3c0fd4d5c23 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10fc1a48c9c41eaa1bf3ff2e4109657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1976b27e84a4484ba9d46a4244b08699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:58:56.984154 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-381a26dc-712d-4ae4-af1b-f3c0fd4d5c23 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] 10.222.0.36 "GET /compute/v2.1/servers/1c2ec1ba-e381-4083-a794-c8ff83beb391" status: 200 len: 1299 microversion: 2.1 time: 0.145168 Oct 15 13:58:56.984753 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 511/1014] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:58:56 2022] GET /compute/v2.1/servers/1c2ec1ba-e381-4083-a794-c8ff83beb391 => generated 1299 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:58:57.958141 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-a8f7b103-1016-4274-839a-8a7366dfd3a4 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:58:57.960752 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-a8f7b103-1016-4274-839a-8a7366dfd3a4 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] [instance: 191fca7f-a39d-4a31-9be0-b655f49aea35] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:58:57.967567 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-a8f7b103-1016-4274-839a-8a7366dfd3a4 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:58:57.968114 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-a8f7b103-1016-4274-839a-8a7366dfd3a4 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:58:57.968554 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-a8f7b103-1016-4274-839a-8a7366dfd3a4 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:58:57.969260 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-a8f7b103-1016-4274-839a-8a7366dfd3a4 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:58:57.969714 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-a8f7b103-1016-4274-839a-8a7366dfd3a4 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:58:57.970135 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-a8f7b103-1016-4274-839a-8a7366dfd3a4 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:58:58.008862 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-fa773e7c-9cf9-4eb6-aa21-c815e3ae6179 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:58:58.010225 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-fa773e7c-9cf9-4eb6-aa21-c815e3ae6179 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] [instance: 1c2ec1ba-e381-4083-a794-c8ff83beb391] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:58:58.016642 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-a8f7b103-1016-4274-839a-8a7366dfd3a4 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] 10.222.0.36 "GET /compute/v2.1/servers/191fca7f-a39d-4a31-9be0-b655f49aea35/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.062016 Oct 15 13:58:58.017679 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 504/1015] 10.222.0.36 () {58 vars in 1302 bytes} [Sat Oct 15 13:58:57 2022] GET /compute/v2.1/servers/191fca7f-a39d-4a31-9be0-b655f49aea35/os-volume_attachments => generated 371 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 15 13:58:58.023945 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-fa773e7c-9cf9-4eb6-aa21-c815e3ae6179 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:58:58.024956 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-fa773e7c-9cf9-4eb6-aa21-c815e3ae6179 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:58:58.032595 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-fa773e7c-9cf9-4eb6-aa21-c815e3ae6179 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:58:58.033554 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-fa773e7c-9cf9-4eb6-aa21-c815e3ae6179 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:58:58.033784 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [req-02179d48-20b9-4fa5-bd14-8d7826215f88 req-477bd134-9070-4fcf-a503-e3361be9b930 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c2ec1ba-e381-4083-a794-c8ff83beb391", "tag": "8f1ff711-16b3-41c3-ab0a-c21d959b5f7c"}]} {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 13:58:58.034290 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-fa773e7c-9cf9-4eb6-aa21-c815e3ae6179 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:58:58.034888 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-fa773e7c-9cf9-4eb6-aa21-c815e3ae6179 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:58:58.049692 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [req-02179d48-20b9-4fa5-bd14-8d7826215f88 req-477bd134-9070-4fcf-a503-e3361be9b930 service nova] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:58:58.050400 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [req-02179d48-20b9-4fa5-bd14-8d7826215f88 req-477bd134-9070-4fcf-a503-e3361be9b930 service nova] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:58:58.051096 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [req-02179d48-20b9-4fa5-bd14-8d7826215f88 req-477bd134-9070-4fcf-a503-e3361be9b930 service nova] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:58:58.073128 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.compute.server_external_events [req-02179d48-20b9-4fa5-bd14-8d7826215f88 req-477bd134-9070-4fcf-a503-e3361be9b930 service nova] Creating event network-changed:8f1ff711-16b3-41c3-ab0a-c21d959b5f7c for instance 1c2ec1ba-e381-4083-a794-c8ff83beb391 on hv-cinder-86149 Oct 15 13:58:58.081314 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [req-02179d48-20b9-4fa5-bd14-8d7826215f88 req-477bd134-9070-4fcf-a503-e3361be9b930 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052731 Oct 15 13:58:58.081966 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 505/1016] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 15 13:58:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 15 13:58:58.165883 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-70729c5a-7733-4be1-828c-aa7211964863 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:58:58.166377 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-70729c5a-7733-4be1-828c-aa7211964863 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] [instance: 191fca7f-a39d-4a31-9be0-b655f49aea35] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:58:58.173583 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-70729c5a-7733-4be1-828c-aa7211964863 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:58:58.174099 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-70729c5a-7733-4be1-828c-aa7211964863 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:58:58.174561 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-70729c5a-7733-4be1-828c-aa7211964863 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:58:58.175275 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-70729c5a-7733-4be1-828c-aa7211964863 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:58:58.175754 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-70729c5a-7733-4be1-828c-aa7211964863 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:58:58.176213 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-70729c5a-7733-4be1-828c-aa7211964863 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:58:58.212438 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-70729c5a-7733-4be1-828c-aa7211964863 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] 10.222.0.36 "GET /compute/v2.1/servers/191fca7f-a39d-4a31-9be0-b655f49aea35/os-volume_attachments/103ba8e5-45d0-43e1-beaa-7d8b5a0e0ab9" status: 200 len: 194 microversion: 2.1 time: 0.053061 Oct 15 13:58:58.213113 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 506/1017] 10.222.0.36 () {58 vars in 1413 bytes} [Sat Oct 15 13:58:58 2022] GET /compute/v2.1/servers/191fca7f-a39d-4a31-9be0-b655f49aea35/os-volume_attachments/103ba8e5-45d0-43e1-beaa-7d8b5a0e0ab9 => generated 194 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 15 13:58:58.225346 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-689834e8-ac00-43eb-abf8-a9daed937cbb tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:58:58.225860 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-689834e8-ac00-43eb-abf8-a9daed937cbb tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] [instance: 191fca7f-a39d-4a31-9be0-b655f49aea35] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:58:58.233245 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-689834e8-ac00-43eb-abf8-a9daed937cbb tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:58:58.233763 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-689834e8-ac00-43eb-abf8-a9daed937cbb tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:58:58.234246 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-689834e8-ac00-43eb-abf8-a9daed937cbb tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:58:58.234960 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-689834e8-ac00-43eb-abf8-a9daed937cbb tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:58:58.235410 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-689834e8-ac00-43eb-abf8-a9daed937cbb tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:58:58.235947 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-689834e8-ac00-43eb-abf8-a9daed937cbb tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:58:58.315508 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-fa773e7c-9cf9-4eb6-aa21-c815e3ae6179 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10fc1a48c9c41eaa1bf3ff2e4109657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1976b27e84a4484ba9d46a4244b08699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:58:58.330487 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-fa773e7c-9cf9-4eb6-aa21-c815e3ae6179 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] 10.222.0.36 "GET /compute/v2.1/servers/1c2ec1ba-e381-4083-a794-c8ff83beb391" status: 200 len: 1366 microversion: 2.1 time: 0.326350 Oct 15 13:58:58.332380 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 512/1018] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:58:58 2022] GET /compute/v2.1/servers/1c2ec1ba-e381-4083-a794-c8ff83beb391 => generated 1366 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:58:58.343222 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.objects.instance [None req-689834e8-ac00-43eb-abf8-a9daed937cbb tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lazy-loading 'services' on Instance uuid 191fca7f-a39d-4a31-9be0-b655f49aea35 {{(pid=125243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 15 13:58:58.427311 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-689834e8-ac00-43eb-abf8-a9daed937cbb tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] 10.222.0.36 "DELETE /compute/v2.1/servers/191fca7f-a39d-4a31-9be0-b655f49aea35/os-volume_attachments/103ba8e5-45d0-43e1-beaa-7d8b5a0e0ab9" status: 202 len: 0 microversion: 2.1 time: 0.206249 Oct 15 13:58:58.427991 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 507/1019] 10.222.0.36 () {58 vars in 1416 bytes} [Sat Oct 15 13:58:58 2022] DELETE /compute/v2.1/servers/191fca7f-a39d-4a31-9be0-b655f49aea35/os-volume_attachments/103ba8e5-45d0-43e1-beaa-7d8b5a0e0ab9 => generated 0 bytes in 208 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 15 13:58:59.357767 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-d3f07b19-d088-47b4-a050-68ee830dba3a tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:58:59.358403 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-d3f07b19-d088-47b4-a050-68ee830dba3a tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] [instance: 1c2ec1ba-e381-4083-a794-c8ff83beb391] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:58:59.366058 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-d3f07b19-d088-47b4-a050-68ee830dba3a tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:58:59.366592 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-d3f07b19-d088-47b4-a050-68ee830dba3a tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:58:59.367030 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-d3f07b19-d088-47b4-a050-68ee830dba3a tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:58:59.368048 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-d3f07b19-d088-47b4-a050-68ee830dba3a tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:58:59.368549 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-d3f07b19-d088-47b4-a050-68ee830dba3a tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:58:59.369132 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-d3f07b19-d088-47b4-a050-68ee830dba3a tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:58:59.545616 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-d3f07b19-d088-47b4-a050-68ee830dba3a tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10fc1a48c9c41eaa1bf3ff2e4109657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1976b27e84a4484ba9d46a4244b08699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:58:59.554572 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-d3f07b19-d088-47b4-a050-68ee830dba3a tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] 10.222.0.36 "GET /compute/v2.1/servers/1c2ec1ba-e381-4083-a794-c8ff83beb391" status: 200 len: 1366 microversion: 2.1 time: 0.201395 Oct 15 13:58:59.554956 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 513/1020] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:58:59 2022] GET /compute/v2.1/servers/1c2ec1ba-e381-4083-a794-c8ff83beb391 => generated 1366 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:59:00.578457 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-9465fa8b-afef-4ba2-aee3-dfa49e6c9e7f tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:59:00.579151 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-9465fa8b-afef-4ba2-aee3-dfa49e6c9e7f tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] [instance: 1c2ec1ba-e381-4083-a794-c8ff83beb391] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:59:00.586040 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-9465fa8b-afef-4ba2-aee3-dfa49e6c9e7f tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:59:00.586550 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-9465fa8b-afef-4ba2-aee3-dfa49e6c9e7f tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:59:00.586977 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-9465fa8b-afef-4ba2-aee3-dfa49e6c9e7f tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:59:00.587692 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-9465fa8b-afef-4ba2-aee3-dfa49e6c9e7f tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:59:00.588180 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-9465fa8b-afef-4ba2-aee3-dfa49e6c9e7f tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:59:00.588607 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-9465fa8b-afef-4ba2-aee3-dfa49e6c9e7f tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:59:00.747529 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-9465fa8b-afef-4ba2-aee3-dfa49e6c9e7f tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10fc1a48c9c41eaa1bf3ff2e4109657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1976b27e84a4484ba9d46a4244b08699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:59:00.756871 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-9465fa8b-afef-4ba2-aee3-dfa49e6c9e7f tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] 10.222.0.36 "GET /compute/v2.1/servers/1c2ec1ba-e381-4083-a794-c8ff83beb391" status: 200 len: 1366 microversion: 2.1 time: 0.183223 Oct 15 13:59:00.757461 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 508/1021] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:59:00 2022] GET /compute/v2.1/servers/1c2ec1ba-e381-4083-a794-c8ff83beb391 => generated 1366 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:59:01.780721 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-be7f8e17-eb60-44c6-849a-919ad2bb6385 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:59:01.781496 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-be7f8e17-eb60-44c6-849a-919ad2bb6385 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] [instance: 1c2ec1ba-e381-4083-a794-c8ff83beb391] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:59:01.791018 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-be7f8e17-eb60-44c6-849a-919ad2bb6385 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:59:01.791746 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-be7f8e17-eb60-44c6-849a-919ad2bb6385 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:59:01.792583 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-be7f8e17-eb60-44c6-849a-919ad2bb6385 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:59:01.793715 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-be7f8e17-eb60-44c6-849a-919ad2bb6385 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:59:01.794491 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-be7f8e17-eb60-44c6-849a-919ad2bb6385 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:59:01.795276 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-be7f8e17-eb60-44c6-849a-919ad2bb6385 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:59:02.040112 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-be7f8e17-eb60-44c6-849a-919ad2bb6385 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10fc1a48c9c41eaa1bf3ff2e4109657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1976b27e84a4484ba9d46a4244b08699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:59:02.048846 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-be7f8e17-eb60-44c6-849a-919ad2bb6385 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] 10.222.0.36 "GET /compute/v2.1/servers/1c2ec1ba-e381-4083-a794-c8ff83beb391" status: 200 len: 1366 microversion: 2.1 time: 0.272063 Oct 15 13:59:02.049510 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 514/1022] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:59:01 2022] GET /compute/v2.1/servers/1c2ec1ba-e381-4083-a794-c8ff83beb391 => generated 1366 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:59:02.794350 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-f8c53e65-efc6-4b2c-aa3d-f349a6d62280 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:59:02.794956 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-f8c53e65-efc6-4b2c-aa3d-f349a6d62280 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] [instance: 191fca7f-a39d-4a31-9be0-b655f49aea35] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:59:02.797475 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG dbcounter [-] [125243] Writing DB stats nova_api:SELECT=62,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=125243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:59:02.803177 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-f8c53e65-efc6-4b2c-aa3d-f349a6d62280 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:59:02.803667 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-f8c53e65-efc6-4b2c-aa3d-f349a6d62280 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:59:02.804131 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-f8c53e65-efc6-4b2c-aa3d-f349a6d62280 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:59:02.804842 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-f8c53e65-efc6-4b2c-aa3d-f349a6d62280 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:59:02.805292 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-f8c53e65-efc6-4b2c-aa3d-f349a6d62280 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:59:02.805793 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-f8c53e65-efc6-4b2c-aa3d-f349a6d62280 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:59:02.838469 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-f8c53e65-efc6-4b2c-aa3d-f349a6d62280 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] 10.222.0.36 "GET /compute/v2.1/servers/191fca7f-a39d-4a31-9be0-b655f49aea35/os-volume_attachments/ceb8a09d-b672-4452-b4c4-5465e7a8da07" status: 200 len: 194 microversion: 2.1 time: 0.048382 Oct 15 13:59:02.839093 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 509/1023] 10.222.0.36 () {58 vars in 1413 bytes} [Sat Oct 15 13:59:02 2022] GET /compute/v2.1/servers/191fca7f-a39d-4a31-9be0-b655f49aea35/os-volume_attachments/ceb8a09d-b672-4452-b4c4-5465e7a8da07 => generated 194 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 13:59:02.850468 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-74bdf66c-afa4-4c1a-8bdc-3cd5983bcf22 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:59:02.851055 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-74bdf66c-afa4-4c1a-8bdc-3cd5983bcf22 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] [instance: 191fca7f-a39d-4a31-9be0-b655f49aea35] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:59:02.853387 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG dbcounter [-] [125242] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=125242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:59:02.859197 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-74bdf66c-afa4-4c1a-8bdc-3cd5983bcf22 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:59:02.859689 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-74bdf66c-afa4-4c1a-8bdc-3cd5983bcf22 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:59:02.860154 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-74bdf66c-afa4-4c1a-8bdc-3cd5983bcf22 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:59:02.860860 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-74bdf66c-afa4-4c1a-8bdc-3cd5983bcf22 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:59:02.861313 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-74bdf66c-afa4-4c1a-8bdc-3cd5983bcf22 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:59:02.861736 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-74bdf66c-afa4-4c1a-8bdc-3cd5983bcf22 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:59:02.952042 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.objects.instance [None req-74bdf66c-afa4-4c1a-8bdc-3cd5983bcf22 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lazy-loading 'services' on Instance uuid 191fca7f-a39d-4a31-9be0-b655f49aea35 {{(pid=125242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 15 13:59:03.037864 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-74bdf66c-afa4-4c1a-8bdc-3cd5983bcf22 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] 10.222.0.36 "DELETE /compute/v2.1/servers/191fca7f-a39d-4a31-9be0-b655f49aea35/os-volume_attachments/ceb8a09d-b672-4452-b4c4-5465e7a8da07" status: 202 len: 0 microversion: 2.1 time: 0.191663 Oct 15 13:59:03.038506 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 515/1024] 10.222.0.36 () {58 vars in 1416 bytes} [Sat Oct 15 13:59:02 2022] DELETE /compute/v2.1/servers/191fca7f-a39d-4a31-9be0-b655f49aea35/os-volume_attachments/ceb8a09d-b672-4452-b4c4-5465e7a8da07 => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 15 13:59:03.071288 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-e7be88fa-8b70-4267-b466-c04b364ef5f6 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:59:03.071948 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-e7be88fa-8b70-4267-b466-c04b364ef5f6 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] [instance: 1c2ec1ba-e381-4083-a794-c8ff83beb391] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:59:03.080096 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-e7be88fa-8b70-4267-b466-c04b364ef5f6 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:59:03.080602 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-e7be88fa-8b70-4267-b466-c04b364ef5f6 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:59:03.081073 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-e7be88fa-8b70-4267-b466-c04b364ef5f6 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:59:03.082016 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-e7be88fa-8b70-4267-b466-c04b364ef5f6 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:59:03.082573 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-e7be88fa-8b70-4267-b466-c04b364ef5f6 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:59:03.083596 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-e7be88fa-8b70-4267-b466-c04b364ef5f6 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:59:03.234147 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-e7be88fa-8b70-4267-b466-c04b364ef5f6 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10fc1a48c9c41eaa1bf3ff2e4109657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1976b27e84a4484ba9d46a4244b08699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:59:03.243140 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-e7be88fa-8b70-4267-b466-c04b364ef5f6 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] 10.222.0.36 "GET /compute/v2.1/servers/1c2ec1ba-e381-4083-a794-c8ff83beb391" status: 200 len: 1366 microversion: 2.1 time: 0.176231 Oct 15 13:59:03.243762 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 510/1025] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:59:03 2022] GET /compute/v2.1/servers/1c2ec1ba-e381-4083-a794-c8ff83beb391 => generated 1366 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:59:04.259064 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-02f602d1-f5ad-48db-b3b4-b7a63445d42c tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:59:04.263173 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-02f602d1-f5ad-48db-b3b4-b7a63445d42c tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] [instance: 191fca7f-a39d-4a31-9be0-b655f49aea35] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:59:04.267405 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-0b73d514-885c-4f9b-bed7-0697fcf832b7 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:59:04.268426 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-0b73d514-885c-4f9b-bed7-0697fcf832b7 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] [instance: 1c2ec1ba-e381-4083-a794-c8ff83beb391] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:59:04.269917 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-02f602d1-f5ad-48db-b3b4-b7a63445d42c tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:59:04.270625 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-02f602d1-f5ad-48db-b3b4-b7a63445d42c tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:59:04.271197 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-02f602d1-f5ad-48db-b3b4-b7a63445d42c tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:59:04.271954 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-02f602d1-f5ad-48db-b3b4-b7a63445d42c tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:59:04.272756 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-02f602d1-f5ad-48db-b3b4-b7a63445d42c tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:59:04.272880 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-02f602d1-f5ad-48db-b3b4-b7a63445d42c tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:59:04.276612 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-0b73d514-885c-4f9b-bed7-0697fcf832b7 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:59:04.277190 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-0b73d514-885c-4f9b-bed7-0697fcf832b7 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:59:04.277765 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-0b73d514-885c-4f9b-bed7-0697fcf832b7 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:59:04.278499 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-0b73d514-885c-4f9b-bed7-0697fcf832b7 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:59:04.279036 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-0b73d514-885c-4f9b-bed7-0697fcf832b7 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:59:04.279463 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-0b73d514-885c-4f9b-bed7-0697fcf832b7 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:59:04.307032 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-02f602d1-f5ad-48db-b3b4-b7a63445d42c tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] 10.222.0.36 "GET /compute/v2.1/servers/191fca7f-a39d-4a31-9be0-b655f49aea35/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053064 Oct 15 13:59:04.307824 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 516/1026] 10.222.0.36 () {58 vars in 1302 bytes} [Sat Oct 15 13:59:04 2022] GET /compute/v2.1/servers/191fca7f-a39d-4a31-9be0-b655f49aea35/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 15 13:59:04.320709 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [req-c76ff80c-15d4-4157-ba6c-a900e0ca0065 req-c53be94d-4f35-4f90-b85f-894a769e2e5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c2ec1ba-e381-4083-a794-c8ff83beb391", "name": "network-vif-plugged", "status": "completed", "tag": "8f1ff711-16b3-41c3-ab0a-c21d959b5f7c"}]} {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 13:59:04.335208 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [req-c76ff80c-15d4-4157-ba6c-a900e0ca0065 req-c53be94d-4f35-4f90-b85f-894a769e2e5a service nova] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:59:04.335775 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [req-c76ff80c-15d4-4157-ba6c-a900e0ca0065 req-c53be94d-4f35-4f90-b85f-894a769e2e5a service nova] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:59:04.336347 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [req-c76ff80c-15d4-4157-ba6c-a900e0ca0065 req-c53be94d-4f35-4f90-b85f-894a769e2e5a service nova] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:59:04.354659 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.compute.server_external_events [req-c76ff80c-15d4-4157-ba6c-a900e0ca0065 req-c53be94d-4f35-4f90-b85f-894a769e2e5a service nova] Creating event network-vif-plugged:8f1ff711-16b3-41c3-ab0a-c21d959b5f7c for instance 1c2ec1ba-e381-4083-a794-c8ff83beb391 on hv-cinder-86149 Oct 15 13:59:04.361621 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [req-c76ff80c-15d4-4157-ba6c-a900e0ca0065 req-c53be94d-4f35-4f90-b85f-894a769e2e5a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048288 Oct 15 13:59:04.362706 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 517/1027] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 15 13:59:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 13:59:04.459369 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-0b73d514-885c-4f9b-bed7-0697fcf832b7 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10fc1a48c9c41eaa1bf3ff2e4109657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1976b27e84a4484ba9d46a4244b08699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:59:04.459639 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-359c804a-e85d-49e8-8c45-66c584190735 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:59:04.461942 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-359c804a-e85d-49e8-8c45-66c584190735 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] [instance: 191fca7f-a39d-4a31-9be0-b655f49aea35] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:59:04.464609 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG dbcounter [-] [125243] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=125243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:59:04.469049 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-359c804a-e85d-49e8-8c45-66c584190735 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:59:04.469555 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-359c804a-e85d-49e8-8c45-66c584190735 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:59:04.469999 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-359c804a-e85d-49e8-8c45-66c584190735 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:59:04.470723 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-359c804a-e85d-49e8-8c45-66c584190735 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:59:04.471175 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-359c804a-e85d-49e8-8c45-66c584190735 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:59:04.471804 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-359c804a-e85d-49e8-8c45-66c584190735 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:59:04.475807 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-0b73d514-885c-4f9b-bed7-0697fcf832b7 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] 10.222.0.36 "GET /compute/v2.1/servers/1c2ec1ba-e381-4083-a794-c8ff83beb391" status: 200 len: 1366 microversion: 2.1 time: 0.212419 Oct 15 13:59:04.476903 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 511/1028] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:59:04 2022] GET /compute/v2.1/servers/1c2ec1ba-e381-4083-a794-c8ff83beb391 => generated 1366 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 13:59:04.507442 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-359c804a-e85d-49e8-8c45-66c584190735 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] 10.222.0.36 "GET /compute/v2.1/servers/191fca7f-a39d-4a31-9be0-b655f49aea35/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052303 Oct 15 13:59:04.508043 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 518/1029] 10.222.0.36 () {58 vars in 1302 bytes} [Sat Oct 15 13:59:04 2022] GET /compute/v2.1/servers/191fca7f-a39d-4a31-9be0-b655f49aea35/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 15 13:59:04.577301 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-ec363094-2ec5-46bc-bea1-cb47c0c220b5 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:59:04.577804 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-ec363094-2ec5-46bc-bea1-cb47c0c220b5 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] [instance: 191fca7f-a39d-4a31-9be0-b655f49aea35] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:59:04.580179 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG dbcounter [-] [125243] Writing DB stats nova_cell0:SELECT=2 {{(pid=125243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:59:04.580811 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG dbcounter [-] [125243] Writing DB stats nova_cell0:SELECT=6 {{(pid=125243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:59:04.587536 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-ec363094-2ec5-46bc-bea1-cb47c0c220b5 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:59:04.587977 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-ec363094-2ec5-46bc-bea1-cb47c0c220b5 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:59:04.588407 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-ec363094-2ec5-46bc-bea1-cb47c0c220b5 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:59:04.589107 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-ec363094-2ec5-46bc-bea1-cb47c0c220b5 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:59:04.589554 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-ec363094-2ec5-46bc-bea1-cb47c0c220b5 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:59:04.589974 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-ec363094-2ec5-46bc-bea1-cb47c0c220b5 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:59:04.618584 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-ec363094-2ec5-46bc-bea1-cb47c0c220b5 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] [instance: 191fca7f-a39d-4a31-9be0-b655f49aea35] Going to try to terminate instance {{(pid=125243) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 15 13:59:04.700355 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-ec363094-2ec5-46bc-bea1-cb47c0c220b5 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] 10.222.0.36 "DELETE /compute/v2.1/servers/191fca7f-a39d-4a31-9be0-b655f49aea35" status: 204 len: 0 microversion: 2.1 time: 0.126626 Oct 15 13:59:04.700921 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 512/1030] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 15 13:59:04 2022] DELETE /compute/v2.1/servers/191fca7f-a39d-4a31-9be0-b655f49aea35 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 15 13:59:04.709650 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-99981486-e8ff-404e-8f24-71f2a72f22bb tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:59:04.710284 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-99981486-e8ff-404e-8f24-71f2a72f22bb tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] [instance: 191fca7f-a39d-4a31-9be0-b655f49aea35] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:59:04.712359 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG dbcounter [-] [125242] Writing DB stats nova_cell0:SELECT=6 {{(pid=125242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:59:04.717483 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-99981486-e8ff-404e-8f24-71f2a72f22bb tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:59:04.718017 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-99981486-e8ff-404e-8f24-71f2a72f22bb tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:59:04.718449 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-99981486-e8ff-404e-8f24-71f2a72f22bb tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:59:04.719139 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-99981486-e8ff-404e-8f24-71f2a72f22bb tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:59:04.719588 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-99981486-e8ff-404e-8f24-71f2a72f22bb tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:59:04.720380 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-99981486-e8ff-404e-8f24-71f2a72f22bb tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:59:04.855157 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-99981486-e8ff-404e-8f24-71f2a72f22bb tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583cce1547144e11978f20a3193ceba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f8b5024a194f70a9f7689ac44ab07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:59:04.863489 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-99981486-e8ff-404e-8f24-71f2a72f22bb tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] 10.222.0.36 "GET /compute/v2.1/servers/191fca7f-a39d-4a31-9be0-b655f49aea35" status: 200 len: 1674 microversion: 2.1 time: 0.158080 Oct 15 13:59:04.864151 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 519/1031] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:59:04 2022] GET /compute/v2.1/servers/191fca7f-a39d-4a31-9be0-b655f49aea35 => generated 1674 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:59:05.505933 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-1e7883be-7d01-405c-b611-b1acaf53ae6d tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:59:05.506676 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-1e7883be-7d01-405c-b611-b1acaf53ae6d tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] [instance: 1c2ec1ba-e381-4083-a794-c8ff83beb391] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:59:05.515624 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-1e7883be-7d01-405c-b611-b1acaf53ae6d tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:59:05.516264 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-1e7883be-7d01-405c-b611-b1acaf53ae6d tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:59:05.516705 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-1e7883be-7d01-405c-b611-b1acaf53ae6d tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:59:05.517729 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-1e7883be-7d01-405c-b611-b1acaf53ae6d tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:59:05.518459 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-1e7883be-7d01-405c-b611-b1acaf53ae6d tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:59:05.519029 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-1e7883be-7d01-405c-b611-b1acaf53ae6d tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:59:05.662975 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-1e7883be-7d01-405c-b611-b1acaf53ae6d tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10fc1a48c9c41eaa1bf3ff2e4109657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1976b27e84a4484ba9d46a4244b08699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:59:05.675829 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-1e7883be-7d01-405c-b611-b1acaf53ae6d tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] 10.222.0.36 "GET /compute/v2.1/servers/1c2ec1ba-e381-4083-a794-c8ff83beb391" status: 200 len: 1366 microversion: 2.1 time: 0.177000 Oct 15 13:59:05.677100 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 513/1032] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:59:05 2022] GET /compute/v2.1/servers/1c2ec1ba-e381-4083-a794-c8ff83beb391 => generated 1366 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:59:05.888473 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-e9062607-8f68-49c6-b058-f3c0796da2db tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:59:05.889074 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-e9062607-8f68-49c6-b058-f3c0796da2db tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] [instance: 191fca7f-a39d-4a31-9be0-b655f49aea35] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:59:05.896505 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-e9062607-8f68-49c6-b058-f3c0796da2db tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:59:05.897036 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-e9062607-8f68-49c6-b058-f3c0796da2db tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:59:05.897511 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-e9062607-8f68-49c6-b058-f3c0796da2db tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:59:05.898289 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-e9062607-8f68-49c6-b058-f3c0796da2db tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:59:05.898748 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-e9062607-8f68-49c6-b058-f3c0796da2db tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:59:05.899276 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-e9062607-8f68-49c6-b058-f3c0796da2db tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:59:06.045847 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-e9062607-8f68-49c6-b058-f3c0796da2db tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583cce1547144e11978f20a3193ceba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f8b5024a194f70a9f7689ac44ab07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:59:06.054998 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-e9062607-8f68-49c6-b058-f3c0796da2db tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] 10.222.0.36 "GET /compute/v2.1/servers/191fca7f-a39d-4a31-9be0-b655f49aea35" status: 200 len: 1674 microversion: 2.1 time: 0.171801 Oct 15 13:59:06.055616 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 520/1033] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:59:05 2022] GET /compute/v2.1/servers/191fca7f-a39d-4a31-9be0-b655f49aea35 => generated 1674 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:59:06.700398 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-7e39cdf2-31fc-480c-a527-8961310916a6 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:59:06.700973 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-7e39cdf2-31fc-480c-a527-8961310916a6 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] [instance: 1c2ec1ba-e381-4083-a794-c8ff83beb391] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:59:06.708052 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-7e39cdf2-31fc-480c-a527-8961310916a6 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:59:06.708719 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-7e39cdf2-31fc-480c-a527-8961310916a6 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:59:06.709186 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-7e39cdf2-31fc-480c-a527-8961310916a6 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:59:06.709926 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-7e39cdf2-31fc-480c-a527-8961310916a6 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:59:06.710385 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-7e39cdf2-31fc-480c-a527-8961310916a6 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:59:06.710817 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-7e39cdf2-31fc-480c-a527-8961310916a6 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:59:06.870566 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-7e39cdf2-31fc-480c-a527-8961310916a6 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10fc1a48c9c41eaa1bf3ff2e4109657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1976b27e84a4484ba9d46a4244b08699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:59:06.878661 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-7e39cdf2-31fc-480c-a527-8961310916a6 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] 10.222.0.36 "GET /compute/v2.1/servers/1c2ec1ba-e381-4083-a794-c8ff83beb391" status: 200 len: 1366 microversion: 2.1 time: 0.182363 Oct 15 13:59:06.879243 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 514/1034] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:59:06 2022] GET /compute/v2.1/servers/1c2ec1ba-e381-4083-a794-c8ff83beb391 => generated 1366 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:59:07.078729 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-ffb42978-ef22-40a6-b29a-1d8a44f5393f tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:59:07.079294 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-ffb42978-ef22-40a6-b29a-1d8a44f5393f tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] [instance: 191fca7f-a39d-4a31-9be0-b655f49aea35] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:59:07.086446 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-ffb42978-ef22-40a6-b29a-1d8a44f5393f tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:59:07.086947 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-ffb42978-ef22-40a6-b29a-1d8a44f5393f tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:59:07.087393 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-ffb42978-ef22-40a6-b29a-1d8a44f5393f tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:59:07.088145 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-ffb42978-ef22-40a6-b29a-1d8a44f5393f tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:59:07.088612 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-ffb42978-ef22-40a6-b29a-1d8a44f5393f tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:59:07.089071 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-ffb42978-ef22-40a6-b29a-1d8a44f5393f tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:59:07.349740 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-ffb42978-ef22-40a6-b29a-1d8a44f5393f tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583cce1547144e11978f20a3193ceba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f8b5024a194f70a9f7689ac44ab07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:59:07.358591 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-ffb42978-ef22-40a6-b29a-1d8a44f5393f tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] 10.222.0.36 "GET /compute/v2.1/servers/191fca7f-a39d-4a31-9be0-b655f49aea35" status: 200 len: 1674 microversion: 2.1 time: 0.283880 Oct 15 13:59:07.359407 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 521/1035] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:59:07 2022] GET /compute/v2.1/servers/191fca7f-a39d-4a31-9be0-b655f49aea35 => generated 1674 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:59:07.903115 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-f2208d53-2f03-47e4-9bda-e10d3291afbb tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:59:07.904102 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-f2208d53-2f03-47e4-9bda-e10d3291afbb tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] [instance: 1c2ec1ba-e381-4083-a794-c8ff83beb391] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:59:07.912120 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-f2208d53-2f03-47e4-9bda-e10d3291afbb tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:59:07.912665 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-f2208d53-2f03-47e4-9bda-e10d3291afbb tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:59:07.913128 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-f2208d53-2f03-47e4-9bda-e10d3291afbb tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:59:07.913935 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-f2208d53-2f03-47e4-9bda-e10d3291afbb tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:59:07.914778 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-f2208d53-2f03-47e4-9bda-e10d3291afbb tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:59:07.915406 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-f2208d53-2f03-47e4-9bda-e10d3291afbb tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:59:08.384087 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-73964372-746c-4d45-9f9c-196e15941e11 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:59:08.384835 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-73964372-746c-4d45-9f9c-196e15941e11 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] [instance: 191fca7f-a39d-4a31-9be0-b655f49aea35] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:59:08.399472 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-73964372-746c-4d45-9f9c-196e15941e11 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:59:08.400373 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-73964372-746c-4d45-9f9c-196e15941e11 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:59:08.401150 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-73964372-746c-4d45-9f9c-196e15941e11 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:59:08.402438 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-73964372-746c-4d45-9f9c-196e15941e11 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:59:08.403276 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-73964372-746c-4d45-9f9c-196e15941e11 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:59:08.404059 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-73964372-746c-4d45-9f9c-196e15941e11 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:59:08.461459 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-f2208d53-2f03-47e4-9bda-e10d3291afbb tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10fc1a48c9c41eaa1bf3ff2e4109657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1976b27e84a4484ba9d46a4244b08699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:59:08.471653 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-f2208d53-2f03-47e4-9bda-e10d3291afbb tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] 10.222.0.36 "GET /compute/v2.1/servers/1c2ec1ba-e381-4083-a794-c8ff83beb391" status: 200 len: 1557 microversion: 2.1 time: 0.572621 Oct 15 13:59:08.475103 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 515/1036] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:59:07 2022] GET /compute/v2.1/servers/1c2ec1ba-e381-4083-a794-c8ff83beb391 => generated 1557 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:59:08.481760 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [req-a5dcb60a-8191-43d4-8d8c-0da048025a3b req-8eca9ff6-5757-4ba6-bb00-8bab6946a047 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "191fca7f-a39d-4a31-9be0-b655f49aea35", "name": "network-vif-deleted", "tag": "ffaa042f-4e73-43a4-964a-886d1dc0d768"}]} {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 13:59:08.493579 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [req-a5dcb60a-8191-43d4-8d8c-0da048025a3b req-8eca9ff6-5757-4ba6-bb00-8bab6946a047 service nova] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:59:08.494347 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [req-a5dcb60a-8191-43d4-8d8c-0da048025a3b req-8eca9ff6-5757-4ba6-bb00-8bab6946a047 service nova] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:59:08.494948 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [req-a5dcb60a-8191-43d4-8d8c-0da048025a3b req-8eca9ff6-5757-4ba6-bb00-8bab6946a047 service nova] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:59:08.512721 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.compute.server_external_events [req-a5dcb60a-8191-43d4-8d8c-0da048025a3b req-8eca9ff6-5757-4ba6-bb00-8bab6946a047 service nova] Creating event network-vif-deleted:ffaa042f-4e73-43a4-964a-886d1dc0d768 for instance 191fca7f-a39d-4a31-9be0-b655f49aea35 on hv-cinder-86149 Oct 15 13:59:08.519568 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-73964372-746c-4d45-9f9c-196e15941e11 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583cce1547144e11978f20a3193ceba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f8b5024a194f70a9f7689ac44ab07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:59:08.523395 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [req-a5dcb60a-8191-43d4-8d8c-0da048025a3b req-8eca9ff6-5757-4ba6-bb00-8bab6946a047 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045954 Oct 15 13:59:08.524856 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 516/1037] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 15 13:59:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 13:59:08.530951 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-c0bb04d0-82f3-400f-9699-828dec474b3c tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:59:08.531503 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-c0bb04d0-82f3-400f-9699-828dec474b3c tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] [instance: 1c2ec1ba-e381-4083-a794-c8ff83beb391] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:59:08.532029 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-73964372-746c-4d45-9f9c-196e15941e11 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] 10.222.0.36 "GET /compute/v2.1/servers/191fca7f-a39d-4a31-9be0-b655f49aea35" status: 200 len: 1606 microversion: 2.1 time: 0.153201 Oct 15 13:59:08.533723 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 522/1038] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:59:08 2022] GET /compute/v2.1/servers/191fca7f-a39d-4a31-9be0-b655f49aea35 => generated 1606 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:59:08.538280 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-c0bb04d0-82f3-400f-9699-828dec474b3c tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:59:08.539046 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-c0bb04d0-82f3-400f-9699-828dec474b3c tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:59:08.539473 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-c0bb04d0-82f3-400f-9699-828dec474b3c tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:59:08.540210 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-c0bb04d0-82f3-400f-9699-828dec474b3c tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:59:08.540671 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-c0bb04d0-82f3-400f-9699-828dec474b3c tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:59:08.541075 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-c0bb04d0-82f3-400f-9699-828dec474b3c tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:59:08.628458 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-c0bb04d0-82f3-400f-9699-828dec474b3c tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] 10.222.0.36 "GET /compute/v2.1/servers/1c2ec1ba-e381-4083-a794-c8ff83beb391/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.101968 Oct 15 13:59:08.629200 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 517/1039] 10.222.0.36 () {58 vars in 1275 bytes} [Sat Oct 15 13:59:08 2022] GET /compute/v2.1/servers/1c2ec1ba-e381-4083-a794-c8ff83beb391/os-interface => generated 285 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 13:59:09.560379 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-717e34ae-1d61-4ddb-9cb9-ec50b7774719 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:59:09.561189 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-717e34ae-1d61-4ddb-9cb9-ec50b7774719 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] [instance: 191fca7f-a39d-4a31-9be0-b655f49aea35] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:59:09.569157 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-717e34ae-1d61-4ddb-9cb9-ec50b7774719 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:59:09.569695 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-717e34ae-1d61-4ddb-9cb9-ec50b7774719 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:59:09.570353 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-717e34ae-1d61-4ddb-9cb9-ec50b7774719 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:59:09.571244 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-717e34ae-1d61-4ddb-9cb9-ec50b7774719 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:59:09.571741 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-717e34ae-1d61-4ddb-9cb9-ec50b7774719 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:59:09.572223 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-717e34ae-1d61-4ddb-9cb9-ec50b7774719 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:59:09.588575 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.wsgi [None req-717e34ae-1d61-4ddb-9cb9-ec50b7774719 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] HTTP exception thrown: Instance 191fca7f-a39d-4a31-9be0-b655f49aea35 could not be found. Oct 15 13:59:09.590284 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-717e34ae-1d61-4ddb-9cb9-ec50b7774719 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Request method failure captured: Oct 15 13:59:09.590284 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: request: GET /compute/v2.1/servers/191fca7f-a39d-4a31-9be0-b655f49aea35 HTTP/1.1 Oct 15 13:59:09.590284 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Accept: application/json Oct 15 13:59:09.590284 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Accept-Encoding: identity Oct 15 13:59:09.590284 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Connection: close Oct 15 13:59:09.590284 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Content-Length: 0 Oct 15 13:59:09.590284 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Content-Type: application/json Oct 15 13:59:09.590284 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Host: 10.222.0.36 Oct 15 13:59:09.590284 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Openstack-System-Scope: None Oct 15 13:59:09.590284 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: User-Agent: python-urllib3/1.26.12 Oct 15 13:59:09.590284 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Auth-Token: gAAAAABjSrpEAEOvDYjQezlGXzh6XU2_Vl1KBLwmS9gwC61GtyVLxYlkshQyDPE_sOvB3OtB_cqctzpwbfjy2ZDsnCTYXEb6mgK25wVyiDmdp0o_CExIrnzjNhyInosPlpO2f8fIz0chymblvX9P3h-X24ZWwfGBe-8aG83eRywSSE77yc5-RNk Oct 15 13:59:09.590284 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Domain-Id: None Oct 15 13:59:09.590284 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Domain-Name: None Oct 15 13:59:09.590284 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Identity-Status: Confirmed Oct 15 13:59:09.590284 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Is-Admin-Project: True Oct 15 13:59:09.590284 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Project-Domain-Id: default Oct 15 13:59:09.590284 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Project-Domain-Name: Default Oct 15 13:59:09.590284 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Project-Id: 35f8b5024a194f70a9f7689ac44ab07b Oct 15 13:59:09.590284 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Project-Name: tempest-AttachVolumeTestJSON-908525129 Oct 15 13:59:09.590284 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Role: member,reader Oct 15 13:59:09.590284 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Roles: member,reader Oct 15 13:59:09.591694 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_35f8b5024a194f70a9f7689ac44ab07b", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/35f8b5024a194f70a9f7689ac44ab07b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/35f8b5024a194f70a9f7689ac44ab07b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/35f8b5024a194f70a9f7689ac44ab07b"}]}] Oct 15 13:59:09.591694 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Tenant: tempest-AttachVolumeTestJSON-908525129 Oct 15 13:59:09.591694 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Tenant-Id: 35f8b5024a194f70a9f7689ac44ab07b Oct 15 13:59:09.591694 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Tenant-Name: tempest-AttachVolumeTestJSON-908525129 Oct 15 13:59:09.591694 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-User: tempest-AttachVolumeTestJSON-908525129-project Oct 15 13:59:09.591694 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-User-Domain-Id: default Oct 15 13:59:09.591694 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-User-Domain-Name: Default Oct 15 13:59:09.591694 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-User-Id: 583cce1547144e11978f20a3193ceba4 Oct 15 13:59:09.591694 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-User-Name: tempest-AttachVolumeTestJSON-908525129-project Oct 15 13:59:09.591694 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: method: > Oct 15 13:59:09.591694 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: exception: Instance 191fca7f-a39d-4a31-9be0-b655f49aea35 could not be found. Oct 15 13:59:09.591694 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: action_args: {'id': '191fca7f-a39d-4a31-9be0-b655f49aea35'} Oct 15 13:59:09.592748 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 15 13:59:09.592748 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 13:59:09.592748 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 15 13:59:09.592748 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 15 13:59:09.592748 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 15 13:59:09.592748 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 15 13:59:09.592748 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 15 13:59:09.592748 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 15 13:59:09.592748 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 15 13:59:09.592748 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 15 13:59:09.592748 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 191fca7f-a39d-4a31-9be0-b655f49aea35 could not be found. Oct 15 13:59:09.592748 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Oct 15 13:59:09.592748 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 13:59:09.592748 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Oct 15 13:59:09.592748 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 13:59:09.592748 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 13:59:09.592748 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 13:59:09.592748 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 15 13:59:09.592748 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 15 13:59:09.592748 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 15 13:59:09.594018 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 15 13:59:09.594018 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 15 13:59:09.594018 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 15 13:59:09.594018 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 15 13:59:09.594018 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 15 13:59:09.594018 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 15 13:59:09.594018 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 15 13:59:09.594018 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 191fca7f-a39d-4a31-9be0-b655f49aea35 could not be found. Oct 15 13:59:09.594018 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Oct 15 13:59:09.594018 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 13:59:09.594018 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Oct 15 13:59:09.594018 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 13:59:09.594018 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 13:59:09.594018 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 13:59:09.594018 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 15 13:59:09.594018 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 15 13:59:09.594018 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 191fca7f-a39d-4a31-9be0-b655f49aea35 could not be found. Oct 15 13:59:09.594018 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Oct 15 13:59:09.596412 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-717e34ae-1d61-4ddb-9cb9-ec50b7774719 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Returning 404 to user: Instance 191fca7f-a39d-4a31-9be0-b655f49aea35 could not be found. {{(pid=125242) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 15 13:59:09.597304 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-717e34ae-1d61-4ddb-9cb9-ec50b7774719 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] 10.222.0.36 "GET /compute/v2.1/servers/191fca7f-a39d-4a31-9be0-b655f49aea35" status: 404 len: 111 microversion: 2.1 time: 0.041903 Oct 15 13:59:09.597898 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 523/1040] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:59:09 2022] GET /compute/v2.1/servers/191fca7f-a39d-4a31-9be0-b655f49aea35 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 15 13:59:09.608530 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-d79dcb55-2e86-4cd7-a58a-584ecf8938bc tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Calling method '.version_select at 0x7f1b5e33e700>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:59:09.633667 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-d79dcb55-2e86-4cd7-a58a-584ecf8938bc tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1992153869" status: 202 len: 0 microversion: 2.1 time: 0.030486 Oct 15 13:59:09.634268 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 518/1041] 10.222.0.36 () {58 vars in 1221 bytes} [Sat Oct 15 13:59:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1992153869 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 15 13:59:09.806013 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [req-0c7bd8bc-eb33-4fe2-890d-4183de9d1357 req-ccdd6aa5-2259-4ca0-bf40-a29adc8e0246 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c2ec1ba-e381-4083-a794-c8ff83beb391", "tag": "8f1ff711-16b3-41c3-ab0a-c21d959b5f7c"}]} {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 13:59:09.816269 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [req-0c7bd8bc-eb33-4fe2-890d-4183de9d1357 req-ccdd6aa5-2259-4ca0-bf40-a29adc8e0246 service nova] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:59:09.817165 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [req-0c7bd8bc-eb33-4fe2-890d-4183de9d1357 req-ccdd6aa5-2259-4ca0-bf40-a29adc8e0246 service nova] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:59:09.817766 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [req-0c7bd8bc-eb33-4fe2-890d-4183de9d1357 req-ccdd6aa5-2259-4ca0-bf40-a29adc8e0246 service nova] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:59:09.830870 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.compute.server_external_events [req-0c7bd8bc-eb33-4fe2-890d-4183de9d1357 req-ccdd6aa5-2259-4ca0-bf40-a29adc8e0246 service nova] Creating event network-changed:8f1ff711-16b3-41c3-ab0a-c21d959b5f7c for instance 1c2ec1ba-e381-4083-a794-c8ff83beb391 on hv-cinder-86149 Oct 15 13:59:09.837055 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [req-0c7bd8bc-eb33-4fe2-890d-4183de9d1357 req-ccdd6aa5-2259-4ca0-bf40-a29adc8e0246 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035503 Oct 15 13:59:09.837963 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 524/1042] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 15 13:59:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 13:59:12.760186 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-6f77e651-7fec-4ef2-acb3-a1a8ecdc7953 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:59:12.760736 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-6f77e651-7fec-4ef2-acb3-a1a8ecdc7953 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] [instance: 191fca7f-a39d-4a31-9be0-b655f49aea35] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:59:12.767987 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-6f77e651-7fec-4ef2-acb3-a1a8ecdc7953 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:59:12.768474 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-6f77e651-7fec-4ef2-acb3-a1a8ecdc7953 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:59:12.768934 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-6f77e651-7fec-4ef2-acb3-a1a8ecdc7953 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:59:12.769597 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-6f77e651-7fec-4ef2-acb3-a1a8ecdc7953 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:59:12.770043 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-6f77e651-7fec-4ef2-acb3-a1a8ecdc7953 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:59:12.770469 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-6f77e651-7fec-4ef2-acb3-a1a8ecdc7953 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:59:12.784099 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.wsgi [None req-6f77e651-7fec-4ef2-acb3-a1a8ecdc7953 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] HTTP exception thrown: Instance 191fca7f-a39d-4a31-9be0-b655f49aea35 could not be found. Oct 15 13:59:12.785832 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-6f77e651-7fec-4ef2-acb3-a1a8ecdc7953 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Request method failure captured: Oct 15 13:59:12.785832 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: request: DELETE /compute/v2.1/servers/191fca7f-a39d-4a31-9be0-b655f49aea35 HTTP/1.1 Oct 15 13:59:12.785832 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: Accept: application/json Oct 15 13:59:12.785832 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: Accept-Encoding: identity Oct 15 13:59:12.785832 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: Connection: close Oct 15 13:59:12.785832 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: Content-Length: 0 Oct 15 13:59:12.785832 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: Content-Type: application/json Oct 15 13:59:12.785832 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: Host: 10.222.0.36 Oct 15 13:59:12.785832 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: Openstack-System-Scope: None Oct 15 13:59:12.785832 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: User-Agent: python-urllib3/1.26.12 Oct 15 13:59:12.785832 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Auth-Token: gAAAAABjSrpEAEOvDYjQezlGXzh6XU2_Vl1KBLwmS9gwC61GtyVLxYlkshQyDPE_sOvB3OtB_cqctzpwbfjy2ZDsnCTYXEb6mgK25wVyiDmdp0o_CExIrnzjNhyInosPlpO2f8fIz0chymblvX9P3h-X24ZWwfGBe-8aG83eRywSSE77yc5-RNk Oct 15 13:59:12.785832 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Domain-Id: None Oct 15 13:59:12.785832 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Domain-Name: None Oct 15 13:59:12.785832 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Identity-Status: Confirmed Oct 15 13:59:12.785832 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Is-Admin-Project: True Oct 15 13:59:12.785832 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Project-Domain-Id: default Oct 15 13:59:12.785832 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Project-Domain-Name: Default Oct 15 13:59:12.785832 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Project-Id: 35f8b5024a194f70a9f7689ac44ab07b Oct 15 13:59:12.785832 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Project-Name: tempest-AttachVolumeTestJSON-908525129 Oct 15 13:59:12.785832 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Role: member,reader Oct 15 13:59:12.785832 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Roles: member,reader Oct 15 13:59:12.788230 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_35f8b5024a194f70a9f7689ac44ab07b", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/35f8b5024a194f70a9f7689ac44ab07b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/35f8b5024a194f70a9f7689ac44ab07b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/35f8b5024a194f70a9f7689ac44ab07b"}]}] Oct 15 13:59:12.788230 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Tenant: tempest-AttachVolumeTestJSON-908525129 Oct 15 13:59:12.788230 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Tenant-Id: 35f8b5024a194f70a9f7689ac44ab07b Oct 15 13:59:12.788230 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Tenant-Name: tempest-AttachVolumeTestJSON-908525129 Oct 15 13:59:12.788230 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-User: tempest-AttachVolumeTestJSON-908525129-project Oct 15 13:59:12.788230 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-User-Domain-Id: default Oct 15 13:59:12.788230 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-User-Domain-Name: Default Oct 15 13:59:12.788230 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-User-Id: 583cce1547144e11978f20a3193ceba4 Oct 15 13:59:12.788230 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-User-Name: tempest-AttachVolumeTestJSON-908525129-project Oct 15 13:59:12.788230 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: method: > Oct 15 13:59:12.788230 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: exception: Instance 191fca7f-a39d-4a31-9be0-b655f49aea35 could not be found. Oct 15 13:59:12.788230 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: action_args: {'id': '191fca7f-a39d-4a31-9be0-b655f49aea35'} Oct 15 13:59:12.789219 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 15 13:59:12.789219 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 13:59:12.789219 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 15 13:59:12.789219 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 15 13:59:12.789219 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 15 13:59:12.789219 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 15 13:59:12.789219 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 15 13:59:12.789219 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 15 13:59:12.789219 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 15 13:59:12.789219 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 15 13:59:12.789219 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 191fca7f-a39d-4a31-9be0-b655f49aea35 could not be found. Oct 15 13:59:12.789219 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Oct 15 13:59:12.789219 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 13:59:12.789219 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Oct 15 13:59:12.789219 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 13:59:12.789219 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 13:59:12.789219 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 13:59:12.789219 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 15 13:59:12.789219 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 15 13:59:12.789219 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 15 13:59:12.790713 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 15 13:59:12.790713 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 15 13:59:12.790713 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 15 13:59:12.790713 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 15 13:59:12.790713 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 15 13:59:12.790713 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 15 13:59:12.790713 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 15 13:59:12.790713 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 15 13:59:12.790713 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 15 13:59:12.790713 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 191fca7f-a39d-4a31-9be0-b655f49aea35 could not be found. Oct 15 13:59:12.790713 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Oct 15 13:59:12.790713 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 13:59:12.790713 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Oct 15 13:59:12.790713 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 13:59:12.790713 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 13:59:12.790713 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 13:59:12.790713 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 15 13:59:12.790713 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 15 13:59:12.790713 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 191fca7f-a39d-4a31-9be0-b655f49aea35 could not be found. Oct 15 13:59:12.790713 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Oct 15 13:59:12.792267 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-6f77e651-7fec-4ef2-acb3-a1a8ecdc7953 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Returning 404 to user: Instance 191fca7f-a39d-4a31-9be0-b655f49aea35 could not be found. {{(pid=125243) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 15 13:59:12.792267 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-6f77e651-7fec-4ef2-acb3-a1a8ecdc7953 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] 10.222.0.36 "DELETE /compute/v2.1/servers/191fca7f-a39d-4a31-9be0-b655f49aea35" status: 404 len: 111 microversion: 2.1 time: 0.031872 Oct 15 13:59:12.792267 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 519/1043] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 15 13:59:12 2022] DELETE /compute/v2.1/servers/191fca7f-a39d-4a31-9be0-b655f49aea35 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 15 13:59:12.797707 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-b70c0556-e770-4697-9014-d45b045a7d2a tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:59:12.798407 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-b70c0556-e770-4697-9014-d45b045a7d2a tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] [instance: 191fca7f-a39d-4a31-9be0-b655f49aea35] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:59:12.805365 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-b70c0556-e770-4697-9014-d45b045a7d2a tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:59:12.805963 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-b70c0556-e770-4697-9014-d45b045a7d2a tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:59:12.806401 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-b70c0556-e770-4697-9014-d45b045a7d2a tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:59:12.807150 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-b70c0556-e770-4697-9014-d45b045a7d2a tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:59:12.807600 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-b70c0556-e770-4697-9014-d45b045a7d2a tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:59:12.808068 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-b70c0556-e770-4697-9014-d45b045a7d2a tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:59:12.822454 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.wsgi [None req-b70c0556-e770-4697-9014-d45b045a7d2a tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] HTTP exception thrown: Instance 191fca7f-a39d-4a31-9be0-b655f49aea35 could not be found. Oct 15 13:59:12.824170 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-b70c0556-e770-4697-9014-d45b045a7d2a tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Request method failure captured: Oct 15 13:59:12.824170 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: request: GET /compute/v2.1/servers/191fca7f-a39d-4a31-9be0-b655f49aea35 HTTP/1.1 Oct 15 13:59:12.824170 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Accept: application/json Oct 15 13:59:12.824170 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Accept-Encoding: identity Oct 15 13:59:12.824170 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Connection: close Oct 15 13:59:12.824170 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Content-Length: 0 Oct 15 13:59:12.824170 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Content-Type: application/json Oct 15 13:59:12.824170 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Host: 10.222.0.36 Oct 15 13:59:12.824170 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Openstack-System-Scope: None Oct 15 13:59:12.824170 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: User-Agent: python-urllib3/1.26.12 Oct 15 13:59:12.824170 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Auth-Token: gAAAAABjSrpEAEOvDYjQezlGXzh6XU2_Vl1KBLwmS9gwC61GtyVLxYlkshQyDPE_sOvB3OtB_cqctzpwbfjy2ZDsnCTYXEb6mgK25wVyiDmdp0o_CExIrnzjNhyInosPlpO2f8fIz0chymblvX9P3h-X24ZWwfGBe-8aG83eRywSSE77yc5-RNk Oct 15 13:59:12.824170 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Domain-Id: None Oct 15 13:59:12.824170 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Domain-Name: None Oct 15 13:59:12.824170 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Identity-Status: Confirmed Oct 15 13:59:12.824170 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Is-Admin-Project: True Oct 15 13:59:12.824170 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Project-Domain-Id: default Oct 15 13:59:12.824170 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Project-Domain-Name: Default Oct 15 13:59:12.824170 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Project-Id: 35f8b5024a194f70a9f7689ac44ab07b Oct 15 13:59:12.824170 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Project-Name: tempest-AttachVolumeTestJSON-908525129 Oct 15 13:59:12.824170 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Role: member,reader Oct 15 13:59:12.824170 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Roles: member,reader Oct 15 13:59:12.825672 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_35f8b5024a194f70a9f7689ac44ab07b", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/35f8b5024a194f70a9f7689ac44ab07b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/35f8b5024a194f70a9f7689ac44ab07b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/35f8b5024a194f70a9f7689ac44ab07b"}]}] Oct 15 13:59:12.825672 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Tenant: tempest-AttachVolumeTestJSON-908525129 Oct 15 13:59:12.825672 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Tenant-Id: 35f8b5024a194f70a9f7689ac44ab07b Oct 15 13:59:12.825672 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Tenant-Name: tempest-AttachVolumeTestJSON-908525129 Oct 15 13:59:12.825672 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-User: tempest-AttachVolumeTestJSON-908525129-project Oct 15 13:59:12.825672 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-User-Domain-Id: default Oct 15 13:59:12.825672 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-User-Domain-Name: Default Oct 15 13:59:12.825672 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-User-Id: 583cce1547144e11978f20a3193ceba4 Oct 15 13:59:12.825672 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-User-Name: tempest-AttachVolumeTestJSON-908525129-project Oct 15 13:59:12.825672 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: method: > Oct 15 13:59:12.825672 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: exception: Instance 191fca7f-a39d-4a31-9be0-b655f49aea35 could not be found. Oct 15 13:59:12.825672 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: action_args: {'id': '191fca7f-a39d-4a31-9be0-b655f49aea35'} Oct 15 13:59:12.826612 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 15 13:59:12.826612 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 13:59:12.826612 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 15 13:59:12.826612 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 15 13:59:12.826612 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 15 13:59:12.826612 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 15 13:59:12.826612 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 15 13:59:12.826612 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 15 13:59:12.826612 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 15 13:59:12.826612 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 15 13:59:12.826612 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 191fca7f-a39d-4a31-9be0-b655f49aea35 could not be found. Oct 15 13:59:12.826612 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Oct 15 13:59:12.826612 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 13:59:12.826612 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Oct 15 13:59:12.826612 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 13:59:12.826612 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 13:59:12.826612 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 13:59:12.826612 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 15 13:59:12.826612 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 15 13:59:12.826612 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 15 13:59:12.828194 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 15 13:59:12.828194 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 15 13:59:12.828194 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 15 13:59:12.828194 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 15 13:59:12.828194 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 15 13:59:12.828194 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 15 13:59:12.828194 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 15 13:59:12.828194 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 191fca7f-a39d-4a31-9be0-b655f49aea35 could not be found. Oct 15 13:59:12.828194 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Oct 15 13:59:12.828194 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 13:59:12.828194 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Oct 15 13:59:12.828194 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 13:59:12.828194 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 13:59:12.828194 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 13:59:12.828194 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 15 13:59:12.828194 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 15 13:59:12.828194 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 191fca7f-a39d-4a31-9be0-b655f49aea35 could not be found. Oct 15 13:59:12.828194 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Oct 15 13:59:12.829529 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-b70c0556-e770-4697-9014-d45b045a7d2a tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Returning 404 to user: Instance 191fca7f-a39d-4a31-9be0-b655f49aea35 could not be found. {{(pid=125242) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 15 13:59:12.829529 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-b70c0556-e770-4697-9014-d45b045a7d2a tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] 10.222.0.36 "GET /compute/v2.1/servers/191fca7f-a39d-4a31-9be0-b655f49aea35" status: 404 len: 111 microversion: 2.1 time: 0.032898 Oct 15 13:59:12.829529 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 525/1044] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:59:12 2022] GET /compute/v2.1/servers/191fca7f-a39d-4a31-9be0-b655f49aea35 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 15 13:59:13.980624 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-ee1e16e8-e645-4754-80e3-dcd8d8a642db tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:59:13.981161 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-ee1e16e8-e645-4754-80e3-dcd8d8a642db tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] [instance: 40d67d09-379e-4c12-b36c-21edf3b23e45] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:59:13.988213 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-ee1e16e8-e645-4754-80e3-dcd8d8a642db tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:59:13.988706 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-ee1e16e8-e645-4754-80e3-dcd8d8a642db tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:59:13.989147 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-ee1e16e8-e645-4754-80e3-dcd8d8a642db tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:59:13.989848 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-ee1e16e8-e645-4754-80e3-dcd8d8a642db tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:59:13.990303 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-ee1e16e8-e645-4754-80e3-dcd8d8a642db tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:59:13.990731 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-ee1e16e8-e645-4754-80e3-dcd8d8a642db tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:59:14.004918 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.wsgi [None req-ee1e16e8-e645-4754-80e3-dcd8d8a642db tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] HTTP exception thrown: Instance 40d67d09-379e-4c12-b36c-21edf3b23e45 could not be found. Oct 15 13:59:14.006665 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-ee1e16e8-e645-4754-80e3-dcd8d8a642db tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Request method failure captured: Oct 15 13:59:14.006665 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: request: DELETE /compute/v2.1/servers/40d67d09-379e-4c12-b36c-21edf3b23e45 HTTP/1.1 Oct 15 13:59:14.006665 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: Accept: application/json Oct 15 13:59:14.006665 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: Accept-Encoding: identity Oct 15 13:59:14.006665 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: Connection: close Oct 15 13:59:14.006665 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: Content-Length: 0 Oct 15 13:59:14.006665 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: Content-Type: application/json Oct 15 13:59:14.006665 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: Host: 10.222.0.36 Oct 15 13:59:14.006665 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: Openstack-System-Scope: None Oct 15 13:59:14.006665 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: User-Agent: python-urllib3/1.26.12 Oct 15 13:59:14.006665 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Auth-Token: gAAAAABjSrpEAEOvDYjQezlGXzh6XU2_Vl1KBLwmS9gwC61GtyVLxYlkshQyDPE_sOvB3OtB_cqctzpwbfjy2ZDsnCTYXEb6mgK25wVyiDmdp0o_CExIrnzjNhyInosPlpO2f8fIz0chymblvX9P3h-X24ZWwfGBe-8aG83eRywSSE77yc5-RNk Oct 15 13:59:14.006665 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Domain-Id: None Oct 15 13:59:14.006665 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Domain-Name: None Oct 15 13:59:14.006665 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Identity-Status: Confirmed Oct 15 13:59:14.006665 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Is-Admin-Project: True Oct 15 13:59:14.006665 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Project-Domain-Id: default Oct 15 13:59:14.006665 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Project-Domain-Name: Default Oct 15 13:59:14.006665 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Project-Id: 35f8b5024a194f70a9f7689ac44ab07b Oct 15 13:59:14.006665 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Project-Name: tempest-AttachVolumeTestJSON-908525129 Oct 15 13:59:14.006665 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Role: member,reader Oct 15 13:59:14.006665 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Roles: member,reader Oct 15 13:59:14.008412 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_35f8b5024a194f70a9f7689ac44ab07b", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/35f8b5024a194f70a9f7689ac44ab07b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/35f8b5024a194f70a9f7689ac44ab07b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/35f8b5024a194f70a9f7689ac44ab07b"}]}] Oct 15 13:59:14.008412 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Tenant: tempest-AttachVolumeTestJSON-908525129 Oct 15 13:59:14.008412 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Tenant-Id: 35f8b5024a194f70a9f7689ac44ab07b Oct 15 13:59:14.008412 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Tenant-Name: tempest-AttachVolumeTestJSON-908525129 Oct 15 13:59:14.008412 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-User: tempest-AttachVolumeTestJSON-908525129-project Oct 15 13:59:14.008412 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-User-Domain-Id: default Oct 15 13:59:14.008412 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-User-Domain-Name: Default Oct 15 13:59:14.008412 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-User-Id: 583cce1547144e11978f20a3193ceba4 Oct 15 13:59:14.008412 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-User-Name: tempest-AttachVolumeTestJSON-908525129-project Oct 15 13:59:14.008412 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: method: > Oct 15 13:59:14.008412 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: exception: Instance 40d67d09-379e-4c12-b36c-21edf3b23e45 could not be found. Oct 15 13:59:14.008412 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: action_args: {'id': '40d67d09-379e-4c12-b36c-21edf3b23e45'} Oct 15 13:59:14.009283 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 15 13:59:14.009283 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 13:59:14.009283 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 15 13:59:14.009283 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 15 13:59:14.009283 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 15 13:59:14.009283 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 15 13:59:14.009283 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 15 13:59:14.009283 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 15 13:59:14.009283 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 15 13:59:14.009283 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 15 13:59:14.009283 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40d67d09-379e-4c12-b36c-21edf3b23e45 could not be found. Oct 15 13:59:14.009283 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Oct 15 13:59:14.009283 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 13:59:14.009283 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Oct 15 13:59:14.009283 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 13:59:14.009283 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 13:59:14.009283 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 13:59:14.009283 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 15 13:59:14.009283 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 15 13:59:14.009283 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 15 13:59:14.010641 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 15 13:59:14.010641 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 15 13:59:14.010641 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 15 13:59:14.010641 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 15 13:59:14.010641 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 15 13:59:14.010641 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 15 13:59:14.010641 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 15 13:59:14.010641 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 15 13:59:14.010641 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 15 13:59:14.010641 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40d67d09-379e-4c12-b36c-21edf3b23e45 could not be found. Oct 15 13:59:14.010641 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Oct 15 13:59:14.010641 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 13:59:14.010641 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Oct 15 13:59:14.010641 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 13:59:14.010641 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 13:59:14.010641 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 13:59:14.010641 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 15 13:59:14.010641 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 15 13:59:14.010641 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40d67d09-379e-4c12-b36c-21edf3b23e45 could not be found. Oct 15 13:59:14.010641 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Oct 15 13:59:14.012214 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-ee1e16e8-e645-4754-80e3-dcd8d8a642db tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Returning 404 to user: Instance 40d67d09-379e-4c12-b36c-21edf3b23e45 could not be found. {{(pid=125243) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 15 13:59:14.012214 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-ee1e16e8-e645-4754-80e3-dcd8d8a642db tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] 10.222.0.36 "DELETE /compute/v2.1/servers/40d67d09-379e-4c12-b36c-21edf3b23e45" status: 404 len: 111 microversion: 2.1 time: 0.032401 Oct 15 13:59:14.012214 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 520/1045] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 15 13:59:13 2022] DELETE /compute/v2.1/servers/40d67d09-379e-4c12-b36c-21edf3b23e45 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 15 13:59:14.017217 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-28a76a80-e408-4455-84a2-14ef8c078f10 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:59:14.017859 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-28a76a80-e408-4455-84a2-14ef8c078f10 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] [instance: 40d67d09-379e-4c12-b36c-21edf3b23e45] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:59:14.024773 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-28a76a80-e408-4455-84a2-14ef8c078f10 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:59:14.025258 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-28a76a80-e408-4455-84a2-14ef8c078f10 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:59:14.025690 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-28a76a80-e408-4455-84a2-14ef8c078f10 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:59:14.026380 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-28a76a80-e408-4455-84a2-14ef8c078f10 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:59:14.026830 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-28a76a80-e408-4455-84a2-14ef8c078f10 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:59:14.027252 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-28a76a80-e408-4455-84a2-14ef8c078f10 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:59:14.042954 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.wsgi [None req-28a76a80-e408-4455-84a2-14ef8c078f10 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] HTTP exception thrown: Instance 40d67d09-379e-4c12-b36c-21edf3b23e45 could not be found. Oct 15 13:59:14.044552 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-28a76a80-e408-4455-84a2-14ef8c078f10 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Request method failure captured: Oct 15 13:59:14.044552 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: request: GET /compute/v2.1/servers/40d67d09-379e-4c12-b36c-21edf3b23e45 HTTP/1.1 Oct 15 13:59:14.044552 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Accept: application/json Oct 15 13:59:14.044552 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Accept-Encoding: identity Oct 15 13:59:14.044552 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Connection: close Oct 15 13:59:14.044552 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Content-Length: 0 Oct 15 13:59:14.044552 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Content-Type: application/json Oct 15 13:59:14.044552 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Host: 10.222.0.36 Oct 15 13:59:14.044552 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Openstack-System-Scope: None Oct 15 13:59:14.044552 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: User-Agent: python-urllib3/1.26.12 Oct 15 13:59:14.044552 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Auth-Token: gAAAAABjSrpEAEOvDYjQezlGXzh6XU2_Vl1KBLwmS9gwC61GtyVLxYlkshQyDPE_sOvB3OtB_cqctzpwbfjy2ZDsnCTYXEb6mgK25wVyiDmdp0o_CExIrnzjNhyInosPlpO2f8fIz0chymblvX9P3h-X24ZWwfGBe-8aG83eRywSSE77yc5-RNk Oct 15 13:59:14.044552 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Domain-Id: None Oct 15 13:59:14.044552 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Domain-Name: None Oct 15 13:59:14.044552 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Identity-Status: Confirmed Oct 15 13:59:14.044552 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Is-Admin-Project: True Oct 15 13:59:14.044552 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Project-Domain-Id: default Oct 15 13:59:14.044552 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Project-Domain-Name: Default Oct 15 13:59:14.044552 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Project-Id: 35f8b5024a194f70a9f7689ac44ab07b Oct 15 13:59:14.044552 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Project-Name: tempest-AttachVolumeTestJSON-908525129 Oct 15 13:59:14.044552 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Role: member,reader Oct 15 13:59:14.044552 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Roles: member,reader Oct 15 13:59:14.046119 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_35f8b5024a194f70a9f7689ac44ab07b", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/35f8b5024a194f70a9f7689ac44ab07b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/35f8b5024a194f70a9f7689ac44ab07b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/35f8b5024a194f70a9f7689ac44ab07b"}]}] Oct 15 13:59:14.046119 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Tenant: tempest-AttachVolumeTestJSON-908525129 Oct 15 13:59:14.046119 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Tenant-Id: 35f8b5024a194f70a9f7689ac44ab07b Oct 15 13:59:14.046119 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Tenant-Name: tempest-AttachVolumeTestJSON-908525129 Oct 15 13:59:14.046119 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-User: tempest-AttachVolumeTestJSON-908525129-project Oct 15 13:59:14.046119 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-User-Domain-Id: default Oct 15 13:59:14.046119 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-User-Domain-Name: Default Oct 15 13:59:14.046119 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-User-Id: 583cce1547144e11978f20a3193ceba4 Oct 15 13:59:14.046119 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-User-Name: tempest-AttachVolumeTestJSON-908525129-project Oct 15 13:59:14.046119 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: method: > Oct 15 13:59:14.046119 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: exception: Instance 40d67d09-379e-4c12-b36c-21edf3b23e45 could not be found. Oct 15 13:59:14.046119 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: action_args: {'id': '40d67d09-379e-4c12-b36c-21edf3b23e45'} Oct 15 13:59:14.047025 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 15 13:59:14.047025 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 13:59:14.047025 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 15 13:59:14.047025 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 15 13:59:14.047025 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 15 13:59:14.047025 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 15 13:59:14.047025 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 15 13:59:14.047025 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 15 13:59:14.047025 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 15 13:59:14.047025 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 15 13:59:14.047025 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40d67d09-379e-4c12-b36c-21edf3b23e45 could not be found. Oct 15 13:59:14.047025 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Oct 15 13:59:14.047025 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 13:59:14.047025 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Oct 15 13:59:14.047025 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 13:59:14.047025 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 13:59:14.047025 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 13:59:14.047025 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 15 13:59:14.047025 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 15 13:59:14.047025 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 15 13:59:14.048365 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 15 13:59:14.048365 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 15 13:59:14.048365 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 15 13:59:14.048365 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 15 13:59:14.048365 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 15 13:59:14.048365 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 15 13:59:14.048365 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 15 13:59:14.048365 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40d67d09-379e-4c12-b36c-21edf3b23e45 could not be found. Oct 15 13:59:14.048365 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Oct 15 13:59:14.048365 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 13:59:14.048365 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Oct 15 13:59:14.048365 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 13:59:14.048365 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 13:59:14.048365 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 13:59:14.048365 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 15 13:59:14.048365 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 15 13:59:14.048365 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40d67d09-379e-4c12-b36c-21edf3b23e45 could not be found. Oct 15 13:59:14.048365 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Oct 15 13:59:14.049425 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-28a76a80-e408-4455-84a2-14ef8c078f10 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] Returning 404 to user: Instance 40d67d09-379e-4c12-b36c-21edf3b23e45 could not be found. {{(pid=125242) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 15 13:59:14.049425 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-28a76a80-e408-4455-84a2-14ef8c078f10 tempest-AttachVolumeTestJSON-908525129 tempest-AttachVolumeTestJSON-908525129-project] 10.222.0.36 "GET /compute/v2.1/servers/40d67d09-379e-4c12-b36c-21edf3b23e45" status: 404 len: 111 microversion: 2.1 time: 0.032587 Oct 15 13:59:14.049425 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 526/1046] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 13:59:14 2022] GET /compute/v2.1/servers/40d67d09-379e-4c12-b36c-21edf3b23e45 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 15 13:59:49.586325 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-d50b831f-f364-42c5-b376-08ff5dec6644 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:59:49.588637 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-d50b831f-f364-42c5-b376-08ff5dec6644 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 161ef6e2-46fb-4c64-bbf0-c178886e0965] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:59:49.591323 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG dbcounter [-] [125243] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=125243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:59:49.592007 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG dbcounter [-] [125243] Writing DB stats nova_cell1:SELECT=43,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:59:49.598339 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-d50b831f-f364-42c5-b376-08ff5dec6644 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:59:49.598828 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-d50b831f-f364-42c5-b376-08ff5dec6644 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:59:49.599303 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-d50b831f-f364-42c5-b376-08ff5dec6644 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:59:49.600026 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-d50b831f-f364-42c5-b376-08ff5dec6644 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:59:49.600482 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-d50b831f-f364-42c5-b376-08ff5dec6644 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:59:49.600905 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-d50b831f-f364-42c5-b376-08ff5dec6644 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:59:49.634985 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-d50b831f-f364-42c5-b376-08ff5dec6644 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/161ef6e2-46fb-4c64-bbf0-c178886e0965/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.052751 Oct 15 13:59:49.635470 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 521/1047] 10.222.0.36 () {60 vars in 1343 bytes} [Sat Oct 15 13:59:49 2022] GET /compute/v2.1/servers/161ef6e2-46fb-4c64-bbf0-c178886e0965/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 13:59:49.704883 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-4f0ec509-c60c-4727-a2ed-0622bd899e49 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:59:49.705499 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-4f0ec509-c60c-4727-a2ed-0622bd899e49 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 161ef6e2-46fb-4c64-bbf0-c178886e0965] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:59:49.707919 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG dbcounter [-] [125242] Writing DB stats nova_api:SELECT=23 {{(pid=125242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:59:49.708628 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG dbcounter [-] [125242] Writing DB stats nova_cell1:SELECT=79,nova_cell1:INSERT=1 {{(pid=125242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 13:59:49.715623 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-4f0ec509-c60c-4727-a2ed-0622bd899e49 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:59:49.716147 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-4f0ec509-c60c-4727-a2ed-0622bd899e49 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:59:49.716584 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-4f0ec509-c60c-4727-a2ed-0622bd899e49 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:59:49.717282 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-4f0ec509-c60c-4727-a2ed-0622bd899e49 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:59:49.717729 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-4f0ec509-c60c-4727-a2ed-0622bd899e49 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:59:49.718149 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-4f0ec509-c60c-4727-a2ed-0622bd899e49 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:59:49.757674 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-4f0ec509-c60c-4727-a2ed-0622bd899e49 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 161ef6e2-46fb-4c64-bbf0-c178886e0965] Going to try to terminate instance {{(pid=125242) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 15 13:59:49.843519 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-4f0ec509-c60c-4727-a2ed-0622bd899e49 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "DELETE /compute/v2.1/servers/161ef6e2-46fb-4c64-bbf0-c178886e0965" status: 204 len: 0 microversion: 2.20 time: 0.142316 Oct 15 13:59:49.844794 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 527/1048] 10.222.0.36 () {60 vars in 1280 bytes} [Sat Oct 15 13:59:49 2022] DELETE /compute/v2.1/servers/161ef6e2-46fb-4c64-bbf0-c178886e0965 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 15 13:59:49.853258 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-fe666add-b910-4b7f-b9de-9602f53ac860 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:59:49.853868 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-fe666add-b910-4b7f-b9de-9602f53ac860 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 161ef6e2-46fb-4c64-bbf0-c178886e0965] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:59:49.860186 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-fe666add-b910-4b7f-b9de-9602f53ac860 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:59:49.860656 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-fe666add-b910-4b7f-b9de-9602f53ac860 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:59:49.861096 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-fe666add-b910-4b7f-b9de-9602f53ac860 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:59:49.861788 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-fe666add-b910-4b7f-b9de-9602f53ac860 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:59:49.862244 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-fe666add-b910-4b7f-b9de-9602f53ac860 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:59:49.862663 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-fe666add-b910-4b7f-b9de-9602f53ac860 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:59:50.007665 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-fe666add-b910-4b7f-b9de-9602f53ac860 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:59:50.016225 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-fe666add-b910-4b7f-b9de-9602f53ac860 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:59:50.017682 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-fe666add-b910-4b7f-b9de-9602f53ac860 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:59:50.018855 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-fe666add-b910-4b7f-b9de-9602f53ac860 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/161ef6e2-46fb-4c64-bbf0-c178886e0965" status: 200 len: 1726 microversion: 2.20 time: 0.169786 Oct 15 13:59:50.019398 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 522/1049] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:59:49 2022] GET /compute/v2.1/servers/161ef6e2-46fb-4c64-bbf0-c178886e0965 => generated 1726 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 13:59:51.046355 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-d2d6771d-468e-4498-8aa4-50f205abe907 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:59:51.047055 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-d2d6771d-468e-4498-8aa4-50f205abe907 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 161ef6e2-46fb-4c64-bbf0-c178886e0965] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:59:51.054375 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-d2d6771d-468e-4498-8aa4-50f205abe907 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:59:51.054868 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-d2d6771d-468e-4498-8aa4-50f205abe907 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:59:51.055304 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-d2d6771d-468e-4498-8aa4-50f205abe907 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:59:51.056031 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-d2d6771d-468e-4498-8aa4-50f205abe907 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:59:51.056489 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-d2d6771d-468e-4498-8aa4-50f205abe907 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:59:51.056926 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-d2d6771d-468e-4498-8aa4-50f205abe907 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:59:51.205052 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-d2d6771d-468e-4498-8aa4-50f205abe907 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:59:51.217929 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-d2d6771d-468e-4498-8aa4-50f205abe907 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:59:51.219747 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-d2d6771d-468e-4498-8aa4-50f205abe907 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:59:51.221615 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-d2d6771d-468e-4498-8aa4-50f205abe907 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/161ef6e2-46fb-4c64-bbf0-c178886e0965" status: 200 len: 1726 microversion: 2.20 time: 0.179467 Oct 15 13:59:51.222401 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 528/1050] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:59:51 2022] GET /compute/v2.1/servers/161ef6e2-46fb-4c64-bbf0-c178886e0965 => generated 1726 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 13:59:52.249195 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-60ed6a1b-2b80-437c-b828-70f758300ca4 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:59:52.249798 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-60ed6a1b-2b80-437c-b828-70f758300ca4 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 161ef6e2-46fb-4c64-bbf0-c178886e0965] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:59:52.256954 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-60ed6a1b-2b80-437c-b828-70f758300ca4 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:59:52.257469 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-60ed6a1b-2b80-437c-b828-70f758300ca4 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:59:52.257883 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-60ed6a1b-2b80-437c-b828-70f758300ca4 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:59:52.258595 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-60ed6a1b-2b80-437c-b828-70f758300ca4 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:59:52.259050 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-60ed6a1b-2b80-437c-b828-70f758300ca4 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:59:52.259510 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-60ed6a1b-2b80-437c-b828-70f758300ca4 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:59:52.409688 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-60ed6a1b-2b80-437c-b828-70f758300ca4 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:59:52.418586 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-60ed6a1b-2b80-437c-b828-70f758300ca4 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:59:52.420083 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-60ed6a1b-2b80-437c-b828-70f758300ca4 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:59:52.421265 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-60ed6a1b-2b80-437c-b828-70f758300ca4 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/161ef6e2-46fb-4c64-bbf0-c178886e0965" status: 200 len: 1726 microversion: 2.20 time: 0.176239 Oct 15 13:59:52.421862 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 523/1051] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:59:52 2022] GET /compute/v2.1/servers/161ef6e2-46fb-4c64-bbf0-c178886e0965 => generated 1726 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 13:59:53.446825 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-c7c3b238-8a19-4197-af5b-55377c97293c tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:59:53.447488 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-c7c3b238-8a19-4197-af5b-55377c97293c tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 161ef6e2-46fb-4c64-bbf0-c178886e0965] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:59:53.454259 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-c7c3b238-8a19-4197-af5b-55377c97293c tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:59:53.454748 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-c7c3b238-8a19-4197-af5b-55377c97293c tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:59:53.455184 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-c7c3b238-8a19-4197-af5b-55377c97293c tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:59:53.455905 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-c7c3b238-8a19-4197-af5b-55377c97293c tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:59:53.456364 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-c7c3b238-8a19-4197-af5b-55377c97293c tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:59:53.456787 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-c7c3b238-8a19-4197-af5b-55377c97293c tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:59:53.605696 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-c7c3b238-8a19-4197-af5b-55377c97293c tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:59:53.617785 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-c7c3b238-8a19-4197-af5b-55377c97293c tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:59:53.620071 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-c7c3b238-8a19-4197-af5b-55377c97293c tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:59:53.621792 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-c7c3b238-8a19-4197-af5b-55377c97293c tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/161ef6e2-46fb-4c64-bbf0-c178886e0965" status: 200 len: 1726 microversion: 2.20 time: 0.179021 Oct 15 13:59:53.622514 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 529/1052] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:59:53 2022] GET /compute/v2.1/servers/161ef6e2-46fb-4c64-bbf0-c178886e0965 => generated 1726 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 13:59:54.648898 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-a17253e4-f62a-4eef-bc10-c5e0aa66c329 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:59:54.649481 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-a17253e4-f62a-4eef-bc10-c5e0aa66c329 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 161ef6e2-46fb-4c64-bbf0-c178886e0965] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:59:54.656278 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-a17253e4-f62a-4eef-bc10-c5e0aa66c329 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:59:54.656790 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-a17253e4-f62a-4eef-bc10-c5e0aa66c329 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:59:54.657229 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-a17253e4-f62a-4eef-bc10-c5e0aa66c329 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:59:54.657929 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-a17253e4-f62a-4eef-bc10-c5e0aa66c329 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:59:54.658379 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-a17253e4-f62a-4eef-bc10-c5e0aa66c329 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:59:54.658880 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-a17253e4-f62a-4eef-bc10-c5e0aa66c329 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:59:54.807344 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-a17253e4-f62a-4eef-bc10-c5e0aa66c329 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:59:54.816337 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-a17253e4-f62a-4eef-bc10-c5e0aa66c329 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:59:54.817871 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-a17253e4-f62a-4eef-bc10-c5e0aa66c329 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:59:54.819194 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-a17253e4-f62a-4eef-bc10-c5e0aa66c329 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/161ef6e2-46fb-4c64-bbf0-c178886e0965" status: 200 len: 1726 microversion: 2.20 time: 0.176129 Oct 15 13:59:54.819796 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 524/1053] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:59:54 2022] GET /compute/v2.1/servers/161ef6e2-46fb-4c64-bbf0-c178886e0965 => generated 1726 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 13:59:55.845834 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-f8308207-9346-45ad-a83b-37406dd62ebc tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:59:55.847400 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-f8308207-9346-45ad-a83b-37406dd62ebc tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 161ef6e2-46fb-4c64-bbf0-c178886e0965] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:59:55.856017 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-f8308207-9346-45ad-a83b-37406dd62ebc tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:59:55.856790 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-f8308207-9346-45ad-a83b-37406dd62ebc tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:59:55.857216 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-f8308207-9346-45ad-a83b-37406dd62ebc tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:59:55.857917 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-f8308207-9346-45ad-a83b-37406dd62ebc tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:59:55.858991 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-f8308207-9346-45ad-a83b-37406dd62ebc tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:59:55.858991 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-f8308207-9346-45ad-a83b-37406dd62ebc tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:59:55.918583 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [req-b15fcdea-fe63-45cc-9f47-2e9f18946509 req-2cdafaa0-6bf1-4c6c-837c-617a16eb945d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "161ef6e2-46fb-4c64-bbf0-c178886e0965", "name": "network-vif-deleted", "tag": "b7f79f6d-d3ad-4794-bbcd-8936f95ed2b8"}]} {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 13:59:55.938727 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-f8308207-9346-45ad-a83b-37406dd62ebc tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:59:55.949706 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-f8308207-9346-45ad-a83b-37406dd62ebc tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:59:55.951375 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [req-b15fcdea-fe63-45cc-9f47-2e9f18946509 req-2cdafaa0-6bf1-4c6c-837c-617a16eb945d service nova] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:59:55.952970 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [req-b15fcdea-fe63-45cc-9f47-2e9f18946509 req-2cdafaa0-6bf1-4c6c-837c-617a16eb945d service nova] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:59:55.954011 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [req-b15fcdea-fe63-45cc-9f47-2e9f18946509 req-2cdafaa0-6bf1-4c6c-837c-617a16eb945d service nova] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:59:55.956761 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-f8308207-9346-45ad-a83b-37406dd62ebc tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b01e277944d4edcb8625ebf4544e340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf1193b43040948317be442c5c16f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 13:59:55.958003 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-f8308207-9346-45ad-a83b-37406dd62ebc tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/161ef6e2-46fb-4c64-bbf0-c178886e0965" status: 200 len: 1658 microversion: 2.20 time: 0.116452 Oct 15 13:59:55.973826 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.compute.server_external_events [req-b15fcdea-fe63-45cc-9f47-2e9f18946509 req-2cdafaa0-6bf1-4c6c-837c-617a16eb945d service nova] Creating event network-vif-deleted:b7f79f6d-d3ad-4794-bbcd-8936f95ed2b8 for instance 161ef6e2-46fb-4c64-bbf0-c178886e0965 on hv-cinder-86149 Oct 15 13:59:55.975756 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 525/1054] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:59:55 2022] GET /compute/v2.1/servers/161ef6e2-46fb-4c64-bbf0-c178886e0965 => generated 1658 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 15 13:59:55.985456 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [req-b15fcdea-fe63-45cc-9f47-2e9f18946509 req-2cdafaa0-6bf1-4c6c-837c-617a16eb945d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.234333 Oct 15 13:59:55.986508 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 530/1055] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 15 13:59:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 13:59:56.988067 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-9e465d9c-a98e-4734-b2a0-2efd3900d10f tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:59:56.988562 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-9e465d9c-a98e-4734-b2a0-2efd3900d10f tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 161ef6e2-46fb-4c64-bbf0-c178886e0965] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:59:56.996304 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-9e465d9c-a98e-4734-b2a0-2efd3900d10f tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:59:56.996682 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-9e465d9c-a98e-4734-b2a0-2efd3900d10f tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:59:56.997146 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-9e465d9c-a98e-4734-b2a0-2efd3900d10f tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:59:56.997830 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-9e465d9c-a98e-4734-b2a0-2efd3900d10f tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:59:56.998273 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-9e465d9c-a98e-4734-b2a0-2efd3900d10f tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:59:56.998690 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-9e465d9c-a98e-4734-b2a0-2efd3900d10f tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:59:57.012797 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.wsgi [None req-9e465d9c-a98e-4734-b2a0-2efd3900d10f tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] HTTP exception thrown: Instance 161ef6e2-46fb-4c64-bbf0-c178886e0965 could not be found. Oct 15 13:59:57.014347 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-9e465d9c-a98e-4734-b2a0-2efd3900d10f tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Request method failure captured: Oct 15 13:59:57.014347 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: request: GET /compute/v2.1/servers/161ef6e2-46fb-4c64-bbf0-c178886e0965 HTTP/1.1 Oct 15 13:59:57.014347 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: Accept: application/json Oct 15 13:59:57.014347 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: Accept-Encoding: identity Oct 15 13:59:57.014347 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: Connection: close Oct 15 13:59:57.014347 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: Content-Length: 0 Oct 15 13:59:57.014347 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: Content-Type: application/json Oct 15 13:59:57.014347 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: Host: 10.222.0.36 Oct 15 13:59:57.014347 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: Openstack-System-Scope: None Oct 15 13:59:57.014347 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: User-Agent: python-urllib3/1.26.12 Oct 15 13:59:57.014347 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Auth-Token: gAAAAABjSrpKuKb3IqHLdZJ6pMSEoA5wd3Ry1Iv3xTxY-nJ-qM_4H41e6Ag5Y_41ZxyWKZPJHiMXN4UTAXdOMVnxdod4Wr_wYL9b_buf36HM_-Yh_8XW59l6M4LUV0zyUdmJ3lSGAqN0sBtqIM4joATYkHuuvSeWK0imRkzVD_m_9znabaYKBY8 Oct 15 13:59:57.014347 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Domain-Id: None Oct 15 13:59:57.014347 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Domain-Name: None Oct 15 13:59:57.014347 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Identity-Status: Confirmed Oct 15 13:59:57.014347 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Is-Admin-Project: True Oct 15 13:59:57.014347 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Openstack-Nova-Api-Version: 2.20 Oct 15 13:59:57.014347 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Project-Domain-Id: default Oct 15 13:59:57.014347 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Project-Domain-Name: Default Oct 15 13:59:57.014347 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Project-Id: aabf1193b43040948317be442c5c16f7 Oct 15 13:59:57.014347 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-204887899 Oct 15 13:59:57.014347 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Role: member,reader Oct 15 13:59:57.014347 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Roles: member,reader Oct 15 13:59:57.016291 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_aabf1193b43040948317be442c5c16f7", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/aabf1193b43040948317be442c5c16f7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/aabf1193b43040948317be442c5c16f7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/aabf1193b43040948317be442c5c16f7"}]}] Oct 15 13:59:57.016291 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Tenant: tempest-AttachVolumeShelveTestJSON-204887899 Oct 15 13:59:57.016291 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Tenant-Id: aabf1193b43040948317be442c5c16f7 Oct 15 13:59:57.016291 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-204887899 Oct 15 13:59:57.016291 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-User: tempest-AttachVolumeShelveTestJSON-204887899-project Oct 15 13:59:57.016291 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-User-Domain-Id: default Oct 15 13:59:57.016291 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-User-Domain-Name: Default Oct 15 13:59:57.016291 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-User-Id: 0b01e277944d4edcb8625ebf4544e340 Oct 15 13:59:57.016291 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-User-Name: tempest-AttachVolumeShelveTestJSON-204887899-project Oct 15 13:59:57.016291 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: method: > Oct 15 13:59:57.016291 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: exception: Instance 161ef6e2-46fb-4c64-bbf0-c178886e0965 could not be found. Oct 15 13:59:57.016291 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: action_args: {'id': '161ef6e2-46fb-4c64-bbf0-c178886e0965'} Oct 15 13:59:57.017409 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 15 13:59:57.017409 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 13:59:57.017409 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 15 13:59:57.017409 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 15 13:59:57.017409 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 15 13:59:57.017409 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 15 13:59:57.017409 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 15 13:59:57.017409 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 15 13:59:57.017409 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 15 13:59:57.017409 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 15 13:59:57.017409 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 161ef6e2-46fb-4c64-bbf0-c178886e0965 could not be found. Oct 15 13:59:57.017409 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Oct 15 13:59:57.017409 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 13:59:57.017409 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Oct 15 13:59:57.017409 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 13:59:57.017409 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 13:59:57.017409 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 13:59:57.017409 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 15 13:59:57.017409 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 15 13:59:57.017409 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 15 13:59:57.018942 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 15 13:59:57.018942 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 15 13:59:57.018942 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 15 13:59:57.018942 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 15 13:59:57.018942 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 15 13:59:57.018942 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 15 13:59:57.018942 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 15 13:59:57.018942 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 161ef6e2-46fb-4c64-bbf0-c178886e0965 could not be found. Oct 15 13:59:57.018942 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Oct 15 13:59:57.018942 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 13:59:57.018942 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Oct 15 13:59:57.018942 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 13:59:57.018942 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 13:59:57.018942 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 13:59:57.018942 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 15 13:59:57.018942 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 15 13:59:57.018942 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 161ef6e2-46fb-4c64-bbf0-c178886e0965 could not be found. Oct 15 13:59:57.018942 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Oct 15 13:59:57.020244 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-9e465d9c-a98e-4734-b2a0-2efd3900d10f tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Returning 404 to user: Instance 161ef6e2-46fb-4c64-bbf0-c178886e0965 could not be found. {{(pid=125243) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 15 13:59:57.020244 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-9e465d9c-a98e-4734-b2a0-2efd3900d10f tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/161ef6e2-46fb-4c64-bbf0-c178886e0965" status: 404 len: 111 microversion: 2.20 time: 0.034289 Oct 15 13:59:57.020244 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 526/1056] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:59:56 2022] GET /compute/v2.1/servers/161ef6e2-46fb-4c64-bbf0-c178886e0965 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 15 13:59:57.025498 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-b9adc918-c45f-4402-bdbf-d74fc9d1113e tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '.version_select at 0x7f1b5e1879d0>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:59:57.046763 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-b9adc918-c45f-4402-bdbf-d74fc9d1113e tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1216004390" status: 204 len: 0 microversion: 2.20 time: 0.025469 Oct 15 13:59:57.047427 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 531/1057] 10.222.0.36 () {60 vars in 1262 bytes} [Sat Oct 15 13:59:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1216004390 => generated 0 bytes in 27 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 15 13:59:58.875845 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-b750f391-eb71-4a0a-805c-1b7a5b5c59e9 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:59:58.876406 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-b750f391-eb71-4a0a-805c-1b7a5b5c59e9 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 161ef6e2-46fb-4c64-bbf0-c178886e0965] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:59:58.885393 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-b750f391-eb71-4a0a-805c-1b7a5b5c59e9 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:59:58.885887 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-b750f391-eb71-4a0a-805c-1b7a5b5c59e9 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:59:58.886326 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-b750f391-eb71-4a0a-805c-1b7a5b5c59e9 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:59:58.887063 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-b750f391-eb71-4a0a-805c-1b7a5b5c59e9 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:59:58.887552 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-b750f391-eb71-4a0a-805c-1b7a5b5c59e9 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:59:58.888011 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-b750f391-eb71-4a0a-805c-1b7a5b5c59e9 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:59:58.904070 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.wsgi [None req-b750f391-eb71-4a0a-805c-1b7a5b5c59e9 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] HTTP exception thrown: Instance 161ef6e2-46fb-4c64-bbf0-c178886e0965 could not be found. Oct 15 13:59:58.905672 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-b750f391-eb71-4a0a-805c-1b7a5b5c59e9 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Request method failure captured: Oct 15 13:59:58.905672 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: request: DELETE /compute/v2.1/servers/161ef6e2-46fb-4c64-bbf0-c178886e0965 HTTP/1.1 Oct 15 13:59:58.905672 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: Accept: application/json Oct 15 13:59:58.905672 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: Accept-Encoding: identity Oct 15 13:59:58.905672 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: Connection: close Oct 15 13:59:58.905672 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: Content-Length: 0 Oct 15 13:59:58.905672 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: Content-Type: application/json Oct 15 13:59:58.905672 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: Host: 10.222.0.36 Oct 15 13:59:58.905672 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: Openstack-System-Scope: None Oct 15 13:59:58.905672 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: User-Agent: python-urllib3/1.26.12 Oct 15 13:59:58.905672 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Auth-Token: gAAAAABjSrpKuKb3IqHLdZJ6pMSEoA5wd3Ry1Iv3xTxY-nJ-qM_4H41e6Ag5Y_41ZxyWKZPJHiMXN4UTAXdOMVnxdod4Wr_wYL9b_buf36HM_-Yh_8XW59l6M4LUV0zyUdmJ3lSGAqN0sBtqIM4joATYkHuuvSeWK0imRkzVD_m_9znabaYKBY8 Oct 15 13:59:58.905672 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Domain-Id: None Oct 15 13:59:58.905672 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Domain-Name: None Oct 15 13:59:58.905672 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Identity-Status: Confirmed Oct 15 13:59:58.905672 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Is-Admin-Project: True Oct 15 13:59:58.905672 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Openstack-Nova-Api-Version: 2.20 Oct 15 13:59:58.905672 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Project-Domain-Id: default Oct 15 13:59:58.905672 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Project-Domain-Name: Default Oct 15 13:59:58.905672 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Project-Id: aabf1193b43040948317be442c5c16f7 Oct 15 13:59:58.905672 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-204887899 Oct 15 13:59:58.905672 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Role: member,reader Oct 15 13:59:58.905672 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Roles: member,reader Oct 15 13:59:58.907302 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_aabf1193b43040948317be442c5c16f7", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/aabf1193b43040948317be442c5c16f7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/aabf1193b43040948317be442c5c16f7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/aabf1193b43040948317be442c5c16f7"}]}] Oct 15 13:59:58.907302 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Tenant: tempest-AttachVolumeShelveTestJSON-204887899 Oct 15 13:59:58.907302 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Tenant-Id: aabf1193b43040948317be442c5c16f7 Oct 15 13:59:58.907302 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-204887899 Oct 15 13:59:58.907302 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-User: tempest-AttachVolumeShelveTestJSON-204887899-project Oct 15 13:59:58.907302 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-User-Domain-Id: default Oct 15 13:59:58.907302 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-User-Domain-Name: Default Oct 15 13:59:58.907302 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-User-Id: 0b01e277944d4edcb8625ebf4544e340 Oct 15 13:59:58.907302 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-User-Name: tempest-AttachVolumeShelveTestJSON-204887899-project Oct 15 13:59:58.907302 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: method: > Oct 15 13:59:58.907302 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: exception: Instance 161ef6e2-46fb-4c64-bbf0-c178886e0965 could not be found. Oct 15 13:59:58.907302 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: action_args: {'id': '161ef6e2-46fb-4c64-bbf0-c178886e0965'} Oct 15 13:59:58.908401 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 15 13:59:58.908401 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 13:59:58.908401 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 15 13:59:58.908401 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 15 13:59:58.908401 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 15 13:59:58.908401 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 15 13:59:58.908401 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 15 13:59:58.908401 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 15 13:59:58.908401 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 15 13:59:58.908401 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 15 13:59:58.908401 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 161ef6e2-46fb-4c64-bbf0-c178886e0965 could not be found. Oct 15 13:59:58.908401 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Oct 15 13:59:58.908401 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 13:59:58.908401 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Oct 15 13:59:58.908401 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 13:59:58.908401 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 13:59:58.908401 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 13:59:58.908401 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 15 13:59:58.908401 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 15 13:59:58.908401 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 15 13:59:58.910038 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 15 13:59:58.910038 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 15 13:59:58.910038 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 15 13:59:58.910038 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 15 13:59:58.910038 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 15 13:59:58.910038 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 15 13:59:58.910038 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 15 13:59:58.910038 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 15 13:59:58.910038 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 15 13:59:58.910038 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 161ef6e2-46fb-4c64-bbf0-c178886e0965 could not be found. Oct 15 13:59:58.910038 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Oct 15 13:59:58.910038 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 13:59:58.910038 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Oct 15 13:59:58.910038 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 13:59:58.910038 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 13:59:58.910038 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 13:59:58.910038 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 15 13:59:58.910038 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 15 13:59:58.910038 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 161ef6e2-46fb-4c64-bbf0-c178886e0965 could not be found. Oct 15 13:59:58.910038 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Oct 15 13:59:58.911498 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-b750f391-eb71-4a0a-805c-1b7a5b5c59e9 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Returning 404 to user: Instance 161ef6e2-46fb-4c64-bbf0-c178886e0965 could not be found. {{(pid=125243) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 15 13:59:58.911498 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-b750f391-eb71-4a0a-805c-1b7a5b5c59e9 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "DELETE /compute/v2.1/servers/161ef6e2-46fb-4c64-bbf0-c178886e0965" status: 404 len: 111 microversion: 2.20 time: 0.035356 Oct 15 13:59:58.911498 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 527/1058] 10.222.0.36 () {60 vars in 1280 bytes} [Sat Oct 15 13:59:58 2022] DELETE /compute/v2.1/servers/161ef6e2-46fb-4c64-bbf0-c178886e0965 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 15 13:59:58.916806 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-ae403906-79d9-4213-b861-edcfcd284084 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 13:59:58.917534 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-ae403906-79d9-4213-b861-edcfcd284084 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 161ef6e2-46fb-4c64-bbf0-c178886e0965] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 13:59:58.924945 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-ae403906-79d9-4213-b861-edcfcd284084 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:59:58.925407 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-ae403906-79d9-4213-b861-edcfcd284084 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:59:58.925839 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-ae403906-79d9-4213-b861-edcfcd284084 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:59:58.926545 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-ae403906-79d9-4213-b861-edcfcd284084 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 13:59:58.926991 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-ae403906-79d9-4213-b861-edcfcd284084 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 13:59:58.927404 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-ae403906-79d9-4213-b861-edcfcd284084 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 13:59:58.940940 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.wsgi [None req-ae403906-79d9-4213-b861-edcfcd284084 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] HTTP exception thrown: Instance 161ef6e2-46fb-4c64-bbf0-c178886e0965 could not be found. Oct 15 13:59:58.942606 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-ae403906-79d9-4213-b861-edcfcd284084 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Request method failure captured: Oct 15 13:59:58.942606 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: request: GET /compute/v2.1/servers/161ef6e2-46fb-4c64-bbf0-c178886e0965 HTTP/1.1 Oct 15 13:59:58.942606 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Accept: application/json Oct 15 13:59:58.942606 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Accept-Encoding: identity Oct 15 13:59:58.942606 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Connection: close Oct 15 13:59:58.942606 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Content-Length: 0 Oct 15 13:59:58.942606 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Content-Type: application/json Oct 15 13:59:58.942606 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Host: 10.222.0.36 Oct 15 13:59:58.942606 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Openstack-System-Scope: None Oct 15 13:59:58.942606 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: User-Agent: python-urllib3/1.26.12 Oct 15 13:59:58.942606 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Auth-Token: gAAAAABjSrpKuKb3IqHLdZJ6pMSEoA5wd3Ry1Iv3xTxY-nJ-qM_4H41e6Ag5Y_41ZxyWKZPJHiMXN4UTAXdOMVnxdod4Wr_wYL9b_buf36HM_-Yh_8XW59l6M4LUV0zyUdmJ3lSGAqN0sBtqIM4joATYkHuuvSeWK0imRkzVD_m_9znabaYKBY8 Oct 15 13:59:58.942606 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Domain-Id: None Oct 15 13:59:58.942606 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Domain-Name: None Oct 15 13:59:58.942606 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Identity-Status: Confirmed Oct 15 13:59:58.942606 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Is-Admin-Project: True Oct 15 13:59:58.942606 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Openstack-Nova-Api-Version: 2.20 Oct 15 13:59:58.942606 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Project-Domain-Id: default Oct 15 13:59:58.942606 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Project-Domain-Name: Default Oct 15 13:59:58.942606 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Project-Id: aabf1193b43040948317be442c5c16f7 Oct 15 13:59:58.942606 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-204887899 Oct 15 13:59:58.942606 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Role: member,reader Oct 15 13:59:58.942606 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Roles: member,reader Oct 15 13:59:58.944289 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_aabf1193b43040948317be442c5c16f7", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/aabf1193b43040948317be442c5c16f7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/aabf1193b43040948317be442c5c16f7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/aabf1193b43040948317be442c5c16f7"}]}] Oct 15 13:59:58.944289 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Tenant: tempest-AttachVolumeShelveTestJSON-204887899 Oct 15 13:59:58.944289 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Tenant-Id: aabf1193b43040948317be442c5c16f7 Oct 15 13:59:58.944289 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-204887899 Oct 15 13:59:58.944289 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-User: tempest-AttachVolumeShelveTestJSON-204887899-project Oct 15 13:59:58.944289 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-User-Domain-Id: default Oct 15 13:59:58.944289 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-User-Domain-Name: Default Oct 15 13:59:58.944289 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-User-Id: 0b01e277944d4edcb8625ebf4544e340 Oct 15 13:59:58.944289 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-User-Name: tempest-AttachVolumeShelveTestJSON-204887899-project Oct 15 13:59:58.944289 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: method: > Oct 15 13:59:58.944289 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: exception: Instance 161ef6e2-46fb-4c64-bbf0-c178886e0965 could not be found. Oct 15 13:59:58.944289 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: action_args: {'id': '161ef6e2-46fb-4c64-bbf0-c178886e0965'} Oct 15 13:59:58.945198 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 15 13:59:58.945198 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 13:59:58.945198 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 15 13:59:58.945198 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 15 13:59:58.945198 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 15 13:59:58.945198 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 15 13:59:58.945198 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 15 13:59:58.945198 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 15 13:59:58.945198 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 15 13:59:58.945198 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 15 13:59:58.945198 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 161ef6e2-46fb-4c64-bbf0-c178886e0965 could not be found. Oct 15 13:59:58.945198 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Oct 15 13:59:58.945198 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 13:59:58.945198 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Oct 15 13:59:58.945198 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 13:59:58.945198 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 13:59:58.945198 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 13:59:58.945198 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 15 13:59:58.945198 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 15 13:59:58.945198 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 15 13:59:58.946770 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 15 13:59:58.946770 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 15 13:59:58.946770 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 15 13:59:58.946770 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 15 13:59:58.946770 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 15 13:59:58.946770 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 15 13:59:58.946770 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 15 13:59:58.946770 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 161ef6e2-46fb-4c64-bbf0-c178886e0965 could not be found. Oct 15 13:59:58.946770 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Oct 15 13:59:58.946770 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 13:59:58.946770 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Oct 15 13:59:58.946770 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 13:59:58.946770 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 13:59:58.946770 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 13:59:58.946770 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 15 13:59:58.946770 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 15 13:59:58.946770 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 161ef6e2-46fb-4c64-bbf0-c178886e0965 could not be found. Oct 15 13:59:58.946770 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Oct 15 13:59:58.948153 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-ae403906-79d9-4213-b861-edcfcd284084 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Returning 404 to user: Instance 161ef6e2-46fb-4c64-bbf0-c178886e0965 could not be found. {{(pid=125242) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 15 13:59:58.948153 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-ae403906-79d9-4213-b861-edcfcd284084 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/161ef6e2-46fb-4c64-bbf0-c178886e0965" status: 404 len: 111 microversion: 2.20 time: 0.031704 Oct 15 13:59:58.948153 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 532/1059] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 13:59:58 2022] GET /compute/v2.1/servers/161ef6e2-46fb-4c64-bbf0-c178886e0965 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 15 14:00:00.091247 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-d699c3a0-cfea-40f7-8d62-361210341005 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 14:00:00.091782 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-d699c3a0-cfea-40f7-8d62-361210341005 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 5fc359cf-ff2c-4189-b058-31eb3c97568c] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 14:00:00.098769 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-d699c3a0-cfea-40f7-8d62-361210341005 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:00:00.099258 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-d699c3a0-cfea-40f7-8d62-361210341005 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:00:00.099693 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-d699c3a0-cfea-40f7-8d62-361210341005 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:00:00.100433 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-d699c3a0-cfea-40f7-8d62-361210341005 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:00:00.100885 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-d699c3a0-cfea-40f7-8d62-361210341005 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:00:00.101313 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-d699c3a0-cfea-40f7-8d62-361210341005 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:00:00.115446 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.wsgi [None req-d699c3a0-cfea-40f7-8d62-361210341005 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] HTTP exception thrown: Instance 5fc359cf-ff2c-4189-b058-31eb3c97568c could not be found. Oct 15 14:00:00.117050 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-d699c3a0-cfea-40f7-8d62-361210341005 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Request method failure captured: Oct 15 14:00:00.117050 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: request: DELETE /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c HTTP/1.1 Oct 15 14:00:00.117050 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: Accept: application/json Oct 15 14:00:00.117050 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: Accept-Encoding: identity Oct 15 14:00:00.117050 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: Connection: close Oct 15 14:00:00.117050 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: Content-Length: 0 Oct 15 14:00:00.117050 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: Content-Type: application/json Oct 15 14:00:00.117050 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: Host: 10.222.0.36 Oct 15 14:00:00.117050 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: Openstack-System-Scope: None Oct 15 14:00:00.117050 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: User-Agent: python-urllib3/1.26.12 Oct 15 14:00:00.117050 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Auth-Token: gAAAAABjSrpKuKb3IqHLdZJ6pMSEoA5wd3Ry1Iv3xTxY-nJ-qM_4H41e6Ag5Y_41ZxyWKZPJHiMXN4UTAXdOMVnxdod4Wr_wYL9b_buf36HM_-Yh_8XW59l6M4LUV0zyUdmJ3lSGAqN0sBtqIM4joATYkHuuvSeWK0imRkzVD_m_9znabaYKBY8 Oct 15 14:00:00.117050 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Domain-Id: None Oct 15 14:00:00.117050 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Domain-Name: None Oct 15 14:00:00.117050 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Identity-Status: Confirmed Oct 15 14:00:00.117050 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Is-Admin-Project: True Oct 15 14:00:00.117050 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Openstack-Nova-Api-Version: 2.20 Oct 15 14:00:00.117050 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Project-Domain-Id: default Oct 15 14:00:00.117050 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Project-Domain-Name: Default Oct 15 14:00:00.117050 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Project-Id: aabf1193b43040948317be442c5c16f7 Oct 15 14:00:00.117050 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-204887899 Oct 15 14:00:00.117050 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Role: member,reader Oct 15 14:00:00.117050 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Roles: member,reader Oct 15 14:00:00.118802 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_aabf1193b43040948317be442c5c16f7", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/aabf1193b43040948317be442c5c16f7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/aabf1193b43040948317be442c5c16f7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/aabf1193b43040948317be442c5c16f7"}]}] Oct 15 14:00:00.118802 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Tenant: tempest-AttachVolumeShelveTestJSON-204887899 Oct 15 14:00:00.118802 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Tenant-Id: aabf1193b43040948317be442c5c16f7 Oct 15 14:00:00.118802 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-204887899 Oct 15 14:00:00.118802 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-User: tempest-AttachVolumeShelveTestJSON-204887899-project Oct 15 14:00:00.118802 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-User-Domain-Id: default Oct 15 14:00:00.118802 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-User-Domain-Name: Default Oct 15 14:00:00.118802 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-User-Id: 0b01e277944d4edcb8625ebf4544e340 Oct 15 14:00:00.118802 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-User-Name: tempest-AttachVolumeShelveTestJSON-204887899-project Oct 15 14:00:00.118802 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: method: > Oct 15 14:00:00.118802 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: exception: Instance 5fc359cf-ff2c-4189-b058-31eb3c97568c could not be found. Oct 15 14:00:00.118802 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: action_args: {'id': '5fc359cf-ff2c-4189-b058-31eb3c97568c'} Oct 15 14:00:00.119722 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 15 14:00:00.119722 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 14:00:00.119722 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 15 14:00:00.119722 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 15 14:00:00.119722 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 15 14:00:00.119722 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 15 14:00:00.119722 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 15 14:00:00.119722 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 15 14:00:00.119722 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 15 14:00:00.119722 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 15 14:00:00.119722 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5fc359cf-ff2c-4189-b058-31eb3c97568c could not be found. Oct 15 14:00:00.119722 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Oct 15 14:00:00.119722 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 14:00:00.119722 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Oct 15 14:00:00.119722 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 14:00:00.119722 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 14:00:00.119722 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 14:00:00.119722 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 15 14:00:00.119722 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 15 14:00:00.119722 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 15 14:00:00.121256 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 15 14:00:00.121256 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 15 14:00:00.121256 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 15 14:00:00.121256 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 15 14:00:00.121256 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 15 14:00:00.121256 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 15 14:00:00.121256 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 15 14:00:00.121256 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 15 14:00:00.121256 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 15 14:00:00.121256 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5fc359cf-ff2c-4189-b058-31eb3c97568c could not be found. Oct 15 14:00:00.121256 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Oct 15 14:00:00.121256 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 14:00:00.121256 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Oct 15 14:00:00.121256 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 14:00:00.121256 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 14:00:00.121256 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 14:00:00.121256 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 15 14:00:00.121256 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 15 14:00:00.121256 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5fc359cf-ff2c-4189-b058-31eb3c97568c could not be found. Oct 15 14:00:00.121256 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Oct 15 14:00:00.122855 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-d699c3a0-cfea-40f7-8d62-361210341005 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Returning 404 to user: Instance 5fc359cf-ff2c-4189-b058-31eb3c97568c could not be found. {{(pid=125243) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 15 14:00:00.122855 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-d699c3a0-cfea-40f7-8d62-361210341005 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "DELETE /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c" status: 404 len: 111 microversion: 2.20 time: 0.031183 Oct 15 14:00:00.122855 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 528/1060] 10.222.0.36 () {60 vars in 1280 bytes} [Sat Oct 15 14:00:00 2022] DELETE /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 15 14:00:00.127028 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-a2db69bc-168b-423a-b5d9-4b4d755a9c43 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 14:00:00.127650 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-a2db69bc-168b-423a-b5d9-4b4d755a9c43 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] [instance: 5fc359cf-ff2c-4189-b058-31eb3c97568c] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 14:00:00.134485 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-a2db69bc-168b-423a-b5d9-4b4d755a9c43 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:00:00.135162 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-a2db69bc-168b-423a-b5d9-4b4d755a9c43 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:00:00.135620 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-a2db69bc-168b-423a-b5d9-4b4d755a9c43 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:00:00.136347 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-a2db69bc-168b-423a-b5d9-4b4d755a9c43 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:00:00.136800 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-a2db69bc-168b-423a-b5d9-4b4d755a9c43 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:00:00.137354 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-a2db69bc-168b-423a-b5d9-4b4d755a9c43 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:00:00.151045 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.wsgi [None req-a2db69bc-168b-423a-b5d9-4b4d755a9c43 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] HTTP exception thrown: Instance 5fc359cf-ff2c-4189-b058-31eb3c97568c could not be found. Oct 15 14:00:00.152629 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-a2db69bc-168b-423a-b5d9-4b4d755a9c43 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Request method failure captured: Oct 15 14:00:00.152629 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: request: GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c HTTP/1.1 Oct 15 14:00:00.152629 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Accept: application/json Oct 15 14:00:00.152629 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Accept-Encoding: identity Oct 15 14:00:00.152629 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Connection: close Oct 15 14:00:00.152629 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Content-Length: 0 Oct 15 14:00:00.152629 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Content-Type: application/json Oct 15 14:00:00.152629 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Host: 10.222.0.36 Oct 15 14:00:00.152629 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Openstack-System-Scope: None Oct 15 14:00:00.152629 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: User-Agent: python-urllib3/1.26.12 Oct 15 14:00:00.152629 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Auth-Token: gAAAAABjSrpKuKb3IqHLdZJ6pMSEoA5wd3Ry1Iv3xTxY-nJ-qM_4H41e6Ag5Y_41ZxyWKZPJHiMXN4UTAXdOMVnxdod4Wr_wYL9b_buf36HM_-Yh_8XW59l6M4LUV0zyUdmJ3lSGAqN0sBtqIM4joATYkHuuvSeWK0imRkzVD_m_9znabaYKBY8 Oct 15 14:00:00.152629 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Domain-Id: None Oct 15 14:00:00.152629 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Domain-Name: None Oct 15 14:00:00.152629 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Identity-Status: Confirmed Oct 15 14:00:00.152629 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Is-Admin-Project: True Oct 15 14:00:00.152629 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Openstack-Nova-Api-Version: 2.20 Oct 15 14:00:00.152629 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Project-Domain-Id: default Oct 15 14:00:00.152629 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Project-Domain-Name: Default Oct 15 14:00:00.152629 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Project-Id: aabf1193b43040948317be442c5c16f7 Oct 15 14:00:00.152629 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-204887899 Oct 15 14:00:00.152629 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Role: member,reader Oct 15 14:00:00.152629 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Roles: member,reader Oct 15 14:00:00.154318 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_aabf1193b43040948317be442c5c16f7", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/aabf1193b43040948317be442c5c16f7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/aabf1193b43040948317be442c5c16f7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/aabf1193b43040948317be442c5c16f7"}]}] Oct 15 14:00:00.154318 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Tenant: tempest-AttachVolumeShelveTestJSON-204887899 Oct 15 14:00:00.154318 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Tenant-Id: aabf1193b43040948317be442c5c16f7 Oct 15 14:00:00.154318 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-204887899 Oct 15 14:00:00.154318 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-User: tempest-AttachVolumeShelveTestJSON-204887899-project Oct 15 14:00:00.154318 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-User-Domain-Id: default Oct 15 14:00:00.154318 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-User-Domain-Name: Default Oct 15 14:00:00.154318 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-User-Id: 0b01e277944d4edcb8625ebf4544e340 Oct 15 14:00:00.154318 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-User-Name: tempest-AttachVolumeShelveTestJSON-204887899-project Oct 15 14:00:00.154318 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: method: > Oct 15 14:00:00.154318 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: exception: Instance 5fc359cf-ff2c-4189-b058-31eb3c97568c could not be found. Oct 15 14:00:00.154318 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: action_args: {'id': '5fc359cf-ff2c-4189-b058-31eb3c97568c'} Oct 15 14:00:00.155489 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 15 14:00:00.155489 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 14:00:00.155489 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 15 14:00:00.155489 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 15 14:00:00.155489 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 15 14:00:00.155489 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 15 14:00:00.155489 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 15 14:00:00.155489 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 15 14:00:00.155489 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 15 14:00:00.155489 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 15 14:00:00.155489 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5fc359cf-ff2c-4189-b058-31eb3c97568c could not be found. Oct 15 14:00:00.155489 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Oct 15 14:00:00.155489 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 14:00:00.155489 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Oct 15 14:00:00.155489 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 14:00:00.155489 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 14:00:00.155489 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 14:00:00.155489 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 15 14:00:00.155489 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 15 14:00:00.155489 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 15 14:00:00.156993 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 15 14:00:00.156993 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 15 14:00:00.156993 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 15 14:00:00.156993 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 15 14:00:00.156993 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 15 14:00:00.156993 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 15 14:00:00.156993 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 15 14:00:00.156993 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5fc359cf-ff2c-4189-b058-31eb3c97568c could not be found. Oct 15 14:00:00.156993 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Oct 15 14:00:00.156993 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 14:00:00.156993 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Oct 15 14:00:00.156993 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 14:00:00.156993 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 14:00:00.156993 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 14:00:00.156993 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 15 14:00:00.156993 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 15 14:00:00.156993 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5fc359cf-ff2c-4189-b058-31eb3c97568c could not be found. Oct 15 14:00:00.156993 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Oct 15 14:00:00.158512 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-a2db69bc-168b-423a-b5d9-4b4d755a9c43 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] Returning 404 to user: Instance 5fc359cf-ff2c-4189-b058-31eb3c97568c could not be found. {{(pid=125242) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 15 14:00:00.158512 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-a2db69bc-168b-423a-b5d9-4b4d755a9c43 tempest-AttachVolumeShelveTestJSON-204887899 tempest-AttachVolumeShelveTestJSON-204887899-project] 10.222.0.36 "GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c" status: 404 len: 111 microversion: 2.20 time: 0.030885 Oct 15 14:00:00.158512 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 533/1061] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 15 14:00:00 2022] GET /compute/v2.1/servers/5fc359cf-ff2c-4189-b058-31eb3c97568c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 15 14:00:15.811124 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-47503310-9720-4bea-96e5-18f2f1ac8ed6 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-79688249", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1731665434", "security_groups": [{"name": "tempest-secgroup-smoke-1562745215"}], "block_device_mapping_v2": [{"uuid": "e57c138d-3832-47cc-9028-1c9e908b93e5", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "701b540a-8a09-42dc-a3a2-18dbe248ffc3"}]}} {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 14:00:15.826219 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG dbcounter [-] [125243] Writing DB stats nova_api:SELECT=16 {{(pid=125243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 14:00:15.826978 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG dbcounter [-] [125243] Writing DB stats nova_cell1:SELECT=36 {{(pid=125243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 14:00:15.936166 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.network.neutron [None req-47503310-9720-4bea-96e5-18f2f1ac8ed6 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] validate_networks() for [('701b540a-8a09-42dc-a3a2-18dbe248ffc3', None, None, None, None, None)] {{(pid=125243) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 15 14:00:16.467165 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.virt.hardware [None req-47503310-9720-4bea-96e5-18f2f1ac8ed6 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Flavor limits 0:0:0 {{(pid=125243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 15 14:00:16.467567 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.virt.hardware [None req-47503310-9720-4bea-96e5-18f2f1ac8ed6 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Image limits 0:0:0 {{(pid=125243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 15 14:00:16.468070 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.virt.hardware [None req-47503310-9720-4bea-96e5-18f2f1ac8ed6 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Flavor pref 0:0:0 {{(pid=125243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 15 14:00:16.468480 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.virt.hardware [None req-47503310-9720-4bea-96e5-18f2f1ac8ed6 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Image pref 0:0:0 {{(pid=125243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 15 14:00:16.468993 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.virt.hardware [None req-47503310-9720-4bea-96e5-18f2f1ac8ed6 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 15 14:00:16.478599 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-47503310-9720-4bea-96e5-18f2f1ac8ed6 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:00:16.479489 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-47503310-9720-4bea-96e5-18f2f1ac8ed6 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:00:16.480161 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-47503310-9720-4bea-96e5-18f2f1ac8ed6 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:00:16.481097 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-47503310-9720-4bea-96e5-18f2f1ac8ed6 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:00:16.482035 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-47503310-9720-4bea-96e5-18f2f1ac8ed6 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:00:16.482470 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-47503310-9720-4bea-96e5-18f2f1ac8ed6 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:00:16.504010 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.quota [None req-47503310-9720-4bea-96e5-18f2f1ac8ed6 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Getting quotas for project 243c0b9b4bd742659061745c8dc4c696. Resources: {'cores', 'ram', 'instances'} {{(pid=125243) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 15 14:00:16.508452 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.quota [None req-47503310-9720-4bea-96e5-18f2f1ac8ed6 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Getting quotas for user 193bf7a17f544770a27c07f6b8cc0988 and project 243c0b9b4bd742659061745c8dc4c696. Resources: {'cores', 'ram', 'instances'} {{(pid=125243) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 15 14:00:16.571918 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-47503310-9720-4bea-96e5-18f2f1ac8ed6 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Going to run 1 instances... {{(pid=125243) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 15 14:00:16.575106 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-47503310-9720-4bea-96e5-18f2f1ac8ed6 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] [instance: 31fd889c-ef07-468c-9cc5-3a3fd1b51d63] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e57c138d-3832-47cc-9028-1c9e908b93e5',volume_size=None,volume_type=None)] {{(pid=125243) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 15 14:00:16.746805 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-47503310-9720-4bea-96e5-18f2f1ac8ed6 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.940491 Oct 15 14:00:16.747639 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 529/1062] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 15 14:00:15 2022] POST /compute/v2.1/servers => generated 406 bytes in 942 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 15 14:00:16.759174 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-33976a14-e1c3-4b65-9883-326ef34f2fc7 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 14:00:16.759783 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-33976a14-e1c3-4b65-9883-326ef34f2fc7 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] [instance: 31fd889c-ef07-468c-9cc5-3a3fd1b51d63] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 14:00:16.763149 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG dbcounter [-] [125242] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=125242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 14:00:16.763783 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG dbcounter [-] [125242] Writing DB stats nova_cell1:SELECT=32,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 14:00:17.190654 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-33976a14-e1c3-4b65-9883-326ef34f2fc7 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '193bf7a17f544770a27c07f6b8cc0988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243c0b9b4bd742659061745c8dc4c696', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 14:00:17.198829 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-33976a14-e1c3-4b65-9883-326ef34f2fc7 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] 10.222.0.36 "GET /compute/v2.1/servers/31fd889c-ef07-468c-9cc5-3a3fd1b51d63" status: 200 len: 1093 microversion: 2.1 time: 0.443609 Oct 15 14:00:17.199410 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 534/1063] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 14:00:16 2022] GET /compute/v2.1/servers/31fd889c-ef07-468c-9cc5-3a3fd1b51d63 => generated 1093 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 14:00:18.222888 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-be9ebcc3-8db8-4f15-a57d-e3c8136b42ac tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 14:00:18.223465 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-be9ebcc3-8db8-4f15-a57d-e3c8136b42ac tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] [instance: 31fd889c-ef07-468c-9cc5-3a3fd1b51d63] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 14:00:18.233230 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-be9ebcc3-8db8-4f15-a57d-e3c8136b42ac tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:00:18.237033 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-be9ebcc3-8db8-4f15-a57d-e3c8136b42ac tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:00:18.240152 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-be9ebcc3-8db8-4f15-a57d-e3c8136b42ac tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:00:18.240914 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-be9ebcc3-8db8-4f15-a57d-e3c8136b42ac tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:00:18.242514 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-be9ebcc3-8db8-4f15-a57d-e3c8136b42ac tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:00:18.243022 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-be9ebcc3-8db8-4f15-a57d-e3c8136b42ac tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:00:18.344371 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-be9ebcc3-8db8-4f15-a57d-e3c8136b42ac tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '193bf7a17f544770a27c07f6b8cc0988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243c0b9b4bd742659061745c8dc4c696', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 14:00:18.355277 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-be9ebcc3-8db8-4f15-a57d-e3c8136b42ac tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] 10.222.0.36 "GET /compute/v2.1/servers/31fd889c-ef07-468c-9cc5-3a3fd1b51d63" status: 200 len: 1209 microversion: 2.1 time: 0.136674 Oct 15 14:00:18.356987 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 530/1064] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 14:00:18 2022] GET /compute/v2.1/servers/31fd889c-ef07-468c-9cc5-3a3fd1b51d63 => generated 1209 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 14:00:19.385580 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-6d197a72-fb10-42ef-a5cb-559f8a63526e tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 14:00:19.386363 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-6d197a72-fb10-42ef-a5cb-559f8a63526e tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] [instance: 31fd889c-ef07-468c-9cc5-3a3fd1b51d63] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 14:00:19.395855 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-6d197a72-fb10-42ef-a5cb-559f8a63526e tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:00:19.396398 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-6d197a72-fb10-42ef-a5cb-559f8a63526e tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:00:19.396836 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-6d197a72-fb10-42ef-a5cb-559f8a63526e tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:00:19.397738 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-6d197a72-fb10-42ef-a5cb-559f8a63526e tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:00:19.399112 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-6d197a72-fb10-42ef-a5cb-559f8a63526e tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:00:19.399737 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-6d197a72-fb10-42ef-a5cb-559f8a63526e tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:00:19.581218 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-6d197a72-fb10-42ef-a5cb-559f8a63526e tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '193bf7a17f544770a27c07f6b8cc0988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243c0b9b4bd742659061745c8dc4c696', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 14:00:19.591755 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-6d197a72-fb10-42ef-a5cb-559f8a63526e tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] 10.222.0.36 "GET /compute/v2.1/servers/31fd889c-ef07-468c-9cc5-3a3fd1b51d63" status: 200 len: 1277 microversion: 2.1 time: 0.210978 Oct 15 14:00:19.593166 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 535/1065] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 14:00:19 2022] GET /compute/v2.1/servers/31fd889c-ef07-468c-9cc5-3a3fd1b51d63 => generated 1277 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 14:00:19.869042 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [req-1e822f12-50b4-4888-9dfe-bc12cad77589 req-aa3cbc4c-91c9-4b77-8d2e-d901bb27613d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31fd889c-ef07-468c-9cc5-3a3fd1b51d63", "tag": "7c8bf8d7-7d37-4910-8609-6b29066a0947"}]} {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 14:00:19.882938 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [req-1e822f12-50b4-4888-9dfe-bc12cad77589 req-aa3cbc4c-91c9-4b77-8d2e-d901bb27613d service nova] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:00:19.883765 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [req-1e822f12-50b4-4888-9dfe-bc12cad77589 req-aa3cbc4c-91c9-4b77-8d2e-d901bb27613d service nova] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:00:19.884412 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [req-1e822f12-50b4-4888-9dfe-bc12cad77589 req-aa3cbc4c-91c9-4b77-8d2e-d901bb27613d service nova] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:00:19.905904 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.compute.server_external_events [req-1e822f12-50b4-4888-9dfe-bc12cad77589 req-aa3cbc4c-91c9-4b77-8d2e-d901bb27613d service nova] Creating event network-changed:7c8bf8d7-7d37-4910-8609-6b29066a0947 for instance 31fd889c-ef07-468c-9cc5-3a3fd1b51d63 on hv-cinder-86149 Oct 15 14:00:19.913525 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [req-1e822f12-50b4-4888-9dfe-bc12cad77589 req-aa3cbc4c-91c9-4b77-8d2e-d901bb27613d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048321 Oct 15 14:00:19.914265 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 531/1066] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 15 14:00:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 14:00:20.622116 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-34055a5b-4b48-4231-a17f-1151666719cf tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 14:00:20.622509 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-34055a5b-4b48-4231-a17f-1151666719cf tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] [instance: 31fd889c-ef07-468c-9cc5-3a3fd1b51d63] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 14:00:20.631988 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-34055a5b-4b48-4231-a17f-1151666719cf tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:00:20.632425 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-34055a5b-4b48-4231-a17f-1151666719cf tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:00:20.632988 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-34055a5b-4b48-4231-a17f-1151666719cf tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:00:20.633719 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-34055a5b-4b48-4231-a17f-1151666719cf tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:00:20.635293 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-34055a5b-4b48-4231-a17f-1151666719cf tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:00:20.636078 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-34055a5b-4b48-4231-a17f-1151666719cf tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:00:20.786832 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-34055a5b-4b48-4231-a17f-1151666719cf tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '193bf7a17f544770a27c07f6b8cc0988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243c0b9b4bd742659061745c8dc4c696', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 14:00:20.795217 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-34055a5b-4b48-4231-a17f-1151666719cf tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] 10.222.0.36 "GET /compute/v2.1/servers/31fd889c-ef07-468c-9cc5-3a3fd1b51d63" status: 200 len: 1265 microversion: 2.1 time: 0.178057 Oct 15 14:00:20.796024 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 536/1067] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 14:00:20 2022] GET /compute/v2.1/servers/31fd889c-ef07-468c-9cc5-3a3fd1b51d63 => generated 1265 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 14:00:21.820289 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-2fa1ef20-1ed9-46c0-8bd2-95e595f1f93b tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 14:00:21.821323 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-2fa1ef20-1ed9-46c0-8bd2-95e595f1f93b tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] [instance: 31fd889c-ef07-468c-9cc5-3a3fd1b51d63] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 14:00:21.828927 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-2fa1ef20-1ed9-46c0-8bd2-95e595f1f93b tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:00:21.829668 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-2fa1ef20-1ed9-46c0-8bd2-95e595f1f93b tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:00:21.830189 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-2fa1ef20-1ed9-46c0-8bd2-95e595f1f93b tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:00:21.831217 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-2fa1ef20-1ed9-46c0-8bd2-95e595f1f93b tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:00:21.831764 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-2fa1ef20-1ed9-46c0-8bd2-95e595f1f93b tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:00:21.832301 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-2fa1ef20-1ed9-46c0-8bd2-95e595f1f93b tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:00:21.980970 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-2fa1ef20-1ed9-46c0-8bd2-95e595f1f93b tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '193bf7a17f544770a27c07f6b8cc0988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243c0b9b4bd742659061745c8dc4c696', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 14:00:21.990085 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-2fa1ef20-1ed9-46c0-8bd2-95e595f1f93b tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] 10.222.0.36 "GET /compute/v2.1/servers/31fd889c-ef07-468c-9cc5-3a3fd1b51d63" status: 200 len: 1265 microversion: 2.1 time: 0.174796 Oct 15 14:00:21.990649 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 532/1068] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 14:00:21 2022] GET /compute/v2.1/servers/31fd889c-ef07-468c-9cc5-3a3fd1b51d63 => generated 1265 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 14:00:23.016765 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-38fe69e2-ee66-4f99-b0d6-c5a70bd5e410 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 14:00:23.017471 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-38fe69e2-ee66-4f99-b0d6-c5a70bd5e410 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] [instance: 31fd889c-ef07-468c-9cc5-3a3fd1b51d63] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 14:00:23.025932 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-38fe69e2-ee66-4f99-b0d6-c5a70bd5e410 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:00:23.026198 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-38fe69e2-ee66-4f99-b0d6-c5a70bd5e410 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:00:23.026714 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-38fe69e2-ee66-4f99-b0d6-c5a70bd5e410 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:00:23.027477 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-38fe69e2-ee66-4f99-b0d6-c5a70bd5e410 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:00:23.028003 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-38fe69e2-ee66-4f99-b0d6-c5a70bd5e410 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:00:23.028436 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-38fe69e2-ee66-4f99-b0d6-c5a70bd5e410 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:00:23.168561 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-38fe69e2-ee66-4f99-b0d6-c5a70bd5e410 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '193bf7a17f544770a27c07f6b8cc0988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243c0b9b4bd742659061745c8dc4c696', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 14:00:23.176441 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-38fe69e2-ee66-4f99-b0d6-c5a70bd5e410 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] 10.222.0.36 "GET /compute/v2.1/servers/31fd889c-ef07-468c-9cc5-3a3fd1b51d63" status: 200 len: 1265 microversion: 2.1 time: 0.165170 Oct 15 14:00:23.177020 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 537/1069] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 14:00:23 2022] GET /compute/v2.1/servers/31fd889c-ef07-468c-9cc5-3a3fd1b51d63 => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 14:00:24.199909 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-006c418a-3125-4c6e-b278-20cb63dff710 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 14:00:24.200663 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-006c418a-3125-4c6e-b278-20cb63dff710 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] [instance: 31fd889c-ef07-468c-9cc5-3a3fd1b51d63] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 14:00:24.207568 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-006c418a-3125-4c6e-b278-20cb63dff710 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:00:24.208097 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-006c418a-3125-4c6e-b278-20cb63dff710 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:00:24.208536 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-006c418a-3125-4c6e-b278-20cb63dff710 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:00:24.209219 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-006c418a-3125-4c6e-b278-20cb63dff710 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:00:24.209668 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-006c418a-3125-4c6e-b278-20cb63dff710 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:00:24.210090 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-006c418a-3125-4c6e-b278-20cb63dff710 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:00:24.354723 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-006c418a-3125-4c6e-b278-20cb63dff710 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '193bf7a17f544770a27c07f6b8cc0988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243c0b9b4bd742659061745c8dc4c696', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 14:00:24.363011 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-006c418a-3125-4c6e-b278-20cb63dff710 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] 10.222.0.36 "GET /compute/v2.1/servers/31fd889c-ef07-468c-9cc5-3a3fd1b51d63" status: 200 len: 1265 microversion: 2.1 time: 0.166988 Oct 15 14:00:24.363804 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 533/1070] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 14:00:24 2022] GET /compute/v2.1/servers/31fd889c-ef07-468c-9cc5-3a3fd1b51d63 => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 14:00:25.390752 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-ca02f81c-200c-4768-8347-130a9a9b9a96 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 14:00:25.391351 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-ca02f81c-200c-4768-8347-130a9a9b9a96 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] [instance: 31fd889c-ef07-468c-9cc5-3a3fd1b51d63] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 14:00:25.398152 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-ca02f81c-200c-4768-8347-130a9a9b9a96 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:00:25.398629 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-ca02f81c-200c-4768-8347-130a9a9b9a96 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:00:25.399285 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-ca02f81c-200c-4768-8347-130a9a9b9a96 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:00:25.400141 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-ca02f81c-200c-4768-8347-130a9a9b9a96 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:00:25.400594 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-ca02f81c-200c-4768-8347-130a9a9b9a96 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:00:25.401211 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-ca02f81c-200c-4768-8347-130a9a9b9a96 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:00:25.561671 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-ca02f81c-200c-4768-8347-130a9a9b9a96 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '193bf7a17f544770a27c07f6b8cc0988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243c0b9b4bd742659061745c8dc4c696', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 14:00:25.570186 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-ca02f81c-200c-4768-8347-130a9a9b9a96 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] 10.222.0.36 "GET /compute/v2.1/servers/31fd889c-ef07-468c-9cc5-3a3fd1b51d63" status: 200 len: 1265 microversion: 2.1 time: 0.183901 Oct 15 14:00:25.571122 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 538/1071] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 14:00:25 2022] GET /compute/v2.1/servers/31fd889c-ef07-468c-9cc5-3a3fd1b51d63 => generated 1265 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 14:00:26.609368 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-58ce4eca-66a4-49a3-8623-871bc3a581b7 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 14:00:26.609963 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-58ce4eca-66a4-49a3-8623-871bc3a581b7 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] [instance: 31fd889c-ef07-468c-9cc5-3a3fd1b51d63] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 14:00:26.613416 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG dbcounter [-] [125243] Writing DB stats nova_cell0:SELECT=2 {{(pid=125243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 14:00:26.614049 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG dbcounter [-] [125243] Writing DB stats nova_cell0:SELECT=6 {{(pid=125243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 14:00:26.621123 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-58ce4eca-66a4-49a3-8623-871bc3a581b7 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:00:26.621661 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-58ce4eca-66a4-49a3-8623-871bc3a581b7 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:00:26.622095 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-58ce4eca-66a4-49a3-8623-871bc3a581b7 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:00:26.622793 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-58ce4eca-66a4-49a3-8623-871bc3a581b7 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:00:26.623395 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-58ce4eca-66a4-49a3-8623-871bc3a581b7 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:00:26.623766 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-58ce4eca-66a4-49a3-8623-871bc3a581b7 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:00:26.780869 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-58ce4eca-66a4-49a3-8623-871bc3a581b7 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '193bf7a17f544770a27c07f6b8cc0988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243c0b9b4bd742659061745c8dc4c696', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 14:00:26.790825 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-58ce4eca-66a4-49a3-8623-871bc3a581b7 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] 10.222.0.36 "GET /compute/v2.1/servers/31fd889c-ef07-468c-9cc5-3a3fd1b51d63" status: 200 len: 1265 microversion: 2.1 time: 0.185504 Oct 15 14:00:26.799607 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 534/1072] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 14:00:26 2022] GET /compute/v2.1/servers/31fd889c-ef07-468c-9cc5-3a3fd1b51d63 => generated 1265 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 14:00:27.815820 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-d93010f7-5b10-404b-99b0-dbcc3ec80543 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 14:00:27.816538 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-d93010f7-5b10-404b-99b0-dbcc3ec80543 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] [instance: 31fd889c-ef07-468c-9cc5-3a3fd1b51d63] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 14:00:27.820288 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG dbcounter [-] [125242] Writing DB stats nova_cell0:SELECT=2 {{(pid=125242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 14:00:27.826388 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-d93010f7-5b10-404b-99b0-dbcc3ec80543 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:00:27.827583 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-d93010f7-5b10-404b-99b0-dbcc3ec80543 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:00:27.828069 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-d93010f7-5b10-404b-99b0-dbcc3ec80543 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:00:27.829066 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-d93010f7-5b10-404b-99b0-dbcc3ec80543 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:00:27.829399 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-d93010f7-5b10-404b-99b0-dbcc3ec80543 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:00:27.829977 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-d93010f7-5b10-404b-99b0-dbcc3ec80543 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:00:28.025751 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-d93010f7-5b10-404b-99b0-dbcc3ec80543 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '193bf7a17f544770a27c07f6b8cc0988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243c0b9b4bd742659061745c8dc4c696', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 14:00:28.035145 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-d93010f7-5b10-404b-99b0-dbcc3ec80543 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] 10.222.0.36 "GET /compute/v2.1/servers/31fd889c-ef07-468c-9cc5-3a3fd1b51d63" status: 200 len: 1265 microversion: 2.1 time: 0.223892 Oct 15 14:00:28.035944 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 539/1073] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 14:00:27 2022] GET /compute/v2.1/servers/31fd889c-ef07-468c-9cc5-3a3fd1b51d63 => generated 1265 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 14:00:29.063771 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-715885fc-baab-46c1-ba66-07cbee95f84c tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 14:00:29.064711 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-715885fc-baab-46c1-ba66-07cbee95f84c tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] [instance: 31fd889c-ef07-468c-9cc5-3a3fd1b51d63] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 14:00:29.073697 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-715885fc-baab-46c1-ba66-07cbee95f84c tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:00:29.074280 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-715885fc-baab-46c1-ba66-07cbee95f84c tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:00:29.074999 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-715885fc-baab-46c1-ba66-07cbee95f84c tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:00:29.076341 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-715885fc-baab-46c1-ba66-07cbee95f84c tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:00:29.077022 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-715885fc-baab-46c1-ba66-07cbee95f84c tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:00:29.077693 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-715885fc-baab-46c1-ba66-07cbee95f84c tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:00:29.267115 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-715885fc-baab-46c1-ba66-07cbee95f84c tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '193bf7a17f544770a27c07f6b8cc0988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243c0b9b4bd742659061745c8dc4c696', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 14:00:29.277081 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-715885fc-baab-46c1-ba66-07cbee95f84c tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] 10.222.0.36 "GET /compute/v2.1/servers/31fd889c-ef07-468c-9cc5-3a3fd1b51d63" status: 200 len: 1265 microversion: 2.1 time: 0.218739 Oct 15 14:00:29.277961 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 535/1074] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 14:00:29 2022] GET /compute/v2.1/servers/31fd889c-ef07-468c-9cc5-3a3fd1b51d63 => generated 1265 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 14:00:30.302516 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-b8a381b4-08fd-47bd-b435-0036f1b9dfd7 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 14:00:30.303378 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-b8a381b4-08fd-47bd-b435-0036f1b9dfd7 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] [instance: 31fd889c-ef07-468c-9cc5-3a3fd1b51d63] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 14:00:30.310173 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-b8a381b4-08fd-47bd-b435-0036f1b9dfd7 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:00:30.310732 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-b8a381b4-08fd-47bd-b435-0036f1b9dfd7 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:00:30.311535 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-b8a381b4-08fd-47bd-b435-0036f1b9dfd7 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:00:30.312360 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-b8a381b4-08fd-47bd-b435-0036f1b9dfd7 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:00:30.312821 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-b8a381b4-08fd-47bd-b435-0036f1b9dfd7 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:00:30.313278 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-b8a381b4-08fd-47bd-b435-0036f1b9dfd7 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:00:30.472460 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-b8a381b4-08fd-47bd-b435-0036f1b9dfd7 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '193bf7a17f544770a27c07f6b8cc0988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243c0b9b4bd742659061745c8dc4c696', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 14:00:30.480891 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-b8a381b4-08fd-47bd-b435-0036f1b9dfd7 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] 10.222.0.36 "GET /compute/v2.1/servers/31fd889c-ef07-468c-9cc5-3a3fd1b51d63" status: 200 len: 1265 microversion: 2.1 time: 0.183819 Oct 15 14:00:30.481822 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 540/1075] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 14:00:30 2022] GET /compute/v2.1/servers/31fd889c-ef07-468c-9cc5-3a3fd1b51d63 => generated 1265 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 14:00:30.867761 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [req-046dcc93-7fca-4c78-bd3f-5cc41a4d6a71 req-2cfb68b5-d334-4d26-8a2b-37681111c0fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31fd889c-ef07-468c-9cc5-3a3fd1b51d63", "name": "network-vif-plugged", "status": "completed", "tag": "7c8bf8d7-7d37-4910-8609-6b29066a0947"}]} {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 14:00:30.877994 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [req-046dcc93-7fca-4c78-bd3f-5cc41a4d6a71 req-2cfb68b5-d334-4d26-8a2b-37681111c0fa service nova] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:00:30.878476 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [req-046dcc93-7fca-4c78-bd3f-5cc41a4d6a71 req-2cfb68b5-d334-4d26-8a2b-37681111c0fa service nova] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:00:30.878910 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [req-046dcc93-7fca-4c78-bd3f-5cc41a4d6a71 req-2cfb68b5-d334-4d26-8a2b-37681111c0fa service nova] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:00:30.890754 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.compute.server_external_events [req-046dcc93-7fca-4c78-bd3f-5cc41a4d6a71 req-2cfb68b5-d334-4d26-8a2b-37681111c0fa service nova] Creating event network-vif-plugged:7c8bf8d7-7d37-4910-8609-6b29066a0947 for instance 31fd889c-ef07-468c-9cc5-3a3fd1b51d63 on hv-cinder-86149 Oct 15 14:00:30.896303 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [req-046dcc93-7fca-4c78-bd3f-5cc41a4d6a71 req-2cfb68b5-d334-4d26-8a2b-37681111c0fa service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.177802 Oct 15 14:00:30.896897 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 536/1076] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 15 14:00:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 14:00:31.505050 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-0df7c86c-9b38-40eb-b94d-3884aa508ed1 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 14:00:31.505820 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-0df7c86c-9b38-40eb-b94d-3884aa508ed1 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] [instance: 31fd889c-ef07-468c-9cc5-3a3fd1b51d63] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 14:00:31.514590 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-0df7c86c-9b38-40eb-b94d-3884aa508ed1 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:00:31.515099 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-0df7c86c-9b38-40eb-b94d-3884aa508ed1 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:00:31.515531 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-0df7c86c-9b38-40eb-b94d-3884aa508ed1 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:00:31.516271 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-0df7c86c-9b38-40eb-b94d-3884aa508ed1 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:00:31.516719 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-0df7c86c-9b38-40eb-b94d-3884aa508ed1 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:00:31.517139 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-0df7c86c-9b38-40eb-b94d-3884aa508ed1 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:00:31.669045 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-0df7c86c-9b38-40eb-b94d-3884aa508ed1 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '193bf7a17f544770a27c07f6b8cc0988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243c0b9b4bd742659061745c8dc4c696', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 14:00:31.677280 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-0df7c86c-9b38-40eb-b94d-3884aa508ed1 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] 10.222.0.36 "GET /compute/v2.1/servers/31fd889c-ef07-468c-9cc5-3a3fd1b51d63" status: 200 len: 1265 microversion: 2.1 time: 0.176526 Oct 15 14:00:31.677899 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 541/1077] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 14:00:31 2022] GET /compute/v2.1/servers/31fd889c-ef07-468c-9cc5-3a3fd1b51d63 => generated 1265 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 14:00:32.704645 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-a0a12b80-9712-4f48-87a2-1b08a0fd6e56 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 14:00:32.705525 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-a0a12b80-9712-4f48-87a2-1b08a0fd6e56 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] [instance: 31fd889c-ef07-468c-9cc5-3a3fd1b51d63] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 14:00:32.713530 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-a0a12b80-9712-4f48-87a2-1b08a0fd6e56 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:00:32.714133 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-a0a12b80-9712-4f48-87a2-1b08a0fd6e56 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:00:32.714686 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-a0a12b80-9712-4f48-87a2-1b08a0fd6e56 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:00:32.715494 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-a0a12b80-9712-4f48-87a2-1b08a0fd6e56 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:00:32.716095 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-a0a12b80-9712-4f48-87a2-1b08a0fd6e56 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:00:32.716613 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-a0a12b80-9712-4f48-87a2-1b08a0fd6e56 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:00:32.927041 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-a0a12b80-9712-4f48-87a2-1b08a0fd6e56 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '193bf7a17f544770a27c07f6b8cc0988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243c0b9b4bd742659061745c8dc4c696', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 14:00:32.936071 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-a0a12b80-9712-4f48-87a2-1b08a0fd6e56 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] 10.222.0.36 "GET /compute/v2.1/servers/31fd889c-ef07-468c-9cc5-3a3fd1b51d63" status: 200 len: 1452 microversion: 2.1 time: 0.238733 Oct 15 14:00:32.936713 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 537/1078] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 14:00:32 2022] GET /compute/v2.1/servers/31fd889c-ef07-468c-9cc5-3a3fd1b51d63 => generated 1452 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 14:00:32.960170 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-a471dfd3-ec56-4c9e-8d98-2b1c4eecc385 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 14:00:32.960754 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-a471dfd3-ec56-4c9e-8d98-2b1c4eecc385 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] [instance: 31fd889c-ef07-468c-9cc5-3a3fd1b51d63] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 14:00:32.968071 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-a471dfd3-ec56-4c9e-8d98-2b1c4eecc385 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:00:32.968650 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-a471dfd3-ec56-4c9e-8d98-2b1c4eecc385 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:00:32.969094 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-a471dfd3-ec56-4c9e-8d98-2b1c4eecc385 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:00:32.969805 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-a471dfd3-ec56-4c9e-8d98-2b1c4eecc385 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:00:32.970260 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-a471dfd3-ec56-4c9e-8d98-2b1c4eecc385 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:00:32.970692 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-a471dfd3-ec56-4c9e-8d98-2b1c4eecc385 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:00:33.113953 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-a471dfd3-ec56-4c9e-8d98-2b1c4eecc385 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '193bf7a17f544770a27c07f6b8cc0988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243c0b9b4bd742659061745c8dc4c696', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 14:00:33.121927 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-a471dfd3-ec56-4c9e-8d98-2b1c4eecc385 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] 10.222.0.36 "GET /compute/v2.1/servers/31fd889c-ef07-468c-9cc5-3a3fd1b51d63" status: 200 len: 1452 microversion: 2.1 time: 0.165739 Oct 15 14:00:33.122728 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 542/1079] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 14:00:32 2022] GET /compute/v2.1/servers/31fd889c-ef07-468c-9cc5-3a3fd1b51d63 => generated 1452 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 14:00:35.284521 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [req-1177384d-a900-40c2-893f-0b25daa9d7f5 req-62364039-3240-4c04-bac2-375a39aacd24 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31fd889c-ef07-468c-9cc5-3a3fd1b51d63", "tag": "7c8bf8d7-7d37-4910-8609-6b29066a0947"}]} {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 14:00:35.295137 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [req-1177384d-a900-40c2-893f-0b25daa9d7f5 req-62364039-3240-4c04-bac2-375a39aacd24 service nova] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:00:35.295945 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [req-1177384d-a900-40c2-893f-0b25daa9d7f5 req-62364039-3240-4c04-bac2-375a39aacd24 service nova] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:00:35.296498 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [req-1177384d-a900-40c2-893f-0b25daa9d7f5 req-62364039-3240-4c04-bac2-375a39aacd24 service nova] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:00:35.316766 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.compute.server_external_events [req-1177384d-a900-40c2-893f-0b25daa9d7f5 req-62364039-3240-4c04-bac2-375a39aacd24 service nova] Creating event network-changed:7c8bf8d7-7d37-4910-8609-6b29066a0947 for instance 31fd889c-ef07-468c-9cc5-3a3fd1b51d63 on hv-cinder-86149 Oct 15 14:00:35.322683 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [req-1177384d-a900-40c2-893f-0b25daa9d7f5 req-62364039-3240-4c04-bac2-375a39aacd24 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.226024 Oct 15 14:00:35.323684 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 538/1080] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 15 14:00:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 14:01:02.565428 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-3f276dea-746e-4bdd-8b65-a9ce51e29320 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 14:01:02.566084 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-3f276dea-746e-4bdd-8b65-a9ce51e29320 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] [instance: 1c2ec1ba-e381-4083-a794-c8ff83beb391] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 14:01:02.569015 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG dbcounter [-] [125242] Writing DB stats nova_api:SELECT=20 {{(pid=125242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 14:01:02.570225 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG dbcounter [-] [125242] Writing DB stats nova_cell1:SELECT=48 {{(pid=125242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 14:01:02.579294 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-3f276dea-746e-4bdd-8b65-a9ce51e29320 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:01:02.580105 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-3f276dea-746e-4bdd-8b65-a9ce51e29320 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:01:02.580723 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-3f276dea-746e-4bdd-8b65-a9ce51e29320 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:01:02.581764 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-3f276dea-746e-4bdd-8b65-a9ce51e29320 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:01:02.582450 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-3f276dea-746e-4bdd-8b65-a9ce51e29320 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:01:02.583004 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-3f276dea-746e-4bdd-8b65-a9ce51e29320 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:01:02.608557 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-3f276dea-746e-4bdd-8b65-a9ce51e29320 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] 10.222.0.36 "GET /compute/v2.1/servers/1c2ec1ba-e381-4083-a794-c8ff83beb391/ips" status: 200 len: 150 microversion: 2.1 time: 0.048419 Oct 15 14:01:02.609167 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 543/1081] 10.222.0.36 () {58 vars in 1248 bytes} [Sat Oct 15 14:01:02 2022] GET /compute/v2.1/servers/1c2ec1ba-e381-4083-a794-c8ff83beb391/ips => generated 150 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 14:01:02.625413 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-fe207e0c-9d33-4149-a1b2-055c7e1721a3 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3f610ed0-3c89-42cd-b494-e8c57fb46ede"}} {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 14:01:02.627899 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-fe207e0c-9d33-4149-a1b2-055c7e1721a3 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] [instance: 1c2ec1ba-e381-4083-a794-c8ff83beb391] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 14:01:02.630203 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG dbcounter [-] [125243] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=125243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 14:01:02.630833 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG dbcounter [-] [125243] Writing DB stats nova_cell1:SELECT=44 {{(pid=125243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 14:01:02.637819 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-fe207e0c-9d33-4149-a1b2-055c7e1721a3 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:01:02.638308 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-fe207e0c-9d33-4149-a1b2-055c7e1721a3 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:01:02.638750 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-fe207e0c-9d33-4149-a1b2-055c7e1721a3 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:01:02.639453 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-fe207e0c-9d33-4149-a1b2-055c7e1721a3 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:01:02.639933 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-fe207e0c-9d33-4149-a1b2-055c7e1721a3 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:01:02.640362 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-fe207e0c-9d33-4149-a1b2-055c7e1721a3 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:01:02.721725 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.wsgi [None req-fe207e0c-9d33-4149-a1b2-055c7e1721a3 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] HTTP exception thrown: Invalid volume: volume 3f610ed0-3c89-42cd-b494-e8c57fb46ede is already attached to instances: 00959d34-6e9e-4c3d-a32b-1dfc66397406 Oct 15 14:01:02.723368 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-fe207e0c-9d33-4149-a1b2-055c7e1721a3 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Request method failure captured: Oct 15 14:01:02.723368 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: request: POST /compute/v2.1/servers/1c2ec1ba-e381-4083-a794-c8ff83beb391/os-volume_attachments HTTP/1.1 Oct 15 14:01:02.723368 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: Accept: application/json Oct 15 14:01:02.723368 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: Accept-Encoding: identity Oct 15 14:01:02.723368 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: Connection: close Oct 15 14:01:02.723368 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: Content-Length: 74 Oct 15 14:01:02.723368 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: Content-Type: application/json Oct 15 14:01:02.723368 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: Host: 10.222.0.36 Oct 15 14:01:02.723368 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: Openstack-System-Scope: None Oct 15 14:01:02.723368 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: User-Agent: python-urllib3/1.26.12 Oct 15 14:01:02.723368 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Auth-Token: gAAAAABjSrwjLfc9eO9Ga-oGlJy_0-kXrWYl6E9iQsuiX0FzsrMojKgz761L4MHPRenZAoUO0wQyqfJ45bvEQq8ApfN15Y_P6uN8Md3wWVEiU_I4JYoXqcUDzANpGGWqTMo-HatpcMRcOiXDjsl3AXX5mHMNQbkMjtIRLTfF6ftg2a6TfPRcK1g Oct 15 14:01:02.723368 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Domain-Id: None Oct 15 14:01:02.723368 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Domain-Name: None Oct 15 14:01:02.723368 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Identity-Status: Confirmed Oct 15 14:01:02.723368 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Is-Admin-Project: True Oct 15 14:01:02.723368 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Project-Domain-Id: default Oct 15 14:01:02.723368 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Project-Domain-Name: Default Oct 15 14:01:02.723368 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Project-Id: 1976b27e84a4484ba9d46a4244b08699 Oct 15 14:01:02.723368 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Project-Name: tempest-AttachVolumeNegativeTest-20916687 Oct 15 14:01:02.723368 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Role: member,reader Oct 15 14:01:02.723368 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Roles: member,reader Oct 15 14:01:02.725347 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_1976b27e84a4484ba9d46a4244b08699", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/1976b27e84a4484ba9d46a4244b08699"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/1976b27e84a4484ba9d46a4244b08699"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/1976b27e84a4484ba9d46a4244b08699"}]}] Oct 15 14:01:02.725347 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Tenant: tempest-AttachVolumeNegativeTest-20916687 Oct 15 14:01:02.725347 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Tenant-Id: 1976b27e84a4484ba9d46a4244b08699 Oct 15 14:01:02.725347 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-20916687 Oct 15 14:01:02.725347 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-User: tempest-AttachVolumeNegativeTest-20916687-project Oct 15 14:01:02.725347 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-User-Domain-Id: default Oct 15 14:01:02.725347 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-User-Domain-Name: Default Oct 15 14:01:02.725347 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-User-Id: a10fc1a48c9c41eaa1bf3ff2e4109657 Oct 15 14:01:02.725347 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-User-Name: tempest-AttachVolumeNegativeTest-20916687-project Oct 15 14:01:02.725347 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: Oct 15 14:01:02.725347 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: {"volumeAttachment": {"volumeId": "3f610ed0-3c89-42cd-b494-e8c57fb46ede"}} Oct 15 14:01:02.725347 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: method: > Oct 15 14:01:02.726491 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: exception: Invalid volume: volume 3f610ed0-3c89-42cd-b494-e8c57fb46ede is already attached to instances: 00959d34-6e9e-4c3d-a32b-1dfc66397406 Oct 15 14:01:02.726491 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: action_args: {'server_id': '1c2ec1ba-e381-4083-a794-c8ff83beb391', 'body': {'volumeAttachment': {'volumeId': '3f610ed0-3c89-42cd-b494-e8c57fb46ede'}}} Oct 15 14:01:02.726491 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 15 14:01:02.726491 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 14:01:02.726491 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 15 14:01:02.726491 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 15 14:01:02.726491 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 15 14:01:02.726491 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 15 14:01:02.726491 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 15 14:01:02.726491 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 15 14:01:02.726491 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 15 14:01:02.726491 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 15 14:01:02.726491 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 15 14:01:02.726491 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 15 14:01:02.726491 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 3f610ed0-3c89-42cd-b494-e8c57fb46ede is already attached to instances: 00959d34-6e9e-4c3d-a32b-1dfc66397406 Oct 15 14:01:02.726491 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Oct 15 14:01:02.726491 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 14:01:02.726491 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Oct 15 14:01:02.726491 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 14:01:02.728449 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 14:01:02.728449 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 14:01:02.728449 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 15 14:01:02.728449 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 15 14:01:02.728449 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 15 14:01:02.728449 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 15 14:01:02.728449 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 15 14:01:02.728449 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 15 14:01:02.728449 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 15 14:01:02.728449 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 15 14:01:02.728449 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 15 14:01:02.728449 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 15 14:01:02.728449 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 15 14:01:02.728449 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 15 14:01:02.728449 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 3f610ed0-3c89-42cd-b494-e8c57fb46ede is already attached to instances: 00959d34-6e9e-4c3d-a32b-1dfc66397406 Oct 15 14:01:02.728449 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Oct 15 14:01:02.728449 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 14:01:02.728449 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Oct 15 14:01:02.728449 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 14:01:02.728449 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 14:01:02.730017 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 14:01:02.730017 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 15 14:01:02.730017 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 15 14:01:02.730017 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 3f610ed0-3c89-42cd-b494-e8c57fb46ede is already attached to instances: 00959d34-6e9e-4c3d-a32b-1dfc66397406 Oct 15 14:01:02.730017 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Oct 15 14:01:02.730017 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-fe207e0c-9d33-4149-a1b2-055c7e1721a3 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Returning 400 to user: Invalid volume: volume 3f610ed0-3c89-42cd-b494-e8c57fb46ede is already attached to instances: 00959d34-6e9e-4c3d-a32b-1dfc66397406 {{(pid=125243) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 15 14:01:02.730017 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-fe207e0c-9d33-4149-a1b2-055c7e1721a3 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] 10.222.0.36 "POST /compute/v2.1/servers/1c2ec1ba-e381-4083-a794-c8ff83beb391/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.103899 Oct 15 14:01:02.730017 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 539/1082] 10.222.0.36 () {60 vars in 1323 bytes} [Sat Oct 15 14:01:02 2022] POST /compute/v2.1/servers/1c2ec1ba-e381-4083-a794-c8ff83beb391/os-volume_attachments => generated 174 bytes in 105 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 15 14:01:02.734323 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-aaa9b60d-a126-4df5-bebc-2c9f31f31ba9 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 14:01:02.734827 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-aaa9b60d-a126-4df5-bebc-2c9f31f31ba9 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] [instance: 1c2ec1ba-e381-4083-a794-c8ff83beb391] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 14:01:02.741335 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-aaa9b60d-a126-4df5-bebc-2c9f31f31ba9 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:01:02.741823 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-aaa9b60d-a126-4df5-bebc-2c9f31f31ba9 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:01:02.742266 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-aaa9b60d-a126-4df5-bebc-2c9f31f31ba9 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:01:02.743002 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-aaa9b60d-a126-4df5-bebc-2c9f31f31ba9 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:01:02.743411 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-aaa9b60d-a126-4df5-bebc-2c9f31f31ba9 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:01:02.743839 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-aaa9b60d-a126-4df5-bebc-2c9f31f31ba9 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:01:02.768801 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-aaa9b60d-a126-4df5-bebc-2c9f31f31ba9 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] [instance: 1c2ec1ba-e381-4083-a794-c8ff83beb391] Going to try to terminate instance {{(pid=125242) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 15 14:01:02.851705 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-aaa9b60d-a126-4df5-bebc-2c9f31f31ba9 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] 10.222.0.36 "DELETE /compute/v2.1/servers/1c2ec1ba-e381-4083-a794-c8ff83beb391" status: 204 len: 0 microversion: 2.1 time: 0.120979 Oct 15 14:01:02.852673 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 544/1083] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 15 14:01:02 2022] DELETE /compute/v2.1/servers/1c2ec1ba-e381-4083-a794-c8ff83beb391 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 15 14:01:02.861128 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-791e78ea-84b9-44f5-9770-6abbe0a7241a tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 14:01:02.861729 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-791e78ea-84b9-44f5-9770-6abbe0a7241a tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] [instance: 1c2ec1ba-e381-4083-a794-c8ff83beb391] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 14:01:02.869211 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-791e78ea-84b9-44f5-9770-6abbe0a7241a tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:01:02.869701 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-791e78ea-84b9-44f5-9770-6abbe0a7241a tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:01:02.870138 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-791e78ea-84b9-44f5-9770-6abbe0a7241a tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:01:02.870836 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-791e78ea-84b9-44f5-9770-6abbe0a7241a tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:01:02.871298 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-791e78ea-84b9-44f5-9770-6abbe0a7241a tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:01:02.871717 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-791e78ea-84b9-44f5-9770-6abbe0a7241a tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:01:03.016223 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-791e78ea-84b9-44f5-9770-6abbe0a7241a tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10fc1a48c9c41eaa1bf3ff2e4109657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1976b27e84a4484ba9d46a4244b08699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 14:01:03.025842 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-791e78ea-84b9-44f5-9770-6abbe0a7241a tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] 10.222.0.36 "GET /compute/v2.1/servers/1c2ec1ba-e381-4083-a794-c8ff83beb391" status: 200 len: 1681 microversion: 2.1 time: 0.168571 Oct 15 14:01:03.026450 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 540/1084] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 14:01:02 2022] GET /compute/v2.1/servers/1c2ec1ba-e381-4083-a794-c8ff83beb391 => generated 1681 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 14:01:04.053706 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-6fcfb89f-16ac-4a57-9ae3-cc91e9e9bbf4 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 14:01:04.054434 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-6fcfb89f-16ac-4a57-9ae3-cc91e9e9bbf4 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] [instance: 1c2ec1ba-e381-4083-a794-c8ff83beb391] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 14:01:04.061733 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-6fcfb89f-16ac-4a57-9ae3-cc91e9e9bbf4 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:01:04.062223 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-6fcfb89f-16ac-4a57-9ae3-cc91e9e9bbf4 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:01:04.062659 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-6fcfb89f-16ac-4a57-9ae3-cc91e9e9bbf4 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:01:04.063357 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-6fcfb89f-16ac-4a57-9ae3-cc91e9e9bbf4 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:01:04.063810 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-6fcfb89f-16ac-4a57-9ae3-cc91e9e9bbf4 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:01:04.064269 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-6fcfb89f-16ac-4a57-9ae3-cc91e9e9bbf4 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:01:04.202786 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-6fcfb89f-16ac-4a57-9ae3-cc91e9e9bbf4 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10fc1a48c9c41eaa1bf3ff2e4109657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1976b27e84a4484ba9d46a4244b08699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 14:01:04.211080 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-6fcfb89f-16ac-4a57-9ae3-cc91e9e9bbf4 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] 10.222.0.36 "GET /compute/v2.1/servers/1c2ec1ba-e381-4083-a794-c8ff83beb391" status: 200 len: 1681 microversion: 2.1 time: 0.163774 Oct 15 14:01:04.211695 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 545/1085] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 14:01:04 2022] GET /compute/v2.1/servers/1c2ec1ba-e381-4083-a794-c8ff83beb391 => generated 1681 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 14:01:05.234754 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-f47715f5-60dd-4605-99d9-0f8919f77b02 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 14:01:05.235380 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-f47715f5-60dd-4605-99d9-0f8919f77b02 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] [instance: 1c2ec1ba-e381-4083-a794-c8ff83beb391] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 14:01:05.242318 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-f47715f5-60dd-4605-99d9-0f8919f77b02 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:01:05.242816 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-f47715f5-60dd-4605-99d9-0f8919f77b02 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:01:05.243253 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-f47715f5-60dd-4605-99d9-0f8919f77b02 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:01:05.243992 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-f47715f5-60dd-4605-99d9-0f8919f77b02 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:01:05.244454 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-f47715f5-60dd-4605-99d9-0f8919f77b02 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:01:05.244878 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-f47715f5-60dd-4605-99d9-0f8919f77b02 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:01:05.379989 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-f47715f5-60dd-4605-99d9-0f8919f77b02 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10fc1a48c9c41eaa1bf3ff2e4109657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1976b27e84a4484ba9d46a4244b08699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 14:01:05.388131 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-f47715f5-60dd-4605-99d9-0f8919f77b02 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] 10.222.0.36 "GET /compute/v2.1/servers/1c2ec1ba-e381-4083-a794-c8ff83beb391" status: 200 len: 1681 microversion: 2.1 time: 0.157233 Oct 15 14:01:05.388711 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 541/1086] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 14:01:05 2022] GET /compute/v2.1/servers/1c2ec1ba-e381-4083-a794-c8ff83beb391 => generated 1681 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 14:01:05.887805 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [req-6ece7d96-e8c8-40f7-b9f2-46978e4600ff req-75676633-be54-42b6-bfb1-7dba51e569f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c2ec1ba-e381-4083-a794-c8ff83beb391", "name": "network-vif-deleted", "tag": "8f1ff711-16b3-41c3-ab0a-c21d959b5f7c"}]} {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 14:01:05.898524 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [req-6ece7d96-e8c8-40f7-b9f2-46978e4600ff req-75676633-be54-42b6-bfb1-7dba51e569f5 service nova] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:01:05.899280 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [req-6ece7d96-e8c8-40f7-b9f2-46978e4600ff req-75676633-be54-42b6-bfb1-7dba51e569f5 service nova] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:01:05.899917 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [req-6ece7d96-e8c8-40f7-b9f2-46978e4600ff req-75676633-be54-42b6-bfb1-7dba51e569f5 service nova] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:01:05.912447 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.compute.server_external_events [req-6ece7d96-e8c8-40f7-b9f2-46978e4600ff req-75676633-be54-42b6-bfb1-7dba51e569f5 service nova] Creating event network-vif-deleted:8f1ff711-16b3-41c3-ab0a-c21d959b5f7c for instance 1c2ec1ba-e381-4083-a794-c8ff83beb391 on hv-cinder-86149 Oct 15 14:01:05.918975 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [req-6ece7d96-e8c8-40f7-b9f2-46978e4600ff req-75676633-be54-42b6-bfb1-7dba51e569f5 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038003 Oct 15 14:01:05.920243 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 546/1087] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 15 14:01:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 14:01:06.411949 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-7d443c06-6558-448a-96c8-38706a752e9f tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 14:01:06.413037 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-7d443c06-6558-448a-96c8-38706a752e9f tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] [instance: 1c2ec1ba-e381-4083-a794-c8ff83beb391] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 14:01:06.420558 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-7d443c06-6558-448a-96c8-38706a752e9f tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:01:06.420951 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-7d443c06-6558-448a-96c8-38706a752e9f tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:01:06.421360 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-7d443c06-6558-448a-96c8-38706a752e9f tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:01:06.422081 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-7d443c06-6558-448a-96c8-38706a752e9f tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:01:06.423036 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-7d443c06-6558-448a-96c8-38706a752e9f tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:01:06.423256 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-7d443c06-6558-448a-96c8-38706a752e9f tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:01:06.458880 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-7d443c06-6558-448a-96c8-38706a752e9f tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:01:06.459734 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-7d443c06-6558-448a-96c8-38706a752e9f tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:01:06.460240 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-7d443c06-6558-448a-96c8-38706a752e9f tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:01:06.460698 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.objects.instance [None req-7d443c06-6558-448a-96c8-38706a752e9f tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lazy-loading 'fault' on Instance uuid 1c2ec1ba-e381-4083-a794-c8ff83beb391 {{(pid=125243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 15 14:01:06.507362 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-7d443c06-6558-448a-96c8-38706a752e9f tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10fc1a48c9c41eaa1bf3ff2e4109657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1976b27e84a4484ba9d46a4244b08699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 14:01:06.516915 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-7d443c06-6558-448a-96c8-38706a752e9f tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] 10.222.0.36 "GET /compute/v2.1/servers/1c2ec1ba-e381-4083-a794-c8ff83beb391" status: 200 len: 1331 microversion: 2.1 time: 0.108882 Oct 15 14:01:06.518009 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 542/1088] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 14:01:06 2022] GET /compute/v2.1/servers/1c2ec1ba-e381-4083-a794-c8ff83beb391 => generated 1331 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 14:01:07.543369 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-8406ebe9-21bc-4874-8493-40eaec1ae75d tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 14:01:07.544132 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-8406ebe9-21bc-4874-8493-40eaec1ae75d tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] [instance: 1c2ec1ba-e381-4083-a794-c8ff83beb391] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 14:01:07.551118 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-8406ebe9-21bc-4874-8493-40eaec1ae75d tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:01:07.551605 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-8406ebe9-21bc-4874-8493-40eaec1ae75d tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:01:07.552084 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-8406ebe9-21bc-4874-8493-40eaec1ae75d tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:01:07.553041 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-8406ebe9-21bc-4874-8493-40eaec1ae75d tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:01:07.553288 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-8406ebe9-21bc-4874-8493-40eaec1ae75d tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:01:07.553717 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-8406ebe9-21bc-4874-8493-40eaec1ae75d tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:01:07.567802 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.wsgi [None req-8406ebe9-21bc-4874-8493-40eaec1ae75d tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] HTTP exception thrown: Instance 1c2ec1ba-e381-4083-a794-c8ff83beb391 could not be found. Oct 15 14:01:07.569827 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-8406ebe9-21bc-4874-8493-40eaec1ae75d tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Request method failure captured: Oct 15 14:01:07.569827 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: request: GET /compute/v2.1/servers/1c2ec1ba-e381-4083-a794-c8ff83beb391 HTTP/1.1 Oct 15 14:01:07.569827 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Accept: application/json Oct 15 14:01:07.569827 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Accept-Encoding: identity Oct 15 14:01:07.569827 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Connection: close Oct 15 14:01:07.569827 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Content-Length: 0 Oct 15 14:01:07.569827 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Content-Type: application/json Oct 15 14:01:07.569827 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Host: 10.222.0.36 Oct 15 14:01:07.569827 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Openstack-System-Scope: None Oct 15 14:01:07.569827 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: User-Agent: python-urllib3/1.26.12 Oct 15 14:01:07.569827 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Auth-Token: gAAAAABjSrwjLfc9eO9Ga-oGlJy_0-kXrWYl6E9iQsuiX0FzsrMojKgz761L4MHPRenZAoUO0wQyqfJ45bvEQq8ApfN15Y_P6uN8Md3wWVEiU_I4JYoXqcUDzANpGGWqTMo-HatpcMRcOiXDjsl3AXX5mHMNQbkMjtIRLTfF6ftg2a6TfPRcK1g Oct 15 14:01:07.569827 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Domain-Id: None Oct 15 14:01:07.569827 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Domain-Name: None Oct 15 14:01:07.569827 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Identity-Status: Confirmed Oct 15 14:01:07.569827 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Is-Admin-Project: True Oct 15 14:01:07.569827 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Project-Domain-Id: default Oct 15 14:01:07.569827 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Project-Domain-Name: Default Oct 15 14:01:07.569827 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Project-Id: 1976b27e84a4484ba9d46a4244b08699 Oct 15 14:01:07.569827 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Project-Name: tempest-AttachVolumeNegativeTest-20916687 Oct 15 14:01:07.569827 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Role: member,reader Oct 15 14:01:07.569827 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Roles: member,reader Oct 15 14:01:07.571474 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_1976b27e84a4484ba9d46a4244b08699", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/1976b27e84a4484ba9d46a4244b08699"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/1976b27e84a4484ba9d46a4244b08699"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/1976b27e84a4484ba9d46a4244b08699"}]}] Oct 15 14:01:07.571474 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Tenant: tempest-AttachVolumeNegativeTest-20916687 Oct 15 14:01:07.571474 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Tenant-Id: 1976b27e84a4484ba9d46a4244b08699 Oct 15 14:01:07.571474 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-20916687 Oct 15 14:01:07.571474 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-User: tempest-AttachVolumeNegativeTest-20916687-project Oct 15 14:01:07.571474 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-User-Domain-Id: default Oct 15 14:01:07.571474 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-User-Domain-Name: Default Oct 15 14:01:07.571474 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-User-Id: a10fc1a48c9c41eaa1bf3ff2e4109657 Oct 15 14:01:07.571474 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-User-Name: tempest-AttachVolumeNegativeTest-20916687-project Oct 15 14:01:07.571474 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: method: > Oct 15 14:01:07.571474 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: exception: Instance 1c2ec1ba-e381-4083-a794-c8ff83beb391 could not be found. Oct 15 14:01:07.571474 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: action_args: {'id': '1c2ec1ba-e381-4083-a794-c8ff83beb391'} Oct 15 14:01:07.572404 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 15 14:01:07.572404 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 14:01:07.572404 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 15 14:01:07.572404 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 15 14:01:07.572404 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 15 14:01:07.572404 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 15 14:01:07.572404 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 15 14:01:07.572404 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 15 14:01:07.572404 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 15 14:01:07.572404 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 15 14:01:07.572404 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c2ec1ba-e381-4083-a794-c8ff83beb391 could not be found. Oct 15 14:01:07.572404 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Oct 15 14:01:07.572404 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 14:01:07.572404 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Oct 15 14:01:07.572404 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 14:01:07.572404 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 14:01:07.572404 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 14:01:07.572404 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 15 14:01:07.572404 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 15 14:01:07.572404 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 15 14:01:07.573885 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 15 14:01:07.573885 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 15 14:01:07.573885 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 15 14:01:07.573885 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 15 14:01:07.573885 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 15 14:01:07.573885 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 15 14:01:07.573885 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 15 14:01:07.573885 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c2ec1ba-e381-4083-a794-c8ff83beb391 could not be found. Oct 15 14:01:07.573885 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Oct 15 14:01:07.573885 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 14:01:07.573885 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Oct 15 14:01:07.573885 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 14:01:07.573885 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 14:01:07.573885 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 14:01:07.573885 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 15 14:01:07.573885 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 15 14:01:07.573885 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c2ec1ba-e381-4083-a794-c8ff83beb391 could not be found. Oct 15 14:01:07.573885 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Oct 15 14:01:07.575269 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-8406ebe9-21bc-4874-8493-40eaec1ae75d tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Returning 404 to user: Instance 1c2ec1ba-e381-4083-a794-c8ff83beb391 could not be found. {{(pid=125242) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 15 14:01:07.575269 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-8406ebe9-21bc-4874-8493-40eaec1ae75d tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] 10.222.0.36 "GET /compute/v2.1/servers/1c2ec1ba-e381-4083-a794-c8ff83beb391" status: 404 len: 111 microversion: 2.1 time: 0.032657 Oct 15 14:01:07.575269 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 547/1089] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 14:01:07 2022] GET /compute/v2.1/servers/1c2ec1ba-e381-4083-a794-c8ff83beb391 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 15 14:01:07.580644 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-73cea1ee-e390-4004-b32d-65b2b38d0a37 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Calling method '.version_select at 0x7f1b5e34e820>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 14:01:07.604716 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-73cea1ee-e390-4004-b32d-65b2b38d0a37 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1861952530" status: 202 len: 0 microversion: 2.1 time: 0.027889 Oct 15 14:01:07.605492 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 543/1090] 10.222.0.36 () {58 vars in 1221 bytes} [Sat Oct 15 14:01:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1861952530 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 15 14:01:08.331901 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-839b6359-154d-4cc3-8caf-6a255b4c986b tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 14:01:08.332453 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-839b6359-154d-4cc3-8caf-6a255b4c986b tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] [instance: 00959d34-6e9e-4c3d-a32b-1dfc66397406] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 14:01:08.341355 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-839b6359-154d-4cc3-8caf-6a255b4c986b tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:01:08.342021 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-839b6359-154d-4cc3-8caf-6a255b4c986b tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:01:08.342592 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-839b6359-154d-4cc3-8caf-6a255b4c986b tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:01:08.343664 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-839b6359-154d-4cc3-8caf-6a255b4c986b tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:01:08.344428 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-839b6359-154d-4cc3-8caf-6a255b4c986b tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:01:08.345049 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-839b6359-154d-4cc3-8caf-6a255b4c986b tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:01:08.437057 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.objects.instance [None req-839b6359-154d-4cc3-8caf-6a255b4c986b tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lazy-loading 'services' on Instance uuid 00959d34-6e9e-4c3d-a32b-1dfc66397406 {{(pid=125242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 15 14:01:08.525078 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-839b6359-154d-4cc3-8caf-6a255b4c986b tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] 10.222.0.36 "DELETE /compute/v2.1/servers/00959d34-6e9e-4c3d-a32b-1dfc66397406/os-volume_attachments/3f610ed0-3c89-42cd-b494-e8c57fb46ede" status: 202 len: 0 microversion: 2.1 time: 0.197118 Oct 15 14:01:08.525759 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 548/1091] 10.222.0.36 () {58 vars in 1416 bytes} [Sat Oct 15 14:01:08 2022] DELETE /compute/v2.1/servers/00959d34-6e9e-4c3d-a32b-1dfc66397406/os-volume_attachments/3f610ed0-3c89-42cd-b494-e8c57fb46ede => generated 0 bytes in 199 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 15 14:01:08.534924 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-1f50afc6-c804-4892-a988-3a75d1fef22a tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 14:01:08.537244 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-1f50afc6-c804-4892-a988-3a75d1fef22a tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] [instance: 00959d34-6e9e-4c3d-a32b-1dfc66397406] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 14:01:08.544669 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-1f50afc6-c804-4892-a988-3a75d1fef22a tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:01:08.545207 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-1f50afc6-c804-4892-a988-3a75d1fef22a tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:01:08.545590 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-1f50afc6-c804-4892-a988-3a75d1fef22a tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:01:08.546391 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-1f50afc6-c804-4892-a988-3a75d1fef22a tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:01:08.546869 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-1f50afc6-c804-4892-a988-3a75d1fef22a tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:01:08.547298 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-1f50afc6-c804-4892-a988-3a75d1fef22a tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:01:08.579707 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-1f50afc6-c804-4892-a988-3a75d1fef22a tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] 10.222.0.36 "GET /compute/v2.1/servers/00959d34-6e9e-4c3d-a32b-1dfc66397406/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048813 Oct 15 14:01:08.580288 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 544/1092] 10.222.0.36 () {58 vars in 1302 bytes} [Sat Oct 15 14:01:08 2022] GET /compute/v2.1/servers/00959d34-6e9e-4c3d-a32b-1dfc66397406/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 15 14:01:09.594311 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-39478f04-73ff-49d4-b950-abc1007c9970 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 14:01:09.596630 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-39478f04-73ff-49d4-b950-abc1007c9970 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] [instance: 00959d34-6e9e-4c3d-a32b-1dfc66397406] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 14:01:09.604300 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-39478f04-73ff-49d4-b950-abc1007c9970 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:01:09.604796 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-39478f04-73ff-49d4-b950-abc1007c9970 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:01:09.605241 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-39478f04-73ff-49d4-b950-abc1007c9970 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:01:09.605950 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-39478f04-73ff-49d4-b950-abc1007c9970 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:01:09.606405 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-39478f04-73ff-49d4-b950-abc1007c9970 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:01:09.606831 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-39478f04-73ff-49d4-b950-abc1007c9970 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:01:09.640274 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-39478f04-73ff-49d4-b950-abc1007c9970 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] 10.222.0.36 "GET /compute/v2.1/servers/00959d34-6e9e-4c3d-a32b-1dfc66397406/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050882 Oct 15 14:01:09.640857 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 549/1093] 10.222.0.36 () {58 vars in 1302 bytes} [Sat Oct 15 14:01:09 2022] GET /compute/v2.1/servers/00959d34-6e9e-4c3d-a32b-1dfc66397406/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 15 14:01:09.706614 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-3c21afe1-f4c6-4ef9-8d9a-bd8f83563400 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 14:01:09.707221 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-3c21afe1-f4c6-4ef9-8d9a-bd8f83563400 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] [instance: 00959d34-6e9e-4c3d-a32b-1dfc66397406] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 14:01:09.714130 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-3c21afe1-f4c6-4ef9-8d9a-bd8f83563400 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:01:09.714619 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-3c21afe1-f4c6-4ef9-8d9a-bd8f83563400 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:01:09.715048 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-3c21afe1-f4c6-4ef9-8d9a-bd8f83563400 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:01:09.715814 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-3c21afe1-f4c6-4ef9-8d9a-bd8f83563400 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:01:09.716568 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-3c21afe1-f4c6-4ef9-8d9a-bd8f83563400 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:01:09.716994 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-3c21afe1-f4c6-4ef9-8d9a-bd8f83563400 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:01:09.747081 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-3c21afe1-f4c6-4ef9-8d9a-bd8f83563400 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] [instance: 00959d34-6e9e-4c3d-a32b-1dfc66397406] Going to try to terminate instance {{(pid=125243) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 15 14:01:09.834870 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-3c21afe1-f4c6-4ef9-8d9a-bd8f83563400 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] 10.222.0.36 "DELETE /compute/v2.1/servers/00959d34-6e9e-4c3d-a32b-1dfc66397406" status: 204 len: 0 microversion: 2.1 time: 0.132427 Oct 15 14:01:09.835466 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 545/1094] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 15 14:01:09 2022] DELETE /compute/v2.1/servers/00959d34-6e9e-4c3d-a32b-1dfc66397406 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 15 14:01:09.844077 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-e7375ad9-a267-4e88-a19b-8901369554e4 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 14:01:09.844758 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-e7375ad9-a267-4e88-a19b-8901369554e4 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] [instance: 00959d34-6e9e-4c3d-a32b-1dfc66397406] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 14:01:09.850925 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-e7375ad9-a267-4e88-a19b-8901369554e4 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:01:09.851816 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-e7375ad9-a267-4e88-a19b-8901369554e4 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:01:09.852680 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-e7375ad9-a267-4e88-a19b-8901369554e4 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:01:09.853402 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-e7375ad9-a267-4e88-a19b-8901369554e4 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:01:09.853858 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-e7375ad9-a267-4e88-a19b-8901369554e4 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:01:09.854276 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-e7375ad9-a267-4e88-a19b-8901369554e4 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:01:09.998403 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-e7375ad9-a267-4e88-a19b-8901369554e4 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10fc1a48c9c41eaa1bf3ff2e4109657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1976b27e84a4484ba9d46a4244b08699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 14:01:10.006704 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-e7375ad9-a267-4e88-a19b-8901369554e4 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] 10.222.0.36 "GET /compute/v2.1/servers/00959d34-6e9e-4c3d-a32b-1dfc66397406" status: 200 len: 1681 microversion: 2.1 time: 0.166839 Oct 15 14:01:10.007280 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 550/1095] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 14:01:09 2022] GET /compute/v2.1/servers/00959d34-6e9e-4c3d-a32b-1dfc66397406 => generated 1681 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 14:01:11.035460 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-7c609772-7424-48de-be6d-91dbd320325c tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 14:01:11.036434 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-7c609772-7424-48de-be6d-91dbd320325c tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] [instance: 00959d34-6e9e-4c3d-a32b-1dfc66397406] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 14:01:11.044440 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-7c609772-7424-48de-be6d-91dbd320325c tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:01:11.044924 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-7c609772-7424-48de-be6d-91dbd320325c tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:01:11.045354 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-7c609772-7424-48de-be6d-91dbd320325c tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:01:11.046048 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-7c609772-7424-48de-be6d-91dbd320325c tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:01:11.046496 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-7c609772-7424-48de-be6d-91dbd320325c tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:01:11.046911 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-7c609772-7424-48de-be6d-91dbd320325c tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:01:11.196463 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-7c609772-7424-48de-be6d-91dbd320325c tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10fc1a48c9c41eaa1bf3ff2e4109657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1976b27e84a4484ba9d46a4244b08699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 14:01:11.206655 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-7c609772-7424-48de-be6d-91dbd320325c tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] 10.222.0.36 "GET /compute/v2.1/servers/00959d34-6e9e-4c3d-a32b-1dfc66397406" status: 200 len: 1681 microversion: 2.1 time: 0.178025 Oct 15 14:01:11.207407 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 546/1096] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 14:01:11 2022] GET /compute/v2.1/servers/00959d34-6e9e-4c3d-a32b-1dfc66397406 => generated 1681 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 14:01:12.231495 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-ab561514-832d-4dd0-83ba-71f615d8b915 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 14:01:12.232444 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-ab561514-832d-4dd0-83ba-71f615d8b915 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] [instance: 00959d34-6e9e-4c3d-a32b-1dfc66397406] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 14:01:12.239202 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-ab561514-832d-4dd0-83ba-71f615d8b915 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:01:12.239702 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-ab561514-832d-4dd0-83ba-71f615d8b915 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:01:12.240175 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-ab561514-832d-4dd0-83ba-71f615d8b915 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:01:12.240982 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-ab561514-832d-4dd0-83ba-71f615d8b915 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:01:12.241462 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-ab561514-832d-4dd0-83ba-71f615d8b915 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:01:12.241887 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-ab561514-832d-4dd0-83ba-71f615d8b915 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:01:12.379776 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-ab561514-832d-4dd0-83ba-71f615d8b915 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10fc1a48c9c41eaa1bf3ff2e4109657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1976b27e84a4484ba9d46a4244b08699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 14:01:12.388115 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-ab561514-832d-4dd0-83ba-71f615d8b915 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] 10.222.0.36 "GET /compute/v2.1/servers/00959d34-6e9e-4c3d-a32b-1dfc66397406" status: 200 len: 1681 microversion: 2.1 time: 0.161314 Oct 15 14:01:12.388681 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 551/1097] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 14:01:12 2022] GET /compute/v2.1/servers/00959d34-6e9e-4c3d-a32b-1dfc66397406 => generated 1681 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 14:01:12.693802 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [req-542c209b-aec8-4433-82c7-784e78b53294 req-038446fa-719b-40dc-b3d0-498692d0cac0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00959d34-6e9e-4c3d-a32b-1dfc66397406", "name": "network-vif-deleted", "tag": "ea820bb3-7b18-44f5-9f71-bc5999daab15"}]} {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 14:01:12.717262 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [req-542c209b-aec8-4433-82c7-784e78b53294 req-038446fa-719b-40dc-b3d0-498692d0cac0 service nova] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:01:12.717951 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [req-542c209b-aec8-4433-82c7-784e78b53294 req-038446fa-719b-40dc-b3d0-498692d0cac0 service nova] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:01:12.718475 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [req-542c209b-aec8-4433-82c7-784e78b53294 req-038446fa-719b-40dc-b3d0-498692d0cac0 service nova] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:01:12.755505 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.compute.server_external_events [req-542c209b-aec8-4433-82c7-784e78b53294 req-038446fa-719b-40dc-b3d0-498692d0cac0 service nova] Creating event network-vif-deleted:ea820bb3-7b18-44f5-9f71-bc5999daab15 for instance 00959d34-6e9e-4c3d-a32b-1dfc66397406 on hv-cinder-86149 Oct 15 14:01:12.762626 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [req-542c209b-aec8-4433-82c7-784e78b53294 req-038446fa-719b-40dc-b3d0-498692d0cac0 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072465 Oct 15 14:01:12.763642 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 547/1098] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 15 14:01:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 14:01:13.415018 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-28ba42c0-783e-4688-bcbe-d6246d5b1428 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 14:01:13.415792 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-28ba42c0-783e-4688-bcbe-d6246d5b1428 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] [instance: 00959d34-6e9e-4c3d-a32b-1dfc66397406] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 14:01:13.423144 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-28ba42c0-783e-4688-bcbe-d6246d5b1428 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:01:13.423750 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-28ba42c0-783e-4688-bcbe-d6246d5b1428 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:01:13.424287 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-28ba42c0-783e-4688-bcbe-d6246d5b1428 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:01:13.425083 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-28ba42c0-783e-4688-bcbe-d6246d5b1428 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:01:13.425605 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-28ba42c0-783e-4688-bcbe-d6246d5b1428 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:01:13.426107 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-28ba42c0-783e-4688-bcbe-d6246d5b1428 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:01:13.441244 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.wsgi [None req-28ba42c0-783e-4688-bcbe-d6246d5b1428 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] HTTP exception thrown: Instance 00959d34-6e9e-4c3d-a32b-1dfc66397406 could not be found. Oct 15 14:01:13.442945 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-28ba42c0-783e-4688-bcbe-d6246d5b1428 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Request method failure captured: Oct 15 14:01:13.442945 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: request: GET /compute/v2.1/servers/00959d34-6e9e-4c3d-a32b-1dfc66397406 HTTP/1.1 Oct 15 14:01:13.442945 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Accept: application/json Oct 15 14:01:13.442945 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Accept-Encoding: identity Oct 15 14:01:13.442945 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Connection: close Oct 15 14:01:13.442945 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Content-Length: 0 Oct 15 14:01:13.442945 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Content-Type: application/json Oct 15 14:01:13.442945 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Host: 10.222.0.36 Oct 15 14:01:13.442945 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Openstack-System-Scope: None Oct 15 14:01:13.442945 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: User-Agent: python-urllib3/1.26.12 Oct 15 14:01:13.442945 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Auth-Token: gAAAAABjSrwjLfc9eO9Ga-oGlJy_0-kXrWYl6E9iQsuiX0FzsrMojKgz761L4MHPRenZAoUO0wQyqfJ45bvEQq8ApfN15Y_P6uN8Md3wWVEiU_I4JYoXqcUDzANpGGWqTMo-HatpcMRcOiXDjsl3AXX5mHMNQbkMjtIRLTfF6ftg2a6TfPRcK1g Oct 15 14:01:13.442945 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Domain-Id: None Oct 15 14:01:13.442945 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Domain-Name: None Oct 15 14:01:13.442945 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Identity-Status: Confirmed Oct 15 14:01:13.442945 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Is-Admin-Project: True Oct 15 14:01:13.442945 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Project-Domain-Id: default Oct 15 14:01:13.442945 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Project-Domain-Name: Default Oct 15 14:01:13.442945 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Project-Id: 1976b27e84a4484ba9d46a4244b08699 Oct 15 14:01:13.442945 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Project-Name: tempest-AttachVolumeNegativeTest-20916687 Oct 15 14:01:13.442945 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Role: member,reader Oct 15 14:01:13.442945 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Roles: member,reader Oct 15 14:01:13.444652 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_1976b27e84a4484ba9d46a4244b08699", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/1976b27e84a4484ba9d46a4244b08699"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/1976b27e84a4484ba9d46a4244b08699"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/1976b27e84a4484ba9d46a4244b08699"}]}] Oct 15 14:01:13.444652 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Tenant: tempest-AttachVolumeNegativeTest-20916687 Oct 15 14:01:13.444652 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Tenant-Id: 1976b27e84a4484ba9d46a4244b08699 Oct 15 14:01:13.444652 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-20916687 Oct 15 14:01:13.444652 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-User: tempest-AttachVolumeNegativeTest-20916687-project Oct 15 14:01:13.444652 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-User-Domain-Id: default Oct 15 14:01:13.444652 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-User-Domain-Name: Default Oct 15 14:01:13.444652 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-User-Id: a10fc1a48c9c41eaa1bf3ff2e4109657 Oct 15 14:01:13.444652 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-User-Name: tempest-AttachVolumeNegativeTest-20916687-project Oct 15 14:01:13.444652 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: method: > Oct 15 14:01:13.444652 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: exception: Instance 00959d34-6e9e-4c3d-a32b-1dfc66397406 could not be found. Oct 15 14:01:13.444652 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: action_args: {'id': '00959d34-6e9e-4c3d-a32b-1dfc66397406'} Oct 15 14:01:13.445971 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 15 14:01:13.445971 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 14:01:13.445971 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 15 14:01:13.445971 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 15 14:01:13.445971 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 15 14:01:13.445971 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 15 14:01:13.445971 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 15 14:01:13.445971 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 15 14:01:13.445971 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 15 14:01:13.445971 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 15 14:01:13.445971 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00959d34-6e9e-4c3d-a32b-1dfc66397406 could not be found. Oct 15 14:01:13.445971 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Oct 15 14:01:13.445971 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 14:01:13.445971 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Oct 15 14:01:13.445971 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 14:01:13.445971 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 14:01:13.445971 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 14:01:13.445971 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 15 14:01:13.445971 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 15 14:01:13.445971 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 15 14:01:13.447273 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 15 14:01:13.447273 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 15 14:01:13.447273 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 15 14:01:13.447273 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 15 14:01:13.447273 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 15 14:01:13.447273 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 15 14:01:13.447273 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 15 14:01:13.447273 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00959d34-6e9e-4c3d-a32b-1dfc66397406 could not be found. Oct 15 14:01:13.447273 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Oct 15 14:01:13.447273 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 14:01:13.447273 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Oct 15 14:01:13.447273 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 14:01:13.447273 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 14:01:13.447273 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 14:01:13.447273 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 15 14:01:13.447273 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 15 14:01:13.447273 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00959d34-6e9e-4c3d-a32b-1dfc66397406 could not be found. Oct 15 14:01:13.447273 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Oct 15 14:01:13.448528 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-28ba42c0-783e-4688-bcbe-d6246d5b1428 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Returning 404 to user: Instance 00959d34-6e9e-4c3d-a32b-1dfc66397406 could not be found. {{(pid=125242) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 15 14:01:13.448528 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-28ba42c0-783e-4688-bcbe-d6246d5b1428 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] 10.222.0.36 "GET /compute/v2.1/servers/00959d34-6e9e-4c3d-a32b-1dfc66397406" status: 404 len: 111 microversion: 2.1 time: 0.033742 Oct 15 14:01:13.448528 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 552/1099] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 14:01:13 2022] GET /compute/v2.1/servers/00959d34-6e9e-4c3d-a32b-1dfc66397406 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 15 14:01:13.454247 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-5bba4725-576d-4381-981a-75ef61fb562d tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Calling method '.version_select at 0x7f1b5e33eee0>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 14:01:13.477985 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-5bba4725-576d-4381-981a-75ef61fb562d tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1921749236" status: 202 len: 0 microversion: 2.1 time: 0.027637 Oct 15 14:01:13.478663 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 548/1100] 10.222.0.36 () {58 vars in 1221 bytes} [Sat Oct 15 14:01:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1921749236 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 15 14:01:14.150733 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-3b17bb4d-e1fe-468d-8acd-b5a6618d4a6e tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Action: 'create', calling method: .version_select at 0x7f1b5e187dc0>, body: {"keypair": {"name": "tempest-keypair-1389710918", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDkY4hXiNR6eyP5ukTH6UmOySR2lr8sFuVDAvjIt//SM81t3OPyofZovx+I1fr5l2XYXAB91xeDeScPxKTn4kXPABq9XGYflULOM7cTMj+BY1FY4bydgrFHlE46BffAeMA=="}} {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 14:01:14.166489 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.quota [None req-3b17bb4d-e1fe-468d-8acd-b5a6618d4a6e tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Getting quotas for project 1976b27e84a4484ba9d46a4244b08699. Resources: {'key_pairs'} {{(pid=125242) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 15 14:01:14.170858 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.quota [None req-3b17bb4d-e1fe-468d-8acd-b5a6618d4a6e tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Getting quotas for user a10fc1a48c9c41eaa1bf3ff2e4109657 and project 1976b27e84a4484ba9d46a4244b08699. Resources: {'key_pairs'} {{(pid=125242) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 15 14:01:14.194920 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-3b17bb4d-e1fe-468d-8acd-b5a6618d4a6e tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.048694 Oct 15 14:01:14.195526 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 553/1101] 10.222.0.36 () {60 vars in 1159 bytes} [Sat Oct 15 14:01:14 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 14:01:15.541304 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-292c91f3-5a51-4ee9-800d-373750af4843 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1596726376", "imageRef": "26e64909-1cae-49ca-af5e-adea40c062d7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b6c514f8-1a01-4cc0-b2b4-f8ec3eab2ef0"}], "security_groups": [{"name": "tempest-securitygroup--949353610"}], "key_name": "tempest-keypair-1389710918", "user_data": "}} {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 14:01:15.655358 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.network.neutron [None req-292c91f3-5a51-4ee9-800d-373750af4843 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] validate_networks() for [('b6c514f8-1a01-4cc0-b2b4-f8ec3eab2ef0', None, None, None, None, None)] {{(pid=125243) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 15 14:01:16.057922 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.virt.hardware [None req-292c91f3-5a51-4ee9-800d-373750af4843 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Flavor limits 0:0:0 {{(pid=125243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 15 14:01:16.058460 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.virt.hardware [None req-292c91f3-5a51-4ee9-800d-373750af4843 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Image limits 0:0:0 {{(pid=125243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 15 14:01:16.058935 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.virt.hardware [None req-292c91f3-5a51-4ee9-800d-373750af4843 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Flavor pref 0:0:0 {{(pid=125243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 15 14:01:16.059463 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.virt.hardware [None req-292c91f3-5a51-4ee9-800d-373750af4843 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Image pref 0:0:0 {{(pid=125243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 15 14:01:16.059893 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.virt.hardware [None req-292c91f3-5a51-4ee9-800d-373750af4843 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 15 14:01:16.068748 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-292c91f3-5a51-4ee9-800d-373750af4843 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:01:16.069217 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-292c91f3-5a51-4ee9-800d-373750af4843 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:01:16.069642 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-292c91f3-5a51-4ee9-800d-373750af4843 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:01:16.070350 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-292c91f3-5a51-4ee9-800d-373750af4843 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:01:16.070827 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-292c91f3-5a51-4ee9-800d-373750af4843 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:01:16.071252 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-292c91f3-5a51-4ee9-800d-373750af4843 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:01:16.089981 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.quota [None req-292c91f3-5a51-4ee9-800d-373750af4843 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Getting quotas for project 1976b27e84a4484ba9d46a4244b08699. Resources: {'cores', 'ram', 'instances'} {{(pid=125243) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 15 14:01:16.094385 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.quota [None req-292c91f3-5a51-4ee9-800d-373750af4843 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Getting quotas for user a10fc1a48c9c41eaa1bf3ff2e4109657 and project 1976b27e84a4484ba9d46a4244b08699. Resources: {'cores', 'ram', 'instances'} {{(pid=125243) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 15 14:01:16.106793 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-292c91f3-5a51-4ee9-800d-373750af4843 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Going to run 1 instances... {{(pid=125243) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 15 14:01:16.109235 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-292c91f3-5a51-4ee9-800d-373750af4843 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] [instance: 023bca17-a19b-4428-9008-ec108226f7f4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='26e64909-1cae-49ca-af5e-adea40c062d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125243) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 15 14:01:16.159953 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-292c91f3-5a51-4ee9-800d-373750af4843 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.622986 Oct 15 14:01:16.160765 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 549/1102] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 15 14:01:15 2022] POST /compute/v2.1/servers => generated 401 bytes in 624 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 15 14:01:16.172291 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-adb0fa0f-e880-447b-8c34-4843b874b94c tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 14:01:16.172910 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-adb0fa0f-e880-447b-8c34-4843b874b94c tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] [instance: 023bca17-a19b-4428-9008-ec108226f7f4] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 14:01:16.231352 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-adb0fa0f-e880-447b-8c34-4843b874b94c tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10fc1a48c9c41eaa1bf3ff2e4109657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1976b27e84a4484ba9d46a4244b08699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 14:01:16.238846 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-adb0fa0f-e880-447b-8c34-4843b874b94c tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] 10.222.0.36 "GET /compute/v2.1/servers/023bca17-a19b-4428-9008-ec108226f7f4" status: 200 len: 1242 microversion: 2.1 time: 0.070961 Oct 15 14:01:16.239430 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 554/1103] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 14:01:16 2022] GET /compute/v2.1/servers/023bca17-a19b-4428-9008-ec108226f7f4 => generated 1242 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 14:01:17.263298 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-b3987a75-eed8-45a2-8756-32a449dadf6d tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 14:01:17.264002 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-b3987a75-eed8-45a2-8756-32a449dadf6d tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] [instance: 023bca17-a19b-4428-9008-ec108226f7f4] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 14:01:17.273590 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-b3987a75-eed8-45a2-8756-32a449dadf6d tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:01:17.274292 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-b3987a75-eed8-45a2-8756-32a449dadf6d tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:01:17.274830 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-b3987a75-eed8-45a2-8756-32a449dadf6d tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:01:17.275555 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-b3987a75-eed8-45a2-8756-32a449dadf6d tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:01:17.276216 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-b3987a75-eed8-45a2-8756-32a449dadf6d tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:01:17.277008 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-b3987a75-eed8-45a2-8756-32a449dadf6d tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:01:17.375514 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-b3987a75-eed8-45a2-8756-32a449dadf6d tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10fc1a48c9c41eaa1bf3ff2e4109657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1976b27e84a4484ba9d46a4244b08699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 14:01:17.385168 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-b3987a75-eed8-45a2-8756-32a449dadf6d tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] 10.222.0.36 "GET /compute/v2.1/servers/023bca17-a19b-4428-9008-ec108226f7f4" status: 200 len: 1302 microversion: 2.1 time: 0.126925 Oct 15 14:01:17.387114 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 550/1104] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 14:01:17 2022] GET /compute/v2.1/servers/023bca17-a19b-4428-9008-ec108226f7f4 => generated 1302 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 14:01:18.409950 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-bb27dbda-8b2d-450a-89c4-ca6f6d703cbc tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 14:01:18.410584 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-bb27dbda-8b2d-450a-89c4-ca6f6d703cbc tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] [instance: 023bca17-a19b-4428-9008-ec108226f7f4] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 14:01:18.417791 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-bb27dbda-8b2d-450a-89c4-ca6f6d703cbc tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:01:18.418384 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-bb27dbda-8b2d-450a-89c4-ca6f6d703cbc tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:01:18.418882 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-bb27dbda-8b2d-450a-89c4-ca6f6d703cbc tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:01:18.419685 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-bb27dbda-8b2d-450a-89c4-ca6f6d703cbc tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:01:18.420273 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-bb27dbda-8b2d-450a-89c4-ca6f6d703cbc tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:01:18.420695 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-bb27dbda-8b2d-450a-89c4-ca6f6d703cbc tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:01:18.561446 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-bb27dbda-8b2d-450a-89c4-ca6f6d703cbc tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10fc1a48c9c41eaa1bf3ff2e4109657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1976b27e84a4484ba9d46a4244b08699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 14:01:18.569793 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-bb27dbda-8b2d-450a-89c4-ca6f6d703cbc tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] 10.222.0.36 "GET /compute/v2.1/servers/023bca17-a19b-4428-9008-ec108226f7f4" status: 200 len: 1367 microversion: 2.1 time: 0.163731 Oct 15 14:01:18.570393 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 555/1105] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 14:01:18 2022] GET /compute/v2.1/servers/023bca17-a19b-4428-9008-ec108226f7f4 => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 14:01:19.013511 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [req-3c3e4317-4bd7-4d0b-9127-39d15608d38b req-9ef83ca0-e17e-4c9c-9355-0b051cbbcc85 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "023bca17-a19b-4428-9008-ec108226f7f4", "tag": "33c455e8-481d-448e-a7e0-7039d8c328b2"}]} {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 14:01:19.027171 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [req-3c3e4317-4bd7-4d0b-9127-39d15608d38b req-9ef83ca0-e17e-4c9c-9355-0b051cbbcc85 service nova] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:01:19.027948 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [req-3c3e4317-4bd7-4d0b-9127-39d15608d38b req-9ef83ca0-e17e-4c9c-9355-0b051cbbcc85 service nova] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:01:19.028390 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [req-3c3e4317-4bd7-4d0b-9127-39d15608d38b req-9ef83ca0-e17e-4c9c-9355-0b051cbbcc85 service nova] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:01:19.041291 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.compute.server_external_events [req-3c3e4317-4bd7-4d0b-9127-39d15608d38b req-9ef83ca0-e17e-4c9c-9355-0b051cbbcc85 service nova] Creating event network-changed:33c455e8-481d-448e-a7e0-7039d8c328b2 for instance 023bca17-a19b-4428-9008-ec108226f7f4 on hv-cinder-86149 Oct 15 14:01:19.046374 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [req-3c3e4317-4bd7-4d0b-9127-39d15608d38b req-9ef83ca0-e17e-4c9c-9355-0b051cbbcc85 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036914 Oct 15 14:01:19.046996 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 551/1106] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 15 14:01:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 14:01:19.593612 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-e74f6c2f-b887-490d-aa03-b73b4c59f575 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 14:01:19.594214 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-e74f6c2f-b887-490d-aa03-b73b4c59f575 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] [instance: 023bca17-a19b-4428-9008-ec108226f7f4] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 14:01:19.601743 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-e74f6c2f-b887-490d-aa03-b73b4c59f575 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:01:19.602217 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-e74f6c2f-b887-490d-aa03-b73b4c59f575 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:01:19.602648 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-e74f6c2f-b887-490d-aa03-b73b4c59f575 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:01:19.603344 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-e74f6c2f-b887-490d-aa03-b73b4c59f575 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:01:19.603797 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-e74f6c2f-b887-490d-aa03-b73b4c59f575 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:01:19.604270 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-e74f6c2f-b887-490d-aa03-b73b4c59f575 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:01:19.744912 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-e74f6c2f-b887-490d-aa03-b73b4c59f575 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10fc1a48c9c41eaa1bf3ff2e4109657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1976b27e84a4484ba9d46a4244b08699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 14:01:19.753438 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-e74f6c2f-b887-490d-aa03-b73b4c59f575 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] 10.222.0.36 "GET /compute/v2.1/servers/023bca17-a19b-4428-9008-ec108226f7f4" status: 200 len: 1367 microversion: 2.1 time: 0.163838 Oct 15 14:01:19.754016 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 556/1107] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 14:01:19 2022] GET /compute/v2.1/servers/023bca17-a19b-4428-9008-ec108226f7f4 => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 14:01:20.781040 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-2af9d19a-dd1e-4335-8f63-0dac3409559a tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 14:01:20.782143 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-2af9d19a-dd1e-4335-8f63-0dac3409559a tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] [instance: 023bca17-a19b-4428-9008-ec108226f7f4] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 14:01:20.792341 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-2af9d19a-dd1e-4335-8f63-0dac3409559a tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:01:20.792858 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-2af9d19a-dd1e-4335-8f63-0dac3409559a tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:01:20.793262 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-2af9d19a-dd1e-4335-8f63-0dac3409559a tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:01:20.793994 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-2af9d19a-dd1e-4335-8f63-0dac3409559a tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:01:20.794449 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-2af9d19a-dd1e-4335-8f63-0dac3409559a tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:01:20.794877 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-2af9d19a-dd1e-4335-8f63-0dac3409559a tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:01:20.940509 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-2af9d19a-dd1e-4335-8f63-0dac3409559a tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10fc1a48c9c41eaa1bf3ff2e4109657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1976b27e84a4484ba9d46a4244b08699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 14:01:20.950760 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-2af9d19a-dd1e-4335-8f63-0dac3409559a tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] 10.222.0.36 "GET /compute/v2.1/servers/023bca17-a19b-4428-9008-ec108226f7f4" status: 200 len: 1367 microversion: 2.1 time: 0.176733 Oct 15 14:01:20.951336 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 552/1108] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 14:01:20 2022] GET /compute/v2.1/servers/023bca17-a19b-4428-9008-ec108226f7f4 => generated 1367 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 14:01:21.973903 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-ae38fc36-e618-46f6-b07d-2cf8e56ee959 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 14:01:21.974466 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-ae38fc36-e618-46f6-b07d-2cf8e56ee959 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] [instance: 023bca17-a19b-4428-9008-ec108226f7f4] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 14:01:21.982961 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-ae38fc36-e618-46f6-b07d-2cf8e56ee959 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:01:21.983613 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-ae38fc36-e618-46f6-b07d-2cf8e56ee959 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:01:21.984122 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-ae38fc36-e618-46f6-b07d-2cf8e56ee959 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:01:21.984859 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-ae38fc36-e618-46f6-b07d-2cf8e56ee959 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:01:21.985319 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-ae38fc36-e618-46f6-b07d-2cf8e56ee959 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:01:21.985909 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-ae38fc36-e618-46f6-b07d-2cf8e56ee959 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:01:22.123166 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-ae38fc36-e618-46f6-b07d-2cf8e56ee959 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10fc1a48c9c41eaa1bf3ff2e4109657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1976b27e84a4484ba9d46a4244b08699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 14:01:22.131210 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-ae38fc36-e618-46f6-b07d-2cf8e56ee959 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] 10.222.0.36 "GET /compute/v2.1/servers/023bca17-a19b-4428-9008-ec108226f7f4" status: 200 len: 1367 microversion: 2.1 time: 0.161323 Oct 15 14:01:22.132151 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 557/1109] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 14:01:21 2022] GET /compute/v2.1/servers/023bca17-a19b-4428-9008-ec108226f7f4 => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 14:01:23.153943 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-5d2f2b94-38e4-4f75-aae5-be55d54fba9a tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 14:01:23.154583 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-5d2f2b94-38e4-4f75-aae5-be55d54fba9a tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] [instance: 023bca17-a19b-4428-9008-ec108226f7f4] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 14:01:23.162224 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-5d2f2b94-38e4-4f75-aae5-be55d54fba9a tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:01:23.162895 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-5d2f2b94-38e4-4f75-aae5-be55d54fba9a tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:01:23.163486 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-5d2f2b94-38e4-4f75-aae5-be55d54fba9a tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:01:23.164581 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-5d2f2b94-38e4-4f75-aae5-be55d54fba9a tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:01:23.165207 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-5d2f2b94-38e4-4f75-aae5-be55d54fba9a tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:01:23.165815 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-5d2f2b94-38e4-4f75-aae5-be55d54fba9a tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:01:23.304460 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-5d2f2b94-38e4-4f75-aae5-be55d54fba9a tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10fc1a48c9c41eaa1bf3ff2e4109657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1976b27e84a4484ba9d46a4244b08699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 14:01:23.313171 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-5d2f2b94-38e4-4f75-aae5-be55d54fba9a tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] 10.222.0.36 "GET /compute/v2.1/servers/023bca17-a19b-4428-9008-ec108226f7f4" status: 200 len: 1367 microversion: 2.1 time: 0.163302 Oct 15 14:01:23.313763 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 553/1110] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 14:01:23 2022] GET /compute/v2.1/servers/023bca17-a19b-4428-9008-ec108226f7f4 => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 14:01:24.336775 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-c65f8852-f3aa-490d-bad7-4b6368a59e14 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 14:01:24.337398 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-c65f8852-f3aa-490d-bad7-4b6368a59e14 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] [instance: 023bca17-a19b-4428-9008-ec108226f7f4] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 14:01:24.344613 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-c65f8852-f3aa-490d-bad7-4b6368a59e14 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:01:24.345103 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-c65f8852-f3aa-490d-bad7-4b6368a59e14 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:01:24.345535 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-c65f8852-f3aa-490d-bad7-4b6368a59e14 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:01:24.346228 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-c65f8852-f3aa-490d-bad7-4b6368a59e14 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:01:24.346682 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-c65f8852-f3aa-490d-bad7-4b6368a59e14 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:01:24.347104 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-c65f8852-f3aa-490d-bad7-4b6368a59e14 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:01:24.488159 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-c65f8852-f3aa-490d-bad7-4b6368a59e14 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10fc1a48c9c41eaa1bf3ff2e4109657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1976b27e84a4484ba9d46a4244b08699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 14:01:24.499696 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-c65f8852-f3aa-490d-bad7-4b6368a59e14 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] 10.222.0.36 "GET /compute/v2.1/servers/023bca17-a19b-4428-9008-ec108226f7f4" status: 200 len: 1367 microversion: 2.1 time: 0.166618 Oct 15 14:01:24.500566 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 558/1111] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 14:01:24 2022] GET /compute/v2.1/servers/023bca17-a19b-4428-9008-ec108226f7f4 => generated 1367 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 14:01:24.940572 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [req-126797ad-ddd0-47f5-870c-b5f6a90cca73 req-81264037-ec60-4adb-8664-5bf0d83e82d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "023bca17-a19b-4428-9008-ec108226f7f4", "name": "network-vif-plugged", "status": "completed", "tag": "33c455e8-481d-448e-a7e0-7039d8c328b2"}]} {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 14:01:24.951577 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [req-126797ad-ddd0-47f5-870c-b5f6a90cca73 req-81264037-ec60-4adb-8664-5bf0d83e82d1 service nova] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:01:24.952853 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [req-126797ad-ddd0-47f5-870c-b5f6a90cca73 req-81264037-ec60-4adb-8664-5bf0d83e82d1 service nova] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:01:24.953314 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [req-126797ad-ddd0-47f5-870c-b5f6a90cca73 req-81264037-ec60-4adb-8664-5bf0d83e82d1 service nova] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:01:24.965226 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.compute.server_external_events [req-126797ad-ddd0-47f5-870c-b5f6a90cca73 req-81264037-ec60-4adb-8664-5bf0d83e82d1 service nova] Creating event network-vif-plugged:33c455e8-481d-448e-a7e0-7039d8c328b2 for instance 023bca17-a19b-4428-9008-ec108226f7f4 on hv-cinder-86149 Oct 15 14:01:24.970338 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [req-126797ad-ddd0-47f5-870c-b5f6a90cca73 req-81264037-ec60-4adb-8664-5bf0d83e82d1 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033566 Oct 15 14:01:24.971228 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 554/1112] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 15 14:01:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 14:01:25.527197 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-67a4f163-d453-4c58-b692-32d07487c042 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 14:01:25.527791 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-67a4f163-d453-4c58-b692-32d07487c042 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] [instance: 023bca17-a19b-4428-9008-ec108226f7f4] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 14:01:25.534642 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-67a4f163-d453-4c58-b692-32d07487c042 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:01:25.535128 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-67a4f163-d453-4c58-b692-32d07487c042 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:01:25.535573 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-67a4f163-d453-4c58-b692-32d07487c042 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:01:25.536320 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-67a4f163-d453-4c58-b692-32d07487c042 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:01:25.536794 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-67a4f163-d453-4c58-b692-32d07487c042 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:01:25.537244 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-67a4f163-d453-4c58-b692-32d07487c042 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:01:25.680935 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-67a4f163-d453-4c58-b692-32d07487c042 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10fc1a48c9c41eaa1bf3ff2e4109657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1976b27e84a4484ba9d46a4244b08699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 14:01:25.689445 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-67a4f163-d453-4c58-b692-32d07487c042 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] 10.222.0.36 "GET /compute/v2.1/servers/023bca17-a19b-4428-9008-ec108226f7f4" status: 200 len: 1367 microversion: 2.1 time: 0.167982 Oct 15 14:01:25.690055 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 559/1113] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 14:01:25 2022] GET /compute/v2.1/servers/023bca17-a19b-4428-9008-ec108226f7f4 => generated 1367 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 14:01:26.713681 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-247b667d-6ae5-4b1d-90a8-d9232a12d698 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 14:01:26.714369 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-247b667d-6ae5-4b1d-90a8-d9232a12d698 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] [instance: 023bca17-a19b-4428-9008-ec108226f7f4] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 14:01:26.716853 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG dbcounter [-] [125243] Writing DB stats nova_cell0:SELECT=2 {{(pid=125243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 14:01:26.717521 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG dbcounter [-] [125243] Writing DB stats nova_cell0:SELECT=6 {{(pid=125243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 14:01:26.724355 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-247b667d-6ae5-4b1d-90a8-d9232a12d698 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:01:26.724844 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-247b667d-6ae5-4b1d-90a8-d9232a12d698 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:01:26.725283 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-247b667d-6ae5-4b1d-90a8-d9232a12d698 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:01:26.726304 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-247b667d-6ae5-4b1d-90a8-d9232a12d698 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:01:26.726756 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-247b667d-6ae5-4b1d-90a8-d9232a12d698 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:01:26.727175 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-247b667d-6ae5-4b1d-90a8-d9232a12d698 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:01:26.878281 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-247b667d-6ae5-4b1d-90a8-d9232a12d698 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10fc1a48c9c41eaa1bf3ff2e4109657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1976b27e84a4484ba9d46a4244b08699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 14:01:26.887029 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-247b667d-6ae5-4b1d-90a8-d9232a12d698 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] 10.222.0.36 "GET /compute/v2.1/servers/023bca17-a19b-4428-9008-ec108226f7f4" status: 200 len: 1558 microversion: 2.1 time: 0.177719 Oct 15 14:01:26.887624 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 555/1114] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 14:01:26 2022] GET /compute/v2.1/servers/023bca17-a19b-4428-9008-ec108226f7f4 => generated 1558 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 14:01:26.910183 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-9c96fd07-6005-425d-b530-c161766998c0 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 14:01:26.910721 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-9c96fd07-6005-425d-b530-c161766998c0 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] [instance: 023bca17-a19b-4428-9008-ec108226f7f4] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 14:01:26.912857 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG dbcounter [-] [125242] Writing DB stats nova_cell0:SELECT=6 {{(pid=125242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 14:01:26.919310 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-9c96fd07-6005-425d-b530-c161766998c0 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:01:26.919802 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-9c96fd07-6005-425d-b530-c161766998c0 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:01:26.920282 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-9c96fd07-6005-425d-b530-c161766998c0 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:01:26.920989 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-9c96fd07-6005-425d-b530-c161766998c0 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:01:26.921444 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-9c96fd07-6005-425d-b530-c161766998c0 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:01:26.921872 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-9c96fd07-6005-425d-b530-c161766998c0 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:01:27.015129 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-9c96fd07-6005-425d-b530-c161766998c0 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] 10.222.0.36 "GET /compute/v2.1/servers/023bca17-a19b-4428-9008-ec108226f7f4/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.108838 Oct 15 14:01:27.015994 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 560/1115] 10.222.0.36 () {58 vars in 1275 bytes} [Sat Oct 15 14:01:26 2022] GET /compute/v2.1/servers/023bca17-a19b-4428-9008-ec108226f7f4/os-interface => generated 285 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 14:01:28.305763 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [req-5a8677f7-8799-49b2-a247-2ad9d9831b09 req-5c427fa4-91ee-4f89-a82a-d4a49dc56f94 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "023bca17-a19b-4428-9008-ec108226f7f4", "tag": "33c455e8-481d-448e-a7e0-7039d8c328b2"}]} {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 14:01:28.315978 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [req-5a8677f7-8799-49b2-a247-2ad9d9831b09 req-5c427fa4-91ee-4f89-a82a-d4a49dc56f94 service nova] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:01:28.316453 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [req-5a8677f7-8799-49b2-a247-2ad9d9831b09 req-5c427fa4-91ee-4f89-a82a-d4a49dc56f94 service nova] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:01:28.316870 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [req-5a8677f7-8799-49b2-a247-2ad9d9831b09 req-5c427fa4-91ee-4f89-a82a-d4a49dc56f94 service nova] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:01:28.329591 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.compute.server_external_events [req-5a8677f7-8799-49b2-a247-2ad9d9831b09 req-5c427fa4-91ee-4f89-a82a-d4a49dc56f94 service nova] Creating event network-changed:33c455e8-481d-448e-a7e0-7039d8c328b2 for instance 023bca17-a19b-4428-9008-ec108226f7f4 on hv-cinder-86149 Oct 15 14:01:28.335141 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [req-5a8677f7-8799-49b2-a247-2ad9d9831b09 req-5c427fa4-91ee-4f89-a82a-d4a49dc56f94 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033082 Oct 15 14:01:28.336147 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 556/1116] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 15 14:01:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 14:02:43.367797 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG dbcounter [-] [125242] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=125242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 14:02:43.368903 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG dbcounter [-] [125242] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=125242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 14:02:43.545707 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-7bfc1d7e-78d2-46df-8e44-9c3956e8b7ce tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 14:02:43.546211 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-7bfc1d7e-78d2-46df-8e44-9c3956e8b7ce tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] [instance: 023bca17-a19b-4428-9008-ec108226f7f4] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 14:02:43.552969 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-7bfc1d7e-78d2-46df-8e44-9c3956e8b7ce tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:02:43.553455 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-7bfc1d7e-78d2-46df-8e44-9c3956e8b7ce tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:02:43.553885 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-7bfc1d7e-78d2-46df-8e44-9c3956e8b7ce tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:02:43.554577 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-7bfc1d7e-78d2-46df-8e44-9c3956e8b7ce tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:02:43.555060 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-7bfc1d7e-78d2-46df-8e44-9c3956e8b7ce tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:02:43.555433 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-7bfc1d7e-78d2-46df-8e44-9c3956e8b7ce tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:02:43.580819 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-7bfc1d7e-78d2-46df-8e44-9c3956e8b7ce tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] 10.222.0.36 "GET /compute/v2.1/servers/023bca17-a19b-4428-9008-ec108226f7f4/ips" status: 200 len: 151 microversion: 2.1 time: 0.215557 Oct 15 14:02:43.581379 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 561/1117] 10.222.0.36 () {58 vars in 1248 bytes} [Sat Oct 15 14:02:43 2022] GET /compute/v2.1/servers/023bca17-a19b-4428-9008-ec108226f7f4/ips => generated 151 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 14:02:44.944118 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG dbcounter [-] [125243] Writing DB stats nova_api:SELECT=58,nova_api:DELETE=2,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=125243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 14:02:44.945084 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG dbcounter [-] [125243] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 14:02:44.952589 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-80118285-8ec1-4c32-b049-3e2962fc1031 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "aa7fed95-a634-4448-b904-c76054878a05"}} {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 14:02:44.954951 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-80118285-8ec1-4c32-b049-3e2962fc1031 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] [instance: 023bca17-a19b-4428-9008-ec108226f7f4] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 14:02:44.963244 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-80118285-8ec1-4c32-b049-3e2962fc1031 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:02:44.963783 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-80118285-8ec1-4c32-b049-3e2962fc1031 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:02:44.964268 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-80118285-8ec1-4c32-b049-3e2962fc1031 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:02:44.964975 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-80118285-8ec1-4c32-b049-3e2962fc1031 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:02:44.965483 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-80118285-8ec1-4c32-b049-3e2962fc1031 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:02:44.965857 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-80118285-8ec1-4c32-b049-3e2962fc1031 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:02:45.236435 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-80118285-8ec1-4c32-b049-3e2962fc1031 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] 10.222.0.36 "POST /compute/v2.1/servers/023bca17-a19b-4428-9008-ec108226f7f4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.295975 Oct 15 14:02:45.237673 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 557/1118] 10.222.0.36 () {60 vars in 1323 bytes} [Sat Oct 15 14:02:44 2022] POST /compute/v2.1/servers/023bca17-a19b-4428-9008-ec108226f7f4/os-volume_attachments => generated 194 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 14:02:50.733924 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-8dfed702-7fe2-4c30-9e34-042125de7a9e tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 14:02:50.734572 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-8dfed702-7fe2-4c30-9e34-042125de7a9e tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] [instance: 31fd889c-ef07-468c-9cc5-3a3fd1b51d63] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 14:02:50.736770 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [req-552dbe21-aa22-4b4a-a1d8-b59256bcade1 req-05cfece5-b94a-4e79-99ab-b6f4e869ad2c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31fd889c-ef07-468c-9cc5-3a3fd1b51d63", "tag": "7c8bf8d7-7d37-4910-8609-6b29066a0947"}]} {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 14:02:50.741793 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-8dfed702-7fe2-4c30-9e34-042125de7a9e tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:02:50.742380 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-8dfed702-7fe2-4c30-9e34-042125de7a9e tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:02:50.742901 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-8dfed702-7fe2-4c30-9e34-042125de7a9e tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:02:50.743684 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-8dfed702-7fe2-4c30-9e34-042125de7a9e tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:02:50.744230 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-8dfed702-7fe2-4c30-9e34-042125de7a9e tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:02:50.744718 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-8dfed702-7fe2-4c30-9e34-042125de7a9e tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:02:50.748098 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [req-552dbe21-aa22-4b4a-a1d8-b59256bcade1 req-05cfece5-b94a-4e79-99ab-b6f4e869ad2c service nova] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:02:50.748589 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [req-552dbe21-aa22-4b4a-a1d8-b59256bcade1 req-05cfece5-b94a-4e79-99ab-b6f4e869ad2c service nova] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:02:50.749025 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [req-552dbe21-aa22-4b4a-a1d8-b59256bcade1 req-05cfece5-b94a-4e79-99ab-b6f4e869ad2c service nova] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:02:50.761113 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.compute.server_external_events [req-552dbe21-aa22-4b4a-a1d8-b59256bcade1 req-05cfece5-b94a-4e79-99ab-b6f4e869ad2c service nova] Creating event network-changed:7c8bf8d7-7d37-4910-8609-6b29066a0947 for instance 31fd889c-ef07-468c-9cc5-3a3fd1b51d63 on hv-cinder-86149 Oct 15 14:02:50.766536 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [req-552dbe21-aa22-4b4a-a1d8-b59256bcade1 req-05cfece5-b94a-4e79-99ab-b6f4e869ad2c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034107 Oct 15 14:02:50.767366 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 558/1119] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 15 14:02:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 14:02:50.772392 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-8dfed702-7fe2-4c30-9e34-042125de7a9e tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] [instance: 31fd889c-ef07-468c-9cc5-3a3fd1b51d63] Going to try to terminate instance {{(pid=125242) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 15 14:02:50.857074 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-8dfed702-7fe2-4c30-9e34-042125de7a9e tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] 10.222.0.36 "DELETE /compute/v2.1/servers/31fd889c-ef07-468c-9cc5-3a3fd1b51d63" status: 204 len: 0 microversion: 2.1 time: 0.127140 Oct 15 14:02:50.857666 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 562/1120] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 15 14:02:50 2022] DELETE /compute/v2.1/servers/31fd889c-ef07-468c-9cc5-3a3fd1b51d63 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 15 14:02:50.867204 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-c6911cb8-ec20-4fed-accd-f0a83e780f4b tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 14:02:50.867826 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-c6911cb8-ec20-4fed-accd-f0a83e780f4b tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] [instance: 31fd889c-ef07-468c-9cc5-3a3fd1b51d63] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 14:02:50.874368 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-c6911cb8-ec20-4fed-accd-f0a83e780f4b tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:02:50.874846 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-c6911cb8-ec20-4fed-accd-f0a83e780f4b tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:02:50.875301 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-c6911cb8-ec20-4fed-accd-f0a83e780f4b tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:02:50.876024 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-c6911cb8-ec20-4fed-accd-f0a83e780f4b tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:02:50.876451 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-c6911cb8-ec20-4fed-accd-f0a83e780f4b tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:02:50.876870 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-c6911cb8-ec20-4fed-accd-f0a83e780f4b tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:02:51.029973 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-c6911cb8-ec20-4fed-accd-f0a83e780f4b tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '193bf7a17f544770a27c07f6b8cc0988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243c0b9b4bd742659061745c8dc4c696', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 14:02:51.038857 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-c6911cb8-ec20-4fed-accd-f0a83e780f4b tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] 10.222.0.36 "GET /compute/v2.1/servers/31fd889c-ef07-468c-9cc5-3a3fd1b51d63" status: 200 len: 1577 microversion: 2.1 time: 0.176020 Oct 15 14:02:51.039440 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 559/1121] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 14:02:50 2022] GET /compute/v2.1/servers/31fd889c-ef07-468c-9cc5-3a3fd1b51d63 => generated 1577 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 14:02:52.066369 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-d4c57d69-31fd-4e45-821d-768a9f8e5992 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 14:02:52.066942 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-d4c57d69-31fd-4e45-821d-768a9f8e5992 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] [instance: 31fd889c-ef07-468c-9cc5-3a3fd1b51d63] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 14:02:52.073904 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-d4c57d69-31fd-4e45-821d-768a9f8e5992 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:02:52.074398 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-d4c57d69-31fd-4e45-821d-768a9f8e5992 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:02:52.074854 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-d4c57d69-31fd-4e45-821d-768a9f8e5992 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:02:52.075549 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-d4c57d69-31fd-4e45-821d-768a9f8e5992 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:02:52.076051 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-d4c57d69-31fd-4e45-821d-768a9f8e5992 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:02:52.076489 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-d4c57d69-31fd-4e45-821d-768a9f8e5992 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:02:52.214868 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-d4c57d69-31fd-4e45-821d-768a9f8e5992 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '193bf7a17f544770a27c07f6b8cc0988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243c0b9b4bd742659061745c8dc4c696', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 14:02:52.223337 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-d4c57d69-31fd-4e45-821d-768a9f8e5992 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] 10.222.0.36 "GET /compute/v2.1/servers/31fd889c-ef07-468c-9cc5-3a3fd1b51d63" status: 200 len: 1577 microversion: 2.1 time: 0.161779 Oct 15 14:02:52.223945 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 563/1122] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 14:02:52 2022] GET /compute/v2.1/servers/31fd889c-ef07-468c-9cc5-3a3fd1b51d63 => generated 1577 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 14:02:53.246918 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-396efa40-d3ee-456c-9b4b-c09093db6bb0 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 14:02:53.247501 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-396efa40-d3ee-456c-9b4b-c09093db6bb0 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] [instance: 31fd889c-ef07-468c-9cc5-3a3fd1b51d63] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 14:02:53.256329 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-396efa40-d3ee-456c-9b4b-c09093db6bb0 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:02:53.256855 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-396efa40-d3ee-456c-9b4b-c09093db6bb0 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:02:53.257249 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-396efa40-d3ee-456c-9b4b-c09093db6bb0 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:02:53.258269 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-396efa40-d3ee-456c-9b4b-c09093db6bb0 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:02:53.258760 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-396efa40-d3ee-456c-9b4b-c09093db6bb0 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:02:53.259170 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-396efa40-d3ee-456c-9b4b-c09093db6bb0 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:02:53.481919 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-396efa40-d3ee-456c-9b4b-c09093db6bb0 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '193bf7a17f544770a27c07f6b8cc0988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243c0b9b4bd742659061745c8dc4c696', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 14:02:53.490966 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-396efa40-d3ee-456c-9b4b-c09093db6bb0 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] 10.222.0.36 "GET /compute/v2.1/servers/31fd889c-ef07-468c-9cc5-3a3fd1b51d63" status: 200 len: 1577 microversion: 2.1 time: 0.247965 Oct 15 14:02:53.491908 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 560/1123] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 14:02:53 2022] GET /compute/v2.1/servers/31fd889c-ef07-468c-9cc5-3a3fd1b51d63 => generated 1577 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 14:02:53.667021 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [req-1ecd3a1c-c866-4d62-a88a-29830aecc5af req-adb7120a-4e58-470b-8fc5-5586de61046e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31fd889c-ef07-468c-9cc5-3a3fd1b51d63", "name": "network-vif-deleted", "tag": "7c8bf8d7-7d37-4910-8609-6b29066a0947"}]} {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 14:02:53.677925 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [req-1ecd3a1c-c866-4d62-a88a-29830aecc5af req-adb7120a-4e58-470b-8fc5-5586de61046e service nova] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:02:53.678437 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [req-1ecd3a1c-c866-4d62-a88a-29830aecc5af req-adb7120a-4e58-470b-8fc5-5586de61046e service nova] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:02:53.678850 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [req-1ecd3a1c-c866-4d62-a88a-29830aecc5af req-adb7120a-4e58-470b-8fc5-5586de61046e service nova] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:02:53.691541 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.compute.server_external_events [req-1ecd3a1c-c866-4d62-a88a-29830aecc5af req-adb7120a-4e58-470b-8fc5-5586de61046e service nova] Creating event network-vif-deleted:7c8bf8d7-7d37-4910-8609-6b29066a0947 for instance 31fd889c-ef07-468c-9cc5-3a3fd1b51d63 on hv-cinder-86149 Oct 15 14:02:53.696830 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [req-1ecd3a1c-c866-4d62-a88a-29830aecc5af req-adb7120a-4e58-470b-8fc5-5586de61046e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033518 Oct 15 14:02:53.697531 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 564/1124] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 15 14:02:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 14:02:53.905895 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-16290f47-976a-42ca-a206-a9f5d5331ee6 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "aa7fed95-a634-4448-b904-c76054878a05"}} {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 14:02:53.908456 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-16290f47-976a-42ca-a206-a9f5d5331ee6 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] [instance: 023bca17-a19b-4428-9008-ec108226f7f4] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 14:02:53.915020 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-16290f47-976a-42ca-a206-a9f5d5331ee6 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:02:53.915714 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-16290f47-976a-42ca-a206-a9f5d5331ee6 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:02:53.916182 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-16290f47-976a-42ca-a206-a9f5d5331ee6 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:02:53.916880 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-16290f47-976a-42ca-a206-a9f5d5331ee6 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:02:53.917329 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-16290f47-976a-42ca-a206-a9f5d5331ee6 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:02:53.917754 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-16290f47-976a-42ca-a206-a9f5d5331ee6 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:02:54.014464 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.wsgi [None req-16290f47-976a-42ca-a206-a9f5d5331ee6 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] HTTP exception thrown: Invalid volume: volume aa7fed95-a634-4448-b904-c76054878a05 is already attached to instances: 023bca17-a19b-4428-9008-ec108226f7f4 Oct 15 14:02:54.017157 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-16290f47-976a-42ca-a206-a9f5d5331ee6 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Request method failure captured: Oct 15 14:02:54.017157 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: request: POST /compute/v2.1/servers/023bca17-a19b-4428-9008-ec108226f7f4/os-volume_attachments HTTP/1.1 Oct 15 14:02:54.017157 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: Accept: application/json Oct 15 14:02:54.017157 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: Accept-Encoding: identity Oct 15 14:02:54.017157 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: Connection: close Oct 15 14:02:54.017157 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: Content-Length: 74 Oct 15 14:02:54.017157 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: Content-Type: application/json Oct 15 14:02:54.017157 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: Host: 10.222.0.36 Oct 15 14:02:54.017157 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: Openstack-System-Scope: None Oct 15 14:02:54.017157 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: User-Agent: python-urllib3/1.26.12 Oct 15 14:02:54.017157 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Auth-Token: gAAAAABjSrwjLfc9eO9Ga-oGlJy_0-kXrWYl6E9iQsuiX0FzsrMojKgz761L4MHPRenZAoUO0wQyqfJ45bvEQq8ApfN15Y_P6uN8Md3wWVEiU_I4JYoXqcUDzANpGGWqTMo-HatpcMRcOiXDjsl3AXX5mHMNQbkMjtIRLTfF6ftg2a6TfPRcK1g Oct 15 14:02:54.017157 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Domain-Id: None Oct 15 14:02:54.017157 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Domain-Name: None Oct 15 14:02:54.017157 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Identity-Status: Confirmed Oct 15 14:02:54.017157 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Is-Admin-Project: True Oct 15 14:02:54.017157 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Project-Domain-Id: default Oct 15 14:02:54.017157 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Project-Domain-Name: Default Oct 15 14:02:54.017157 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Project-Id: 1976b27e84a4484ba9d46a4244b08699 Oct 15 14:02:54.017157 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Project-Name: tempest-AttachVolumeNegativeTest-20916687 Oct 15 14:02:54.017157 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Role: member,reader Oct 15 14:02:54.017157 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Roles: member,reader Oct 15 14:02:54.018710 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_1976b27e84a4484ba9d46a4244b08699", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/1976b27e84a4484ba9d46a4244b08699"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/1976b27e84a4484ba9d46a4244b08699"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/1976b27e84a4484ba9d46a4244b08699"}]}] Oct 15 14:02:54.018710 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Tenant: tempest-AttachVolumeNegativeTest-20916687 Oct 15 14:02:54.018710 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Tenant-Id: 1976b27e84a4484ba9d46a4244b08699 Oct 15 14:02:54.018710 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-20916687 Oct 15 14:02:54.018710 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-User: tempest-AttachVolumeNegativeTest-20916687-project Oct 15 14:02:54.018710 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-User-Domain-Id: default Oct 15 14:02:54.018710 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-User-Domain-Name: Default Oct 15 14:02:54.018710 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-User-Id: a10fc1a48c9c41eaa1bf3ff2e4109657 Oct 15 14:02:54.018710 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-User-Name: tempest-AttachVolumeNegativeTest-20916687-project Oct 15 14:02:54.018710 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: Oct 15 14:02:54.018710 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: {"volumeAttachment": {"volumeId": "aa7fed95-a634-4448-b904-c76054878a05"}} Oct 15 14:02:54.018710 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: method: > Oct 15 14:02:54.020326 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: exception: Invalid volume: volume aa7fed95-a634-4448-b904-c76054878a05 is already attached to instances: 023bca17-a19b-4428-9008-ec108226f7f4 Oct 15 14:02:54.020326 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: action_args: {'server_id': '023bca17-a19b-4428-9008-ec108226f7f4', 'body': {'volumeAttachment': {'volumeId': 'aa7fed95-a634-4448-b904-c76054878a05'}}} Oct 15 14:02:54.020326 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 15 14:02:54.020326 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 14:02:54.020326 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 15 14:02:54.020326 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 15 14:02:54.020326 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 15 14:02:54.020326 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 15 14:02:54.020326 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 15 14:02:54.020326 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 15 14:02:54.020326 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 15 14:02:54.020326 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 15 14:02:54.020326 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 15 14:02:54.020326 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 15 14:02:54.020326 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume aa7fed95-a634-4448-b904-c76054878a05 is already attached to instances: 023bca17-a19b-4428-9008-ec108226f7f4 Oct 15 14:02:54.020326 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Oct 15 14:02:54.020326 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 14:02:54.020326 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Oct 15 14:02:54.020326 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 14:02:54.022011 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 14:02:54.022011 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 14:02:54.022011 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 15 14:02:54.022011 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 15 14:02:54.022011 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 15 14:02:54.022011 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 15 14:02:54.022011 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 15 14:02:54.022011 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 15 14:02:54.022011 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 15 14:02:54.022011 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 15 14:02:54.022011 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 15 14:02:54.022011 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 15 14:02:54.022011 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 15 14:02:54.022011 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 15 14:02:54.022011 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume aa7fed95-a634-4448-b904-c76054878a05 is already attached to instances: 023bca17-a19b-4428-9008-ec108226f7f4 Oct 15 14:02:54.022011 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Oct 15 14:02:54.022011 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 14:02:54.022011 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Oct 15 14:02:54.022011 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 14:02:54.022011 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 14:02:54.023603 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 14:02:54.023603 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 15 14:02:54.023603 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 15 14:02:54.023603 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume aa7fed95-a634-4448-b904-c76054878a05 is already attached to instances: 023bca17-a19b-4428-9008-ec108226f7f4 Oct 15 14:02:54.023603 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Oct 15 14:02:54.023603 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-16290f47-976a-42ca-a206-a9f5d5331ee6 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Returning 400 to user: Invalid volume: volume aa7fed95-a634-4448-b904-c76054878a05 is already attached to instances: 023bca17-a19b-4428-9008-ec108226f7f4 {{(pid=125243) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 15 14:02:54.023603 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-16290f47-976a-42ca-a206-a9f5d5331ee6 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] 10.222.0.36 "POST /compute/v2.1/servers/023bca17-a19b-4428-9008-ec108226f7f4/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.116869 Oct 15 14:02:54.023603 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 561/1125] 10.222.0.36 () {60 vars in 1323 bytes} [Sat Oct 15 14:02:53 2022] POST /compute/v2.1/servers/023bca17-a19b-4428-9008-ec108226f7f4/os-volume_attachments => generated 174 bytes in 118 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 15 14:02:54.104924 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-02b7a7e3-d0b7-4330-8967-979c31cb33cb tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 14:02:54.105513 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-02b7a7e3-d0b7-4330-8967-979c31cb33cb tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] [instance: 023bca17-a19b-4428-9008-ec108226f7f4] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 14:02:54.112389 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-02b7a7e3-d0b7-4330-8967-979c31cb33cb tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:02:54.112887 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-02b7a7e3-d0b7-4330-8967-979c31cb33cb tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:02:54.113469 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-02b7a7e3-d0b7-4330-8967-979c31cb33cb tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:02:54.114071 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-02b7a7e3-d0b7-4330-8967-979c31cb33cb tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:02:54.114475 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-02b7a7e3-d0b7-4330-8967-979c31cb33cb tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:02:54.114903 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-02b7a7e3-d0b7-4330-8967-979c31cb33cb tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:02:54.202397 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.objects.instance [None req-02b7a7e3-d0b7-4330-8967-979c31cb33cb tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lazy-loading 'services' on Instance uuid 023bca17-a19b-4428-9008-ec108226f7f4 {{(pid=125242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 15 14:02:54.279785 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-02b7a7e3-d0b7-4330-8967-979c31cb33cb tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] 10.222.0.36 "DELETE /compute/v2.1/servers/023bca17-a19b-4428-9008-ec108226f7f4/os-volume_attachments/aa7fed95-a634-4448-b904-c76054878a05" status: 202 len: 0 microversion: 2.1 time: 0.178950 Oct 15 14:02:54.280438 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 565/1126] 10.222.0.36 () {58 vars in 1416 bytes} [Sat Oct 15 14:02:54 2022] DELETE /compute/v2.1/servers/023bca17-a19b-4428-9008-ec108226f7f4/os-volume_attachments/aa7fed95-a634-4448-b904-c76054878a05 => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 15 14:02:54.291454 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-0beaa862-1db7-4ac3-a7c8-76cdbea8e1c5 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 14:02:54.294630 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-0beaa862-1db7-4ac3-a7c8-76cdbea8e1c5 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] [instance: 023bca17-a19b-4428-9008-ec108226f7f4] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 14:02:54.302687 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-0beaa862-1db7-4ac3-a7c8-76cdbea8e1c5 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:02:54.303355 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-0beaa862-1db7-4ac3-a7c8-76cdbea8e1c5 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:02:54.303996 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-0beaa862-1db7-4ac3-a7c8-76cdbea8e1c5 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:02:54.305031 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-0beaa862-1db7-4ac3-a7c8-76cdbea8e1c5 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:02:54.305623 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-0beaa862-1db7-4ac3-a7c8-76cdbea8e1c5 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:02:54.306233 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-0beaa862-1db7-4ac3-a7c8-76cdbea8e1c5 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:02:54.344655 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-0beaa862-1db7-4ac3-a7c8-76cdbea8e1c5 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] 10.222.0.36 "GET /compute/v2.1/servers/023bca17-a19b-4428-9008-ec108226f7f4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059160 Oct 15 14:02:54.345214 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 562/1127] 10.222.0.36 () {58 vars in 1302 bytes} [Sat Oct 15 14:02:54 2022] GET /compute/v2.1/servers/023bca17-a19b-4428-9008-ec108226f7f4/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 14:02:54.516390 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-aa233e8d-f656-4436-9e32-21582d94c876 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 14:02:54.516781 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-aa233e8d-f656-4436-9e32-21582d94c876 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] [instance: 31fd889c-ef07-468c-9cc5-3a3fd1b51d63] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 14:02:54.523366 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-aa233e8d-f656-4436-9e32-21582d94c876 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:02:54.524010 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-aa233e8d-f656-4436-9e32-21582d94c876 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:02:54.524464 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-aa233e8d-f656-4436-9e32-21582d94c876 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:02:54.525179 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-aa233e8d-f656-4436-9e32-21582d94c876 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:02:54.525636 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-aa233e8d-f656-4436-9e32-21582d94c876 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:02:54.526057 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-aa233e8d-f656-4436-9e32-21582d94c876 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:02:54.559233 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-aa233e8d-f656-4436-9e32-21582d94c876 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:02:54.559723 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-aa233e8d-f656-4436-9e32-21582d94c876 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:02:54.560204 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-aa233e8d-f656-4436-9e32-21582d94c876 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:02:54.560644 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.objects.instance [None req-aa233e8d-f656-4436-9e32-21582d94c876 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lazy-loading 'fault' on Instance uuid 31fd889c-ef07-468c-9cc5-3a3fd1b51d63 {{(pid=125242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 15 14:02:54.609795 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-aa233e8d-f656-4436-9e32-21582d94c876 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '193bf7a17f544770a27c07f6b8cc0988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243c0b9b4bd742659061745c8dc4c696', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 14:02:54.618077 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-aa233e8d-f656-4436-9e32-21582d94c876 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] 10.222.0.36 "GET /compute/v2.1/servers/31fd889c-ef07-468c-9cc5-3a3fd1b51d63" status: 200 len: 1229 microversion: 2.1 time: 0.106536 Oct 15 14:02:54.618649 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 566/1128] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 14:02:54 2022] GET /compute/v2.1/servers/31fd889c-ef07-468c-9cc5-3a3fd1b51d63 => generated 1229 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 14:02:55.361169 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-ac917172-8e8b-4bcc-9415-d9aa38305a35 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 14:02:55.363528 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-ac917172-8e8b-4bcc-9415-d9aa38305a35 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] [instance: 023bca17-a19b-4428-9008-ec108226f7f4] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 14:02:55.370411 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-ac917172-8e8b-4bcc-9415-d9aa38305a35 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:02:55.370920 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-ac917172-8e8b-4bcc-9415-d9aa38305a35 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:02:55.371364 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-ac917172-8e8b-4bcc-9415-d9aa38305a35 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:02:55.372208 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-ac917172-8e8b-4bcc-9415-d9aa38305a35 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:02:55.372662 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-ac917172-8e8b-4bcc-9415-d9aa38305a35 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:02:55.373094 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-ac917172-8e8b-4bcc-9415-d9aa38305a35 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:02:55.403715 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-ac917172-8e8b-4bcc-9415-d9aa38305a35 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] 10.222.0.36 "GET /compute/v2.1/servers/023bca17-a19b-4428-9008-ec108226f7f4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047695 Oct 15 14:02:55.404319 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 563/1129] 10.222.0.36 () {58 vars in 1302 bytes} [Sat Oct 15 14:02:55 2022] GET /compute/v2.1/servers/023bca17-a19b-4428-9008-ec108226f7f4/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 14:02:55.643446 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-9a66821d-0ed5-4f5d-9fdd-64205fbdc0c9 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 14:02:55.644075 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-9a66821d-0ed5-4f5d-9fdd-64205fbdc0c9 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] [instance: 31fd889c-ef07-468c-9cc5-3a3fd1b51d63] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 14:02:55.650917 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-9a66821d-0ed5-4f5d-9fdd-64205fbdc0c9 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:02:55.651388 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-9a66821d-0ed5-4f5d-9fdd-64205fbdc0c9 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:02:55.651830 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-9a66821d-0ed5-4f5d-9fdd-64205fbdc0c9 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:02:55.652857 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-9a66821d-0ed5-4f5d-9fdd-64205fbdc0c9 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:02:55.653055 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-9a66821d-0ed5-4f5d-9fdd-64205fbdc0c9 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:02:55.653482 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-9a66821d-0ed5-4f5d-9fdd-64205fbdc0c9 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:02:55.668146 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.wsgi [None req-9a66821d-0ed5-4f5d-9fdd-64205fbdc0c9 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] HTTP exception thrown: Instance 31fd889c-ef07-468c-9cc5-3a3fd1b51d63 could not be found. Oct 15 14:02:55.669835 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-9a66821d-0ed5-4f5d-9fdd-64205fbdc0c9 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Request method failure captured: Oct 15 14:02:55.669835 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: request: GET /compute/v2.1/servers/31fd889c-ef07-468c-9cc5-3a3fd1b51d63 HTTP/1.1 Oct 15 14:02:55.669835 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Accept: application/json Oct 15 14:02:55.669835 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Accept-Encoding: identity Oct 15 14:02:55.669835 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Connection: close Oct 15 14:02:55.669835 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Content-Length: 0 Oct 15 14:02:55.669835 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Content-Type: application/json Oct 15 14:02:55.669835 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Host: 10.222.0.36 Oct 15 14:02:55.669835 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Openstack-System-Scope: None Oct 15 14:02:55.669835 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: User-Agent: python-urllib3/1.26.12 Oct 15 14:02:55.669835 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Auth-Token: gAAAAABjSrs7akZdeWnKNfbPpL5PIG5mRXFvVXqD3141HrZ4nKb24dpr3EvMeYQ5Hx1nj7byWdB9YJsOPCMXYGIoIvcxe9Ohh7gIQjWQWXZ15vyi14OO7I0M7VeBlrNwCi-ODOHjIC8dn-wksQAcF8z9gIN8hepYOUySXSMp9aSpWIlNjY6cPxk Oct 15 14:02:55.669835 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Domain-Id: None Oct 15 14:02:55.669835 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Domain-Name: None Oct 15 14:02:55.669835 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Identity-Status: Confirmed Oct 15 14:02:55.669835 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Is-Admin-Project: True Oct 15 14:02:55.669835 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Project-Domain-Id: default Oct 15 14:02:55.669835 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Project-Domain-Name: Default Oct 15 14:02:55.669835 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Project-Id: 243c0b9b4bd742659061745c8dc4c696 Oct 15 14:02:55.669835 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Project-Name: tempest-TestVolumeBootPattern-1987600970 Oct 15 14:02:55.669835 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Role: member,reader Oct 15 14:02:55.669835 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Roles: member,reader Oct 15 14:02:55.671458 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_243c0b9b4bd742659061745c8dc4c696", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/243c0b9b4bd742659061745c8dc4c696"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/243c0b9b4bd742659061745c8dc4c696"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/243c0b9b4bd742659061745c8dc4c696"}]}] Oct 15 14:02:55.671458 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Tenant: tempest-TestVolumeBootPattern-1987600970 Oct 15 14:02:55.671458 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Tenant-Id: 243c0b9b4bd742659061745c8dc4c696 Oct 15 14:02:55.671458 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Tenant-Name: tempest-TestVolumeBootPattern-1987600970 Oct 15 14:02:55.671458 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-User: tempest-TestVolumeBootPattern-1987600970-project Oct 15 14:02:55.671458 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-User-Domain-Id: default Oct 15 14:02:55.671458 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-User-Domain-Name: Default Oct 15 14:02:55.671458 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-User-Id: 193bf7a17f544770a27c07f6b8cc0988 Oct 15 14:02:55.671458 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-User-Name: tempest-TestVolumeBootPattern-1987600970-project Oct 15 14:02:55.671458 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: method: > Oct 15 14:02:55.671458 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: exception: Instance 31fd889c-ef07-468c-9cc5-3a3fd1b51d63 could not be found. Oct 15 14:02:55.671458 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: action_args: {'id': '31fd889c-ef07-468c-9cc5-3a3fd1b51d63'} Oct 15 14:02:55.672585 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 15 14:02:55.672585 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 14:02:55.672585 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 15 14:02:55.672585 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 15 14:02:55.672585 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 15 14:02:55.672585 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 15 14:02:55.672585 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 15 14:02:55.672585 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 15 14:02:55.672585 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 15 14:02:55.672585 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 15 14:02:55.672585 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31fd889c-ef07-468c-9cc5-3a3fd1b51d63 could not be found. Oct 15 14:02:55.672585 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Oct 15 14:02:55.672585 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 14:02:55.672585 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Oct 15 14:02:55.672585 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 14:02:55.672585 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 14:02:55.672585 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 14:02:55.672585 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 15 14:02:55.672585 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 15 14:02:55.672585 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 15 14:02:55.674111 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 15 14:02:55.674111 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 15 14:02:55.674111 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 15 14:02:55.674111 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 15 14:02:55.674111 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 15 14:02:55.674111 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 15 14:02:55.674111 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 15 14:02:55.674111 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31fd889c-ef07-468c-9cc5-3a3fd1b51d63 could not be found. Oct 15 14:02:55.674111 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Oct 15 14:02:55.674111 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 14:02:55.674111 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Oct 15 14:02:55.674111 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 14:02:55.674111 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 14:02:55.674111 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 14:02:55.674111 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 15 14:02:55.674111 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 15 14:02:55.674111 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31fd889c-ef07-468c-9cc5-3a3fd1b51d63 could not be found. Oct 15 14:02:55.674111 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Oct 15 14:02:55.675526 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-9a66821d-0ed5-4f5d-9fdd-64205fbdc0c9 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Returning 404 to user: Instance 31fd889c-ef07-468c-9cc5-3a3fd1b51d63 could not be found. {{(pid=125242) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 15 14:02:55.675526 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-9a66821d-0ed5-4f5d-9fdd-64205fbdc0c9 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] 10.222.0.36 "GET /compute/v2.1/servers/31fd889c-ef07-468c-9cc5-3a3fd1b51d63" status: 404 len: 111 microversion: 2.1 time: 0.033120 Oct 15 14:02:55.675526 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 567/1130] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 14:02:55 2022] GET /compute/v2.1/servers/31fd889c-ef07-468c-9cc5-3a3fd1b51d63 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 15 14:02:56.417858 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-58fb75fd-173b-4933-ba3c-668462a899bc tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 14:02:56.420128 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-58fb75fd-173b-4933-ba3c-668462a899bc tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] [instance: 023bca17-a19b-4428-9008-ec108226f7f4] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 14:02:56.427626 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-58fb75fd-173b-4933-ba3c-668462a899bc tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:02:56.428154 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-58fb75fd-173b-4933-ba3c-668462a899bc tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:02:56.428592 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-58fb75fd-173b-4933-ba3c-668462a899bc tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:02:56.429315 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-58fb75fd-173b-4933-ba3c-668462a899bc tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:02:56.429733 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-58fb75fd-173b-4933-ba3c-668462a899bc tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:02:56.430190 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-58fb75fd-173b-4933-ba3c-668462a899bc tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:02:56.461476 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-58fb75fd-173b-4933-ba3c-668462a899bc tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] 10.222.0.36 "GET /compute/v2.1/servers/023bca17-a19b-4428-9008-ec108226f7f4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047562 Oct 15 14:02:56.462281 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 564/1131] 10.222.0.36 () {58 vars in 1302 bytes} [Sat Oct 15 14:02:56 2022] GET /compute/v2.1/servers/023bca17-a19b-4428-9008-ec108226f7f4/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 15 14:02:56.527843 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-82aca63d-1eb6-4eda-85d4-3eaeeb54b8c1 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 14:02:56.528313 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-82aca63d-1eb6-4eda-85d4-3eaeeb54b8c1 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] [instance: 023bca17-a19b-4428-9008-ec108226f7f4] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 14:02:56.534426 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-82aca63d-1eb6-4eda-85d4-3eaeeb54b8c1 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:02:56.534909 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-82aca63d-1eb6-4eda-85d4-3eaeeb54b8c1 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:02:56.535348 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-82aca63d-1eb6-4eda-85d4-3eaeeb54b8c1 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:02:56.536073 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-82aca63d-1eb6-4eda-85d4-3eaeeb54b8c1 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:02:56.536520 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-82aca63d-1eb6-4eda-85d4-3eaeeb54b8c1 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:02:56.536938 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-82aca63d-1eb6-4eda-85d4-3eaeeb54b8c1 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:02:56.563221 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-82aca63d-1eb6-4eda-85d4-3eaeeb54b8c1 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] [instance: 023bca17-a19b-4428-9008-ec108226f7f4] Going to try to terminate instance {{(pid=125242) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 15 14:02:56.645846 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-82aca63d-1eb6-4eda-85d4-3eaeeb54b8c1 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] 10.222.0.36 "DELETE /compute/v2.1/servers/023bca17-a19b-4428-9008-ec108226f7f4" status: 204 len: 0 microversion: 2.1 time: 0.121590 Oct 15 14:02:56.646482 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 568/1132] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 15 14:02:56 2022] DELETE /compute/v2.1/servers/023bca17-a19b-4428-9008-ec108226f7f4 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 15 14:02:56.655746 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-356fe864-b0ea-4d1d-8c2a-1cc47929e258 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 14:02:56.656403 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-356fe864-b0ea-4d1d-8c2a-1cc47929e258 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] [instance: 023bca17-a19b-4428-9008-ec108226f7f4] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 14:02:56.662953 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-356fe864-b0ea-4d1d-8c2a-1cc47929e258 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:02:56.663425 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-356fe864-b0ea-4d1d-8c2a-1cc47929e258 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:02:56.663844 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-356fe864-b0ea-4d1d-8c2a-1cc47929e258 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:02:56.664566 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-356fe864-b0ea-4d1d-8c2a-1cc47929e258 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:02:56.665024 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-356fe864-b0ea-4d1d-8c2a-1cc47929e258 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:02:56.665436 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-356fe864-b0ea-4d1d-8c2a-1cc47929e258 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:02:56.806309 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-356fe864-b0ea-4d1d-8c2a-1cc47929e258 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10fc1a48c9c41eaa1bf3ff2e4109657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1976b27e84a4484ba9d46a4244b08699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 14:02:56.815082 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-356fe864-b0ea-4d1d-8c2a-1cc47929e258 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] 10.222.0.36 "GET /compute/v2.1/servers/023bca17-a19b-4428-9008-ec108226f7f4" status: 200 len: 1683 microversion: 2.1 time: 0.163327 Oct 15 14:02:56.815845 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 565/1133] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 14:02:56 2022] GET /compute/v2.1/servers/023bca17-a19b-4428-9008-ec108226f7f4 => generated 1683 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 14:02:57.841904 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-2f02244c-4bb4-49da-b24b-af739890b5c3 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 14:02:57.842964 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-2f02244c-4bb4-49da-b24b-af739890b5c3 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] [instance: 023bca17-a19b-4428-9008-ec108226f7f4] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 14:02:57.851311 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-2f02244c-4bb4-49da-b24b-af739890b5c3 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:02:57.851803 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-2f02244c-4bb4-49da-b24b-af739890b5c3 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:02:57.852269 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-2f02244c-4bb4-49da-b24b-af739890b5c3 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:02:57.852974 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-2f02244c-4bb4-49da-b24b-af739890b5c3 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:02:57.853425 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-2f02244c-4bb4-49da-b24b-af739890b5c3 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:02:57.853845 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-2f02244c-4bb4-49da-b24b-af739890b5c3 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:02:58.067917 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-2f02244c-4bb4-49da-b24b-af739890b5c3 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10fc1a48c9c41eaa1bf3ff2e4109657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1976b27e84a4484ba9d46a4244b08699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 14:02:58.076287 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-2f02244c-4bb4-49da-b24b-af739890b5c3 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] 10.222.0.36 "GET /compute/v2.1/servers/023bca17-a19b-4428-9008-ec108226f7f4" status: 200 len: 1683 microversion: 2.1 time: 0.240608 Oct 15 14:02:58.077080 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 569/1134] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 14:02:57 2022] GET /compute/v2.1/servers/023bca17-a19b-4428-9008-ec108226f7f4 => generated 1683 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 14:02:58.798009 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-635f18e9-a922-4b4e-a72c-79d2cfacf23c tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 14:02:58.798984 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [req-3078836b-75ff-49ce-b777-777c60307f3a req-4c7b8e1e-1dbf-4abc-9471-853a3162f01d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bceb7f8c-8854-493e-b707-efe98ac7eb5b", "tag": "a8e5516a-30ab-4376-8e26-9efdb40d9c1e"}]} {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 14:02:58.803181 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-635f18e9-a922-4b4e-a72c-79d2cfacf23c tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] [instance: bceb7f8c-8854-493e-b707-efe98ac7eb5b] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 14:02:58.813657 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-635f18e9-a922-4b4e-a72c-79d2cfacf23c tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:02:58.816485 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-635f18e9-a922-4b4e-a72c-79d2cfacf23c tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:02:58.818673 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [req-3078836b-75ff-49ce-b777-777c60307f3a req-4c7b8e1e-1dbf-4abc-9471-853a3162f01d service nova] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:02:58.819590 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-635f18e9-a922-4b4e-a72c-79d2cfacf23c tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:02:58.820424 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-635f18e9-a922-4b4e-a72c-79d2cfacf23c tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:02:58.820852 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-635f18e9-a922-4b4e-a72c-79d2cfacf23c tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:02:58.821381 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-635f18e9-a922-4b4e-a72c-79d2cfacf23c tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:02:58.821838 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [req-3078836b-75ff-49ce-b777-777c60307f3a req-4c7b8e1e-1dbf-4abc-9471-853a3162f01d service nova] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:02:58.826519 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [req-3078836b-75ff-49ce-b777-777c60307f3a req-4c7b8e1e-1dbf-4abc-9471-853a3162f01d service nova] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:02:58.846462 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.compute.server_external_events [req-3078836b-75ff-49ce-b777-777c60307f3a req-4c7b8e1e-1dbf-4abc-9471-853a3162f01d service nova] Creating event network-changed:a8e5516a-30ab-4376-8e26-9efdb40d9c1e for instance bceb7f8c-8854-493e-b707-efe98ac7eb5b on hv-cinder-86149 Oct 15 14:02:58.855138 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [req-3078836b-75ff-49ce-b777-777c60307f3a req-4c7b8e1e-1dbf-4abc-9471-853a3162f01d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063137 Oct 15 14:02:58.861876 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 570/1135] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 15 14:02:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 14:02:58.866513 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-635f18e9-a922-4b4e-a72c-79d2cfacf23c tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] [instance: bceb7f8c-8854-493e-b707-efe98ac7eb5b] Going to try to terminate instance {{(pid=125243) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 15 14:02:58.975694 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-635f18e9-a922-4b4e-a72c-79d2cfacf23c tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] 10.222.0.36 "DELETE /compute/v2.1/servers/bceb7f8c-8854-493e-b707-efe98ac7eb5b" status: 204 len: 0 microversion: 2.1 time: 0.187533 Oct 15 14:02:58.977058 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 566/1136] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 15 14:02:58 2022] DELETE /compute/v2.1/servers/bceb7f8c-8854-493e-b707-efe98ac7eb5b => generated 0 bytes in 190 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 15 14:02:58.986880 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-a63962c5-70d4-41f7-b7a8-ae80d2f6520b tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 14:02:58.989093 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-a63962c5-70d4-41f7-b7a8-ae80d2f6520b tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] [instance: bceb7f8c-8854-493e-b707-efe98ac7eb5b] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 14:02:58.997668 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-a63962c5-70d4-41f7-b7a8-ae80d2f6520b tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:02:58.998496 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-a63962c5-70d4-41f7-b7a8-ae80d2f6520b tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:02:58.999139 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-a63962c5-70d4-41f7-b7a8-ae80d2f6520b tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:02:59.000143 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-a63962c5-70d4-41f7-b7a8-ae80d2f6520b tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:02:59.000837 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-a63962c5-70d4-41f7-b7a8-ae80d2f6520b tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:02:59.001547 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-a63962c5-70d4-41f7-b7a8-ae80d2f6520b tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:02:59.103724 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-d770b2ef-fbd7-4ebc-8227-974ada8966e3 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 14:02:59.104875 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-d770b2ef-fbd7-4ebc-8227-974ada8966e3 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] [instance: 023bca17-a19b-4428-9008-ec108226f7f4] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 14:02:59.113794 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-d770b2ef-fbd7-4ebc-8227-974ada8966e3 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:02:59.114429 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-d770b2ef-fbd7-4ebc-8227-974ada8966e3 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:02:59.114958 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-d770b2ef-fbd7-4ebc-8227-974ada8966e3 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:02:59.115748 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-d770b2ef-fbd7-4ebc-8227-974ada8966e3 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:02:59.116330 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-d770b2ef-fbd7-4ebc-8227-974ada8966e3 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:02:59.116865 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-d770b2ef-fbd7-4ebc-8227-974ada8966e3 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:02:59.353508 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-a63962c5-70d4-41f7-b7a8-ae80d2f6520b tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '193bf7a17f544770a27c07f6b8cc0988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243c0b9b4bd742659061745c8dc4c696', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 14:02:59.372897 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-a63962c5-70d4-41f7-b7a8-ae80d2f6520b tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] 10.222.0.36 "GET /compute/v2.1/servers/bceb7f8c-8854-493e-b707-efe98ac7eb5b" status: 200 len: 1578 microversion: 2.1 time: 0.390922 Oct 15 14:02:59.388353 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 571/1137] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 14:02:58 2022] GET /compute/v2.1/servers/bceb7f8c-8854-493e-b707-efe98ac7eb5b => generated 1578 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 14:02:59.443586 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-d770b2ef-fbd7-4ebc-8227-974ada8966e3 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10fc1a48c9c41eaa1bf3ff2e4109657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1976b27e84a4484ba9d46a4244b08699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 14:02:59.452042 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-d770b2ef-fbd7-4ebc-8227-974ada8966e3 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] 10.222.0.36 "GET /compute/v2.1/servers/023bca17-a19b-4428-9008-ec108226f7f4" status: 200 len: 1683 microversion: 2.1 time: 0.356608 Oct 15 14:02:59.452989 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 567/1138] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 14:02:59 2022] GET /compute/v2.1/servers/023bca17-a19b-4428-9008-ec108226f7f4 => generated 1683 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 14:02:59.635333 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [req-e4c603e8-1939-45a8-ac71-78b430c65f0a req-e301fd8f-d0aa-40c6-8e49-8e57e2b9e4e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "023bca17-a19b-4428-9008-ec108226f7f4", "name": "network-vif-deleted", "tag": "33c455e8-481d-448e-a7e0-7039d8c328b2"}]} {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 14:02:59.660367 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [req-e4c603e8-1939-45a8-ac71-78b430c65f0a req-e301fd8f-d0aa-40c6-8e49-8e57e2b9e4e3 service nova] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:02:59.661153 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [req-e4c603e8-1939-45a8-ac71-78b430c65f0a req-e301fd8f-d0aa-40c6-8e49-8e57e2b9e4e3 service nova] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:02:59.661755 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [req-e4c603e8-1939-45a8-ac71-78b430c65f0a req-e301fd8f-d0aa-40c6-8e49-8e57e2b9e4e3 service nova] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:02:59.690271 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.compute.server_external_events [req-e4c603e8-1939-45a8-ac71-78b430c65f0a req-e301fd8f-d0aa-40c6-8e49-8e57e2b9e4e3 service nova] Creating event network-vif-deleted:33c455e8-481d-448e-a7e0-7039d8c328b2 for instance 023bca17-a19b-4428-9008-ec108226f7f4 on hv-cinder-86149 Oct 15 14:02:59.699376 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [req-e4c603e8-1939-45a8-ac71-78b430c65f0a req-e301fd8f-d0aa-40c6-8e49-8e57e2b9e4e3 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064273 Oct 15 14:02:59.700590 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 572/1139] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 15 14:02:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 14:03:00.397868 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-0b120340-6ba3-47b7-98c9-6cb221bf9537 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 14:03:00.398758 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-0b120340-6ba3-47b7-98c9-6cb221bf9537 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] [instance: bceb7f8c-8854-493e-b707-efe98ac7eb5b] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 14:03:00.405329 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-0b120340-6ba3-47b7-98c9-6cb221bf9537 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:03:00.406067 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-0b120340-6ba3-47b7-98c9-6cb221bf9537 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:03:00.406505 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-0b120340-6ba3-47b7-98c9-6cb221bf9537 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:03:00.407210 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-0b120340-6ba3-47b7-98c9-6cb221bf9537 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:03:00.408197 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-0b120340-6ba3-47b7-98c9-6cb221bf9537 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:03:00.408751 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-0b120340-6ba3-47b7-98c9-6cb221bf9537 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:03:00.478535 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-959be72c-126f-435f-82c6-4fb4a4fa9181 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 14:03:00.479429 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-959be72c-126f-435f-82c6-4fb4a4fa9181 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] [instance: 023bca17-a19b-4428-9008-ec108226f7f4] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 14:03:00.483911 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-0b120340-6ba3-47b7-98c9-6cb221bf9537 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '193bf7a17f544770a27c07f6b8cc0988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243c0b9b4bd742659061745c8dc4c696', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 14:03:00.489143 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-959be72c-126f-435f-82c6-4fb4a4fa9181 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:03:00.489631 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-959be72c-126f-435f-82c6-4fb4a4fa9181 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:03:00.490585 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-959be72c-126f-435f-82c6-4fb4a4fa9181 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:03:00.492251 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-0b120340-6ba3-47b7-98c9-6cb221bf9537 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] 10.222.0.36 "GET /compute/v2.1/servers/bceb7f8c-8854-493e-b707-efe98ac7eb5b" status: 200 len: 1226 microversion: 2.1 time: 0.098554 Oct 15 14:03:00.492942 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-959be72c-126f-435f-82c6-4fb4a4fa9181 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:03:00.493188 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 568/1140] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 14:03:00 2022] GET /compute/v2.1/servers/bceb7f8c-8854-493e-b707-efe98ac7eb5b => generated 1226 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 14:03:00.493441 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-959be72c-126f-435f-82c6-4fb4a4fa9181 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:03:00.493873 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-959be72c-126f-435f-82c6-4fb4a4fa9181 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:03:00.508003 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.wsgi [None req-959be72c-126f-435f-82c6-4fb4a4fa9181 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] HTTP exception thrown: Instance 023bca17-a19b-4428-9008-ec108226f7f4 could not be found. Oct 15 14:03:00.509961 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-959be72c-126f-435f-82c6-4fb4a4fa9181 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Request method failure captured: Oct 15 14:03:00.509961 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: request: GET /compute/v2.1/servers/023bca17-a19b-4428-9008-ec108226f7f4 HTTP/1.1 Oct 15 14:03:00.509961 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Accept: application/json Oct 15 14:03:00.509961 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Accept-Encoding: identity Oct 15 14:03:00.509961 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Connection: close Oct 15 14:03:00.509961 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Content-Length: 0 Oct 15 14:03:00.509961 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Content-Type: application/json Oct 15 14:03:00.509961 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Host: 10.222.0.36 Oct 15 14:03:00.509961 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Openstack-System-Scope: None Oct 15 14:03:00.509961 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: User-Agent: python-urllib3/1.26.12 Oct 15 14:03:00.509961 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Auth-Token: gAAAAABjSrwjLfc9eO9Ga-oGlJy_0-kXrWYl6E9iQsuiX0FzsrMojKgz761L4MHPRenZAoUO0wQyqfJ45bvEQq8ApfN15Y_P6uN8Md3wWVEiU_I4JYoXqcUDzANpGGWqTMo-HatpcMRcOiXDjsl3AXX5mHMNQbkMjtIRLTfF6ftg2a6TfPRcK1g Oct 15 14:03:00.509961 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Domain-Id: None Oct 15 14:03:00.509961 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Domain-Name: None Oct 15 14:03:00.509961 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Identity-Status: Confirmed Oct 15 14:03:00.509961 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Is-Admin-Project: True Oct 15 14:03:00.509961 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Project-Domain-Id: default Oct 15 14:03:00.509961 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Project-Domain-Name: Default Oct 15 14:03:00.509961 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Project-Id: 1976b27e84a4484ba9d46a4244b08699 Oct 15 14:03:00.509961 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Project-Name: tempest-AttachVolumeNegativeTest-20916687 Oct 15 14:03:00.509961 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Role: member,reader Oct 15 14:03:00.509961 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Roles: member,reader Oct 15 14:03:00.511415 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_1976b27e84a4484ba9d46a4244b08699", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/1976b27e84a4484ba9d46a4244b08699"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/1976b27e84a4484ba9d46a4244b08699"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/1976b27e84a4484ba9d46a4244b08699"}]}] Oct 15 14:03:00.511415 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Tenant: tempest-AttachVolumeNegativeTest-20916687 Oct 15 14:03:00.511415 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Tenant-Id: 1976b27e84a4484ba9d46a4244b08699 Oct 15 14:03:00.511415 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-20916687 Oct 15 14:03:00.511415 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-User: tempest-AttachVolumeNegativeTest-20916687-project Oct 15 14:03:00.511415 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-User-Domain-Id: default Oct 15 14:03:00.511415 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-User-Domain-Name: Default Oct 15 14:03:00.511415 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-User-Id: a10fc1a48c9c41eaa1bf3ff2e4109657 Oct 15 14:03:00.511415 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-User-Name: tempest-AttachVolumeNegativeTest-20916687-project Oct 15 14:03:00.511415 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: method: > Oct 15 14:03:00.511415 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: exception: Instance 023bca17-a19b-4428-9008-ec108226f7f4 could not be found. Oct 15 14:03:00.511415 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: action_args: {'id': '023bca17-a19b-4428-9008-ec108226f7f4'} Oct 15 14:03:00.512216 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 15 14:03:00.512216 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 14:03:00.512216 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 15 14:03:00.512216 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 15 14:03:00.512216 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 15 14:03:00.512216 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 15 14:03:00.512216 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 15 14:03:00.512216 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 15 14:03:00.512216 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 15 14:03:00.512216 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 15 14:03:00.512216 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 023bca17-a19b-4428-9008-ec108226f7f4 could not be found. Oct 15 14:03:00.512216 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Oct 15 14:03:00.512216 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 14:03:00.512216 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Oct 15 14:03:00.512216 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 14:03:00.512216 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 14:03:00.512216 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 14:03:00.512216 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 15 14:03:00.512216 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 15 14:03:00.512216 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 15 14:03:00.513512 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 15 14:03:00.513512 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 15 14:03:00.513512 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 15 14:03:00.513512 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 15 14:03:00.513512 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 15 14:03:00.513512 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 15 14:03:00.513512 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 15 14:03:00.513512 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 023bca17-a19b-4428-9008-ec108226f7f4 could not be found. Oct 15 14:03:00.513512 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Oct 15 14:03:00.513512 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 14:03:00.513512 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Oct 15 14:03:00.513512 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 14:03:00.513512 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 14:03:00.513512 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 14:03:00.513512 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 15 14:03:00.513512 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 15 14:03:00.513512 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 023bca17-a19b-4428-9008-ec108226f7f4 could not be found. Oct 15 14:03:00.513512 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Oct 15 14:03:00.516195 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-959be72c-126f-435f-82c6-4fb4a4fa9181 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Returning 404 to user: Instance 023bca17-a19b-4428-9008-ec108226f7f4 could not be found. {{(pid=125242) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 15 14:03:00.517306 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-959be72c-126f-435f-82c6-4fb4a4fa9181 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] 10.222.0.36 "GET /compute/v2.1/servers/023bca17-a19b-4428-9008-ec108226f7f4" status: 404 len: 111 microversion: 2.1 time: 0.043672 Oct 15 14:03:00.517864 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 573/1141] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 14:03:00 2022] GET /compute/v2.1/servers/023bca17-a19b-4428-9008-ec108226f7f4 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 15 14:03:00.527501 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-7965d0ae-0f45-4630-bbd7-48b9890488a6 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Calling method '.version_select at 0x7f1b5e390160>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 14:03:00.549614 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-7965d0ae-0f45-4630-bbd7-48b9890488a6 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1389710918" status: 202 len: 0 microversion: 2.1 time: 0.026485 Oct 15 14:03:00.550513 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 569/1142] 10.222.0.36 () {58 vars in 1221 bytes} [Sat Oct 15 14:03:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1389710918 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 15 14:03:01.241255 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-20df50bf-72dd-4571-a03c-a49f45628eb2 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Action: 'create', calling method: .version_select at 0x7f1b5e342ca0>, body: {"keypair": {"name": "tempest-keypair-1597839276", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMlyCBrlkK8+rzBjnUqWxlemFrgb6Vo6FwLaleeDKzgZXNToZAx63BuG/Y0toh05GNxp0UrYPNq2DuvMnsjsnMGV2t+Im2M7zYSLxcdRg+Cckxv/TqNv2ozsfuwkRWy03Q=="}} {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 14:03:01.257988 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.quota [None req-20df50bf-72dd-4571-a03c-a49f45628eb2 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Getting quotas for project 1976b27e84a4484ba9d46a4244b08699. Resources: {'key_pairs'} {{(pid=125242) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 15 14:03:01.261913 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.quota [None req-20df50bf-72dd-4571-a03c-a49f45628eb2 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Getting quotas for user a10fc1a48c9c41eaa1bf3ff2e4109657 and project 1976b27e84a4484ba9d46a4244b08699. Resources: {'key_pairs'} {{(pid=125242) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 15 14:03:01.288162 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-20df50bf-72dd-4571-a03c-a49f45628eb2 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.050857 Oct 15 14:03:01.288773 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 574/1143] 10.222.0.36 () {60 vars in 1159 bytes} [Sat Oct 15 14:03:01 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 14:03:01.518920 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-73cf4095-d927-4675-97a6-c653b210bc46 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 14:03:01.519484 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-73cf4095-d927-4675-97a6-c653b210bc46 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] [instance: bceb7f8c-8854-493e-b707-efe98ac7eb5b] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 14:03:01.526538 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-73cf4095-d927-4675-97a6-c653b210bc46 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:03:01.527419 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-73cf4095-d927-4675-97a6-c653b210bc46 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:03:01.527888 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-73cf4095-d927-4675-97a6-c653b210bc46 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:03:01.528611 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-73cf4095-d927-4675-97a6-c653b210bc46 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:03:01.529073 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-73cf4095-d927-4675-97a6-c653b210bc46 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:03:01.529485 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-73cf4095-d927-4675-97a6-c653b210bc46 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:03:01.544033 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.wsgi [None req-73cf4095-d927-4675-97a6-c653b210bc46 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] HTTP exception thrown: Instance bceb7f8c-8854-493e-b707-efe98ac7eb5b could not be found. Oct 15 14:03:01.545939 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-73cf4095-d927-4675-97a6-c653b210bc46 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Request method failure captured: Oct 15 14:03:01.545939 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: request: GET /compute/v2.1/servers/bceb7f8c-8854-493e-b707-efe98ac7eb5b HTTP/1.1 Oct 15 14:03:01.545939 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: Accept: application/json Oct 15 14:03:01.545939 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: Accept-Encoding: identity Oct 15 14:03:01.545939 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: Connection: close Oct 15 14:03:01.545939 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: Content-Length: 0 Oct 15 14:03:01.545939 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: Content-Type: application/json Oct 15 14:03:01.545939 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: Host: 10.222.0.36 Oct 15 14:03:01.545939 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: Openstack-System-Scope: None Oct 15 14:03:01.545939 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: User-Agent: python-urllib3/1.26.12 Oct 15 14:03:01.545939 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Auth-Token: gAAAAABjSrs7akZdeWnKNfbPpL5PIG5mRXFvVXqD3141HrZ4nKb24dpr3EvMeYQ5Hx1nj7byWdB9YJsOPCMXYGIoIvcxe9Ohh7gIQjWQWXZ15vyi14OO7I0M7VeBlrNwCi-ODOHjIC8dn-wksQAcF8z9gIN8hepYOUySXSMp9aSpWIlNjY6cPxk Oct 15 14:03:01.545939 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Domain-Id: None Oct 15 14:03:01.545939 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Domain-Name: None Oct 15 14:03:01.545939 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Identity-Status: Confirmed Oct 15 14:03:01.545939 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Is-Admin-Project: True Oct 15 14:03:01.545939 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Project-Domain-Id: default Oct 15 14:03:01.545939 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Project-Domain-Name: Default Oct 15 14:03:01.545939 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Project-Id: 243c0b9b4bd742659061745c8dc4c696 Oct 15 14:03:01.545939 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Project-Name: tempest-TestVolumeBootPattern-1987600970 Oct 15 14:03:01.545939 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Role: member,reader Oct 15 14:03:01.545939 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Roles: member,reader Oct 15 14:03:01.547631 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_243c0b9b4bd742659061745c8dc4c696", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/243c0b9b4bd742659061745c8dc4c696"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/243c0b9b4bd742659061745c8dc4c696"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/243c0b9b4bd742659061745c8dc4c696"}]}] Oct 15 14:03:01.547631 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Tenant: tempest-TestVolumeBootPattern-1987600970 Oct 15 14:03:01.547631 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Tenant-Id: 243c0b9b4bd742659061745c8dc4c696 Oct 15 14:03:01.547631 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Tenant-Name: tempest-TestVolumeBootPattern-1987600970 Oct 15 14:03:01.547631 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-User: tempest-TestVolumeBootPattern-1987600970-project Oct 15 14:03:01.547631 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-User-Domain-Id: default Oct 15 14:03:01.547631 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-User-Domain-Name: Default Oct 15 14:03:01.547631 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-User-Id: 193bf7a17f544770a27c07f6b8cc0988 Oct 15 14:03:01.547631 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-User-Name: tempest-TestVolumeBootPattern-1987600970-project Oct 15 14:03:01.547631 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: method: > Oct 15 14:03:01.547631 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: exception: Instance bceb7f8c-8854-493e-b707-efe98ac7eb5b could not be found. Oct 15 14:03:01.547631 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: action_args: {'id': 'bceb7f8c-8854-493e-b707-efe98ac7eb5b'} Oct 15 14:03:01.548544 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 15 14:03:01.548544 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 14:03:01.548544 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 15 14:03:01.548544 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 15 14:03:01.548544 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 15 14:03:01.548544 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 15 14:03:01.548544 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 15 14:03:01.548544 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 15 14:03:01.548544 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 15 14:03:01.548544 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 15 14:03:01.548544 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bceb7f8c-8854-493e-b707-efe98ac7eb5b could not be found. Oct 15 14:03:01.548544 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Oct 15 14:03:01.548544 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 14:03:01.548544 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Oct 15 14:03:01.548544 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 14:03:01.548544 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 14:03:01.548544 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 14:03:01.548544 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 15 14:03:01.548544 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 15 14:03:01.548544 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 15 14:03:01.549865 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 15 14:03:01.549865 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 15 14:03:01.549865 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 15 14:03:01.549865 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 15 14:03:01.549865 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 15 14:03:01.549865 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 15 14:03:01.549865 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 15 14:03:01.549865 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bceb7f8c-8854-493e-b707-efe98ac7eb5b could not be found. Oct 15 14:03:01.549865 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Oct 15 14:03:01.549865 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 14:03:01.549865 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Oct 15 14:03:01.549865 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 14:03:01.549865 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 14:03:01.549865 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 14:03:01.549865 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 15 14:03:01.549865 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 15 14:03:01.549865 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bceb7f8c-8854-493e-b707-efe98ac7eb5b could not be found. Oct 15 14:03:01.549865 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Oct 15 14:03:01.551028 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-73cf4095-d927-4675-97a6-c653b210bc46 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Returning 404 to user: Instance bceb7f8c-8854-493e-b707-efe98ac7eb5b could not be found. {{(pid=125243) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 15 14:03:01.551028 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-73cf4095-d927-4675-97a6-c653b210bc46 tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] 10.222.0.36 "GET /compute/v2.1/servers/bceb7f8c-8854-493e-b707-efe98ac7eb5b" status: 404 len: 111 microversion: 2.1 time: 0.033084 Oct 15 14:03:01.551028 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 570/1144] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 14:03:01 2022] GET /compute/v2.1/servers/bceb7f8c-8854-493e-b707-efe98ac7eb5b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 15 14:03:01.754674 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [req-554f0dac-47da-4fa2-9625-0c50367dfc07 req-616167e5-f0d9-46ee-82c1-bd280ff26549 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bceb7f8c-8854-493e-b707-efe98ac7eb5b", "name": "network-vif-deleted", "tag": "a8e5516a-30ab-4376-8e26-9efdb40d9c1e"}]} {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 14:03:01.770253 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [req-554f0dac-47da-4fa2-9625-0c50367dfc07 req-616167e5-f0d9-46ee-82c1-bd280ff26549 service nova] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:03:01.771709 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [req-554f0dac-47da-4fa2-9625-0c50367dfc07 req-616167e5-f0d9-46ee-82c1-bd280ff26549 service nova] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:03:01.772400 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [req-554f0dac-47da-4fa2-9625-0c50367dfc07 req-616167e5-f0d9-46ee-82c1-bd280ff26549 service nova] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:03:01.785439 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.compute.server_external_events [req-554f0dac-47da-4fa2-9625-0c50367dfc07 req-616167e5-f0d9-46ee-82c1-bd280ff26549 service nova] Creating event network-vif-deleted:a8e5516a-30ab-4376-8e26-9efdb40d9c1e for instance bceb7f8c-8854-493e-b707-efe98ac7eb5b on hv-cinder-86149 Oct 15 14:03:01.790662 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [req-554f0dac-47da-4fa2-9625-0c50367dfc07 req-616167e5-f0d9-46ee-82c1-bd280ff26549 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040598 Oct 15 14:03:01.791703 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 575/1145] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 15 14:03:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 14:03:02.040255 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-578df805-5e54-484c-9640-6917d716360a tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 14:03:02.040754 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-578df805-5e54-484c-9640-6917d716360a tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] [instance: 9209310f-9812-4e8e-9a64-a46690948204] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 14:03:02.047106 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-578df805-5e54-484c-9640-6917d716360a tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:03:02.047621 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-578df805-5e54-484c-9640-6917d716360a tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:03:02.048091 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-578df805-5e54-484c-9640-6917d716360a tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:03:02.048863 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-578df805-5e54-484c-9640-6917d716360a tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:03:02.049314 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-578df805-5e54-484c-9640-6917d716360a tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:03:02.049741 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-578df805-5e54-484c-9640-6917d716360a tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:03:02.064459 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.wsgi [None req-578df805-5e54-484c-9640-6917d716360a tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] HTTP exception thrown: Instance 9209310f-9812-4e8e-9a64-a46690948204 could not be found. Oct 15 14:03:02.066229 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-578df805-5e54-484c-9640-6917d716360a tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Request method failure captured: Oct 15 14:03:02.066229 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: request: DELETE /compute/v2.1/servers/9209310f-9812-4e8e-9a64-a46690948204 HTTP/1.1 Oct 15 14:03:02.066229 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: Accept: application/json Oct 15 14:03:02.066229 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: Accept-Encoding: identity Oct 15 14:03:02.066229 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: Connection: close Oct 15 14:03:02.066229 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: Content-Length: 0 Oct 15 14:03:02.066229 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: Content-Type: application/json Oct 15 14:03:02.066229 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: Host: 10.222.0.36 Oct 15 14:03:02.066229 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: Openstack-System-Scope: None Oct 15 14:03:02.066229 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: User-Agent: python-urllib3/1.26.12 Oct 15 14:03:02.066229 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Auth-Token: gAAAAABjSrs7akZdeWnKNfbPpL5PIG5mRXFvVXqD3141HrZ4nKb24dpr3EvMeYQ5Hx1nj7byWdB9YJsOPCMXYGIoIvcxe9Ohh7gIQjWQWXZ15vyi14OO7I0M7VeBlrNwCi-ODOHjIC8dn-wksQAcF8z9gIN8hepYOUySXSMp9aSpWIlNjY6cPxk Oct 15 14:03:02.066229 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Domain-Id: None Oct 15 14:03:02.066229 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Domain-Name: None Oct 15 14:03:02.066229 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Identity-Status: Confirmed Oct 15 14:03:02.066229 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Is-Admin-Project: True Oct 15 14:03:02.066229 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Project-Domain-Id: default Oct 15 14:03:02.066229 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Project-Domain-Name: Default Oct 15 14:03:02.066229 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Project-Id: 243c0b9b4bd742659061745c8dc4c696 Oct 15 14:03:02.066229 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Project-Name: tempest-TestVolumeBootPattern-1987600970 Oct 15 14:03:02.066229 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Role: member,reader Oct 15 14:03:02.066229 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Roles: member,reader Oct 15 14:03:02.067622 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_243c0b9b4bd742659061745c8dc4c696", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/243c0b9b4bd742659061745c8dc4c696"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/243c0b9b4bd742659061745c8dc4c696"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/243c0b9b4bd742659061745c8dc4c696"}]}] Oct 15 14:03:02.067622 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Tenant: tempest-TestVolumeBootPattern-1987600970 Oct 15 14:03:02.067622 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Tenant-Id: 243c0b9b4bd742659061745c8dc4c696 Oct 15 14:03:02.067622 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Tenant-Name: tempest-TestVolumeBootPattern-1987600970 Oct 15 14:03:02.067622 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-User: tempest-TestVolumeBootPattern-1987600970-project Oct 15 14:03:02.067622 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-User-Domain-Id: default Oct 15 14:03:02.067622 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-User-Domain-Name: Default Oct 15 14:03:02.067622 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-User-Id: 193bf7a17f544770a27c07f6b8cc0988 Oct 15 14:03:02.067622 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-User-Name: tempest-TestVolumeBootPattern-1987600970-project Oct 15 14:03:02.067622 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: method: > Oct 15 14:03:02.067622 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: exception: Instance 9209310f-9812-4e8e-9a64-a46690948204 could not be found. Oct 15 14:03:02.067622 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: action_args: {'id': '9209310f-9812-4e8e-9a64-a46690948204'} Oct 15 14:03:02.068594 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 15 14:03:02.068594 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 14:03:02.068594 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 15 14:03:02.068594 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 15 14:03:02.068594 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 15 14:03:02.068594 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 15 14:03:02.068594 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 15 14:03:02.068594 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 15 14:03:02.068594 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 15 14:03:02.068594 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 15 14:03:02.068594 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9209310f-9812-4e8e-9a64-a46690948204 could not be found. Oct 15 14:03:02.068594 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Oct 15 14:03:02.068594 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 14:03:02.068594 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Oct 15 14:03:02.068594 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 14:03:02.068594 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 14:03:02.068594 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 14:03:02.068594 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 15 14:03:02.068594 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 15 14:03:02.068594 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 15 14:03:02.069881 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 15 14:03:02.069881 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 15 14:03:02.069881 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 15 14:03:02.069881 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 15 14:03:02.069881 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 15 14:03:02.069881 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 15 14:03:02.069881 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 15 14:03:02.069881 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 15 14:03:02.069881 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 15 14:03:02.069881 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9209310f-9812-4e8e-9a64-a46690948204 could not be found. Oct 15 14:03:02.069881 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Oct 15 14:03:02.069881 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 14:03:02.069881 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Oct 15 14:03:02.069881 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 14:03:02.069881 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 14:03:02.069881 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 14:03:02.069881 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 15 14:03:02.069881 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 15 14:03:02.069881 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9209310f-9812-4e8e-9a64-a46690948204 could not be found. Oct 15 14:03:02.069881 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Oct 15 14:03:02.071159 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-578df805-5e54-484c-9640-6917d716360a tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Returning 404 to user: Instance 9209310f-9812-4e8e-9a64-a46690948204 could not be found. {{(pid=125243) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 15 14:03:02.071159 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-578df805-5e54-484c-9640-6917d716360a tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] 10.222.0.36 "DELETE /compute/v2.1/servers/9209310f-9812-4e8e-9a64-a46690948204" status: 404 len: 111 microversion: 2.1 time: 0.031418 Oct 15 14:03:02.071159 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 571/1146] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 15 14:03:02 2022] DELETE /compute/v2.1/servers/9209310f-9812-4e8e-9a64-a46690948204 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 15 14:03:02.077382 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-79bd4dcc-2a1f-4b43-a211-085d0d1fa35c tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 14:03:02.078104 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-79bd4dcc-2a1f-4b43-a211-085d0d1fa35c tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] [instance: 9209310f-9812-4e8e-9a64-a46690948204] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 14:03:02.084841 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-79bd4dcc-2a1f-4b43-a211-085d0d1fa35c tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:03:02.085334 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-79bd4dcc-2a1f-4b43-a211-085d0d1fa35c tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:03:02.085771 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-79bd4dcc-2a1f-4b43-a211-085d0d1fa35c tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:03:02.086481 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-79bd4dcc-2a1f-4b43-a211-085d0d1fa35c tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:03:02.086935 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-79bd4dcc-2a1f-4b43-a211-085d0d1fa35c tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:03:02.087364 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-79bd4dcc-2a1f-4b43-a211-085d0d1fa35c tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:03:02.102081 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.wsgi [None req-79bd4dcc-2a1f-4b43-a211-085d0d1fa35c tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] HTTP exception thrown: Instance 9209310f-9812-4e8e-9a64-a46690948204 could not be found. Oct 15 14:03:02.103752 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-79bd4dcc-2a1f-4b43-a211-085d0d1fa35c tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Request method failure captured: Oct 15 14:03:02.103752 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: request: GET /compute/v2.1/servers/9209310f-9812-4e8e-9a64-a46690948204 HTTP/1.1 Oct 15 14:03:02.103752 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Accept: application/json Oct 15 14:03:02.103752 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Accept-Encoding: identity Oct 15 14:03:02.103752 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Connection: close Oct 15 14:03:02.103752 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Content-Length: 0 Oct 15 14:03:02.103752 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Content-Type: application/json Oct 15 14:03:02.103752 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Host: 10.222.0.36 Oct 15 14:03:02.103752 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Openstack-System-Scope: None Oct 15 14:03:02.103752 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: User-Agent: python-urllib3/1.26.12 Oct 15 14:03:02.103752 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Auth-Token: gAAAAABjSrs7akZdeWnKNfbPpL5PIG5mRXFvVXqD3141HrZ4nKb24dpr3EvMeYQ5Hx1nj7byWdB9YJsOPCMXYGIoIvcxe9Ohh7gIQjWQWXZ15vyi14OO7I0M7VeBlrNwCi-ODOHjIC8dn-wksQAcF8z9gIN8hepYOUySXSMp9aSpWIlNjY6cPxk Oct 15 14:03:02.103752 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Domain-Id: None Oct 15 14:03:02.103752 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Domain-Name: None Oct 15 14:03:02.103752 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Identity-Status: Confirmed Oct 15 14:03:02.103752 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Is-Admin-Project: True Oct 15 14:03:02.103752 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Project-Domain-Id: default Oct 15 14:03:02.103752 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Project-Domain-Name: Default Oct 15 14:03:02.103752 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Project-Id: 243c0b9b4bd742659061745c8dc4c696 Oct 15 14:03:02.103752 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Project-Name: tempest-TestVolumeBootPattern-1987600970 Oct 15 14:03:02.103752 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Role: member,reader Oct 15 14:03:02.103752 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Roles: member,reader Oct 15 14:03:02.105383 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_243c0b9b4bd742659061745c8dc4c696", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/243c0b9b4bd742659061745c8dc4c696"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/243c0b9b4bd742659061745c8dc4c696"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/243c0b9b4bd742659061745c8dc4c696"}]}] Oct 15 14:03:02.105383 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Tenant: tempest-TestVolumeBootPattern-1987600970 Oct 15 14:03:02.105383 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Tenant-Id: 243c0b9b4bd742659061745c8dc4c696 Oct 15 14:03:02.105383 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Tenant-Name: tempest-TestVolumeBootPattern-1987600970 Oct 15 14:03:02.105383 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-User: tempest-TestVolumeBootPattern-1987600970-project Oct 15 14:03:02.105383 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-User-Domain-Id: default Oct 15 14:03:02.105383 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-User-Domain-Name: Default Oct 15 14:03:02.105383 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-User-Id: 193bf7a17f544770a27c07f6b8cc0988 Oct 15 14:03:02.105383 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-User-Name: tempest-TestVolumeBootPattern-1987600970-project Oct 15 14:03:02.105383 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: method: > Oct 15 14:03:02.105383 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: exception: Instance 9209310f-9812-4e8e-9a64-a46690948204 could not be found. Oct 15 14:03:02.105383 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: action_args: {'id': '9209310f-9812-4e8e-9a64-a46690948204'} Oct 15 14:03:02.106318 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 15 14:03:02.106318 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 14:03:02.106318 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 15 14:03:02.106318 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 15 14:03:02.106318 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 15 14:03:02.106318 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 15 14:03:02.106318 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 15 14:03:02.106318 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 15 14:03:02.106318 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 15 14:03:02.106318 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 15 14:03:02.106318 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9209310f-9812-4e8e-9a64-a46690948204 could not be found. Oct 15 14:03:02.106318 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Oct 15 14:03:02.106318 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 14:03:02.106318 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Oct 15 14:03:02.106318 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 14:03:02.106318 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 14:03:02.106318 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 14:03:02.106318 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 15 14:03:02.106318 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 15 14:03:02.106318 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 15 14:03:02.107864 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 15 14:03:02.107864 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 15 14:03:02.107864 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 15 14:03:02.107864 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 15 14:03:02.107864 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 15 14:03:02.107864 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 15 14:03:02.107864 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 15 14:03:02.107864 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9209310f-9812-4e8e-9a64-a46690948204 could not be found. Oct 15 14:03:02.107864 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Oct 15 14:03:02.107864 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 14:03:02.107864 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Oct 15 14:03:02.107864 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 14:03:02.107864 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 14:03:02.107864 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 14:03:02.107864 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 15 14:03:02.107864 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 15 14:03:02.107864 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9209310f-9812-4e8e-9a64-a46690948204 could not be found. Oct 15 14:03:02.107864 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Oct 15 14:03:02.109302 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-79bd4dcc-2a1f-4b43-a211-085d0d1fa35c tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Returning 404 to user: Instance 9209310f-9812-4e8e-9a64-a46690948204 could not be found. {{(pid=125242) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 15 14:03:02.109302 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-79bd4dcc-2a1f-4b43-a211-085d0d1fa35c tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] 10.222.0.36 "GET /compute/v2.1/servers/9209310f-9812-4e8e-9a64-a46690948204" status: 404 len: 111 microversion: 2.1 time: 0.032212 Oct 15 14:03:02.109302 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 576/1147] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 14:03:02 2022] GET /compute/v2.1/servers/9209310f-9812-4e8e-9a64-a46690948204 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 15 14:03:02.908217 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-1f822fa6-c154-4a44-83f0-35e2e9468c35 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-576839672", "imageRef": "26e64909-1cae-49ca-af5e-adea40c062d7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b6c514f8-1a01-4cc0-b2b4-f8ec3eab2ef0"}], "security_groups": [{"name": "tempest-securitygroup--309498600"}], "key_name": "tempest-keypair-1597839276", "user_data": "}} {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 14:03:03.025408 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.network.neutron [None req-1f822fa6-c154-4a44-83f0-35e2e9468c35 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] validate_networks() for [('b6c514f8-1a01-4cc0-b2b4-f8ec3eab2ef0', None, None, None, None, None)] {{(pid=125243) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 15 14:03:03.430411 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.virt.hardware [None req-1f822fa6-c154-4a44-83f0-35e2e9468c35 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Flavor limits 0:0:0 {{(pid=125243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 15 14:03:03.430596 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-69cf222e-9685-4788-97ac-b181a28b735f tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] Calling method '.version_select at 0x7f1b5e1e4af0>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 14:03:03.431055 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.virt.hardware [None req-1f822fa6-c154-4a44-83f0-35e2e9468c35 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Image limits 0:0:0 {{(pid=125243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 15 14:03:03.431536 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.virt.hardware [None req-1f822fa6-c154-4a44-83f0-35e2e9468c35 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Flavor pref 0:0:0 {{(pid=125243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 15 14:03:03.431971 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.virt.hardware [None req-1f822fa6-c154-4a44-83f0-35e2e9468c35 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Image pref 0:0:0 {{(pid=125243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 15 14:03:03.432384 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.virt.hardware [None req-1f822fa6-c154-4a44-83f0-35e2e9468c35 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 15 14:03:03.445153 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-1f822fa6-c154-4a44-83f0-35e2e9468c35 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:03:03.445814 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-1f822fa6-c154-4a44-83f0-35e2e9468c35 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:03:03.446318 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-1f822fa6-c154-4a44-83f0-35e2e9468c35 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:03:03.448865 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-1f822fa6-c154-4a44-83f0-35e2e9468c35 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:03:03.449365 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-1f822fa6-c154-4a44-83f0-35e2e9468c35 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:03:03.449989 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-1f822fa6-c154-4a44-83f0-35e2e9468c35 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:03:03.454719 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-69cf222e-9685-4788-97ac-b181a28b735f tempest-TestVolumeBootPattern-1987600970 tempest-TestVolumeBootPattern-1987600970-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1731665434" status: 202 len: 0 microversion: 2.1 time: 0.027939 Oct 15 14:03:03.456015 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 577/1148] 10.222.0.36 () {58 vars in 1263 bytes} [Sat Oct 15 14:03:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1731665434 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 15 14:03:03.475107 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.quota [None req-1f822fa6-c154-4a44-83f0-35e2e9468c35 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Getting quotas for project 1976b27e84a4484ba9d46a4244b08699. Resources: {'cores', 'ram', 'instances'} {{(pid=125243) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 15 14:03:03.479220 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.quota [None req-1f822fa6-c154-4a44-83f0-35e2e9468c35 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Getting quotas for user a10fc1a48c9c41eaa1bf3ff2e4109657 and project 1976b27e84a4484ba9d46a4244b08699. Resources: {'cores', 'ram', 'instances'} {{(pid=125243) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 15 14:03:03.491569 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-1f822fa6-c154-4a44-83f0-35e2e9468c35 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Going to run 1 instances... {{(pid=125243) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 15 14:03:03.494131 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-1f822fa6-c154-4a44-83f0-35e2e9468c35 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] [instance: 165f6084-ac1a-4348-b7bb-9c2f6652f804] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='26e64909-1cae-49ca-af5e-adea40c062d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125243) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 15 14:03:03.542524 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-1f822fa6-c154-4a44-83f0-35e2e9468c35 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.638599 Oct 15 14:03:03.543548 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 572/1149] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 15 14:03:02 2022] POST /compute/v2.1/servers => generated 401 bytes in 640 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 15 14:03:03.554811 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-d67dc92d-a2f4-49c6-918a-a1858e627c0a tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 14:03:03.555766 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-d67dc92d-a2f4-49c6-918a-a1858e627c0a tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] [instance: 165f6084-ac1a-4348-b7bb-9c2f6652f804] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 14:03:03.619220 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-d67dc92d-a2f4-49c6-918a-a1858e627c0a tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10fc1a48c9c41eaa1bf3ff2e4109657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1976b27e84a4484ba9d46a4244b08699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 14:03:03.628088 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-d67dc92d-a2f4-49c6-918a-a1858e627c0a tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] 10.222.0.36 "GET /compute/v2.1/servers/165f6084-ac1a-4348-b7bb-9c2f6652f804" status: 200 len: 1241 microversion: 2.1 time: 0.077187 Oct 15 14:03:03.632218 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 578/1150] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 14:03:03 2022] GET /compute/v2.1/servers/165f6084-ac1a-4348-b7bb-9c2f6652f804 => generated 1241 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 14:03:04.652117 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-9408874b-6d5f-4af7-90a2-4eabaccef434 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 14:03:04.652905 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-9408874b-6d5f-4af7-90a2-4eabaccef434 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] [instance: 165f6084-ac1a-4348-b7bb-9c2f6652f804] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 14:03:04.670258 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-9408874b-6d5f-4af7-90a2-4eabaccef434 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:03:04.670773 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-9408874b-6d5f-4af7-90a2-4eabaccef434 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:03:04.671211 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-9408874b-6d5f-4af7-90a2-4eabaccef434 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:03:04.672427 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-9408874b-6d5f-4af7-90a2-4eabaccef434 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:03:04.672896 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-9408874b-6d5f-4af7-90a2-4eabaccef434 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:03:04.673551 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-9408874b-6d5f-4af7-90a2-4eabaccef434 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:03:04.751686 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-9408874b-6d5f-4af7-90a2-4eabaccef434 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10fc1a48c9c41eaa1bf3ff2e4109657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1976b27e84a4484ba9d46a4244b08699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 14:03:04.763249 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-9408874b-6d5f-4af7-90a2-4eabaccef434 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] 10.222.0.36 "GET /compute/v2.1/servers/165f6084-ac1a-4348-b7bb-9c2f6652f804" status: 200 len: 1311 microversion: 2.1 time: 0.115961 Oct 15 14:03:04.764179 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 573/1151] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 14:03:04 2022] GET /compute/v2.1/servers/165f6084-ac1a-4348-b7bb-9c2f6652f804 => generated 1311 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 14:03:05.788941 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-751901ef-4dd5-4113-9e59-f0ba7f52f944 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 14:03:05.790562 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-751901ef-4dd5-4113-9e59-f0ba7f52f944 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] [instance: 165f6084-ac1a-4348-b7bb-9c2f6652f804] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 14:03:05.806464 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-751901ef-4dd5-4113-9e59-f0ba7f52f944 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:03:05.807479 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-751901ef-4dd5-4113-9e59-f0ba7f52f944 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:03:05.808462 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-751901ef-4dd5-4113-9e59-f0ba7f52f944 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:03:05.810249 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-751901ef-4dd5-4113-9e59-f0ba7f52f944 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:03:05.811074 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-751901ef-4dd5-4113-9e59-f0ba7f52f944 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:03:05.811987 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-751901ef-4dd5-4113-9e59-f0ba7f52f944 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:03:06.066324 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-751901ef-4dd5-4113-9e59-f0ba7f52f944 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10fc1a48c9c41eaa1bf3ff2e4109657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1976b27e84a4484ba9d46a4244b08699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 14:03:06.074816 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-751901ef-4dd5-4113-9e59-f0ba7f52f944 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] 10.222.0.36 "GET /compute/v2.1/servers/165f6084-ac1a-4348-b7bb-9c2f6652f804" status: 200 len: 1366 microversion: 2.1 time: 0.290445 Oct 15 14:03:06.075395 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 579/1152] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 14:03:05 2022] GET /compute/v2.1/servers/165f6084-ac1a-4348-b7bb-9c2f6652f804 => generated 1366 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 14:03:06.504090 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [req-fff84915-ff47-42e0-8907-64ab2ff4f0ee req-4e0bf15e-5f91-4202-be37-641dd9792eab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "165f6084-ac1a-4348-b7bb-9c2f6652f804", "tag": "512f7ddf-b05b-425b-a250-3833a6c71721"}]} {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 14:03:06.517777 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [req-fff84915-ff47-42e0-8907-64ab2ff4f0ee req-4e0bf15e-5f91-4202-be37-641dd9792eab service nova] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:03:06.518665 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [req-fff84915-ff47-42e0-8907-64ab2ff4f0ee req-4e0bf15e-5f91-4202-be37-641dd9792eab service nova] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:03:06.519178 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [req-fff84915-ff47-42e0-8907-64ab2ff4f0ee req-4e0bf15e-5f91-4202-be37-641dd9792eab service nova] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:03:06.523952 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG dbcounter [-] [125243] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=125243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 14:03:06.534064 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.compute.server_external_events [req-fff84915-ff47-42e0-8907-64ab2ff4f0ee req-4e0bf15e-5f91-4202-be37-641dd9792eab service nova] Creating event network-changed:512f7ddf-b05b-425b-a250-3833a6c71721 for instance 165f6084-ac1a-4348-b7bb-9c2f6652f804 on hv-cinder-86149 Oct 15 14:03:06.540818 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [req-fff84915-ff47-42e0-8907-64ab2ff4f0ee req-4e0bf15e-5f91-4202-be37-641dd9792eab service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040591 Oct 15 14:03:06.544142 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 574/1153] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 15 14:03:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 14:03:07.099596 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-b61135fd-58af-4028-a07f-9ebc1b2a4c12 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 14:03:07.100642 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-b61135fd-58af-4028-a07f-9ebc1b2a4c12 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] [instance: 165f6084-ac1a-4348-b7bb-9c2f6652f804] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 14:03:07.107945 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-b61135fd-58af-4028-a07f-9ebc1b2a4c12 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:03:07.112929 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-b61135fd-58af-4028-a07f-9ebc1b2a4c12 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:03:07.113512 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-b61135fd-58af-4028-a07f-9ebc1b2a4c12 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:03:07.114437 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-b61135fd-58af-4028-a07f-9ebc1b2a4c12 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:03:07.115566 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-b61135fd-58af-4028-a07f-9ebc1b2a4c12 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:03:07.116025 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-b61135fd-58af-4028-a07f-9ebc1b2a4c12 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:03:07.273442 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-b61135fd-58af-4028-a07f-9ebc1b2a4c12 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10fc1a48c9c41eaa1bf3ff2e4109657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1976b27e84a4484ba9d46a4244b08699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 14:03:07.282729 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-b61135fd-58af-4028-a07f-9ebc1b2a4c12 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] 10.222.0.36 "GET /compute/v2.1/servers/165f6084-ac1a-4348-b7bb-9c2f6652f804" status: 200 len: 1366 microversion: 2.1 time: 0.187524 Oct 15 14:03:07.298361 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 580/1154] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 14:03:07 2022] GET /compute/v2.1/servers/165f6084-ac1a-4348-b7bb-9c2f6652f804 => generated 1366 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 14:03:08.307429 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-162e9469-9af6-4e2c-a1ce-f01151957838 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 14:03:08.308185 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-162e9469-9af6-4e2c-a1ce-f01151957838 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] [instance: 165f6084-ac1a-4348-b7bb-9c2f6652f804] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 14:03:08.316175 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-162e9469-9af6-4e2c-a1ce-f01151957838 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:03:08.317009 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-162e9469-9af6-4e2c-a1ce-f01151957838 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:03:08.317441 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-162e9469-9af6-4e2c-a1ce-f01151957838 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:03:08.318126 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-162e9469-9af6-4e2c-a1ce-f01151957838 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:03:08.318573 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-162e9469-9af6-4e2c-a1ce-f01151957838 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:03:08.318994 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-162e9469-9af6-4e2c-a1ce-f01151957838 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:03:08.548407 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-162e9469-9af6-4e2c-a1ce-f01151957838 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10fc1a48c9c41eaa1bf3ff2e4109657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1976b27e84a4484ba9d46a4244b08699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 14:03:08.556754 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-162e9469-9af6-4e2c-a1ce-f01151957838 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] 10.222.0.36 "GET /compute/v2.1/servers/165f6084-ac1a-4348-b7bb-9c2f6652f804" status: 200 len: 1366 microversion: 2.1 time: 0.254675 Oct 15 14:03:08.557495 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 575/1155] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 14:03:08 2022] GET /compute/v2.1/servers/165f6084-ac1a-4348-b7bb-9c2f6652f804 => generated 1366 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 14:03:09.580204 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-1d65fe70-3bfc-4f10-a539-d5804d3c7377 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 14:03:09.581497 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-1d65fe70-3bfc-4f10-a539-d5804d3c7377 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] [instance: 165f6084-ac1a-4348-b7bb-9c2f6652f804] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 14:03:09.589178 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-1d65fe70-3bfc-4f10-a539-d5804d3c7377 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:03:09.589642 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-1d65fe70-3bfc-4f10-a539-d5804d3c7377 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:03:09.590282 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-1d65fe70-3bfc-4f10-a539-d5804d3c7377 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:03:09.591195 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-1d65fe70-3bfc-4f10-a539-d5804d3c7377 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:03:09.591834 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-1d65fe70-3bfc-4f10-a539-d5804d3c7377 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:03:09.592271 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-1d65fe70-3bfc-4f10-a539-d5804d3c7377 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:03:09.597725 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG dbcounter [-] [125242] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=125242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 14:03:09.980032 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-1d65fe70-3bfc-4f10-a539-d5804d3c7377 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10fc1a48c9c41eaa1bf3ff2e4109657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1976b27e84a4484ba9d46a4244b08699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 14:03:09.988312 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-1d65fe70-3bfc-4f10-a539-d5804d3c7377 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] 10.222.0.36 "GET /compute/v2.1/servers/165f6084-ac1a-4348-b7bb-9c2f6652f804" status: 200 len: 1366 microversion: 2.1 time: 0.412093 Oct 15 14:03:09.989154 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 581/1156] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 14:03:09 2022] GET /compute/v2.1/servers/165f6084-ac1a-4348-b7bb-9c2f6652f804 => generated 1366 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 14:03:11.011116 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-13faaefc-ae69-48b8-83c6-c6f64e7dd704 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 14:03:11.011945 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-13faaefc-ae69-48b8-83c6-c6f64e7dd704 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] [instance: 165f6084-ac1a-4348-b7bb-9c2f6652f804] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 14:03:11.018785 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-13faaefc-ae69-48b8-83c6-c6f64e7dd704 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:03:11.019356 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-13faaefc-ae69-48b8-83c6-c6f64e7dd704 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:03:11.019847 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-13faaefc-ae69-48b8-83c6-c6f64e7dd704 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:03:11.021039 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-13faaefc-ae69-48b8-83c6-c6f64e7dd704 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:03:11.021550 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-13faaefc-ae69-48b8-83c6-c6f64e7dd704 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:03:11.022064 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-13faaefc-ae69-48b8-83c6-c6f64e7dd704 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:03:11.194984 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-13faaefc-ae69-48b8-83c6-c6f64e7dd704 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10fc1a48c9c41eaa1bf3ff2e4109657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1976b27e84a4484ba9d46a4244b08699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 14:03:11.204750 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-13faaefc-ae69-48b8-83c6-c6f64e7dd704 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] 10.222.0.36 "GET /compute/v2.1/servers/165f6084-ac1a-4348-b7bb-9c2f6652f804" status: 200 len: 1366 microversion: 2.1 time: 0.197472 Oct 15 14:03:11.205376 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 576/1157] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 14:03:11 2022] GET /compute/v2.1/servers/165f6084-ac1a-4348-b7bb-9c2f6652f804 => generated 1366 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 14:03:11.580072 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [req-f94666a6-787b-416c-ba3d-88e12cbb07fe req-2326ed39-b1c5-440c-b55d-cf4384cb021c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "165f6084-ac1a-4348-b7bb-9c2f6652f804", "name": "network-vif-plugged", "status": "completed", "tag": "512f7ddf-b05b-425b-a250-3833a6c71721"}]} {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 14:03:11.591703 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [req-f94666a6-787b-416c-ba3d-88e12cbb07fe req-2326ed39-b1c5-440c-b55d-cf4384cb021c service nova] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:03:11.592229 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [req-f94666a6-787b-416c-ba3d-88e12cbb07fe req-2326ed39-b1c5-440c-b55d-cf4384cb021c service nova] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:03:11.592664 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [req-f94666a6-787b-416c-ba3d-88e12cbb07fe req-2326ed39-b1c5-440c-b55d-cf4384cb021c service nova] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:03:11.604954 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.compute.server_external_events [req-f94666a6-787b-416c-ba3d-88e12cbb07fe req-2326ed39-b1c5-440c-b55d-cf4384cb021c service nova] Creating event network-vif-plugged:512f7ddf-b05b-425b-a250-3833a6c71721 for instance 165f6084-ac1a-4348-b7bb-9c2f6652f804 on hv-cinder-86149 Oct 15 14:03:11.610165 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [req-f94666a6-787b-416c-ba3d-88e12cbb07fe req-2326ed39-b1c5-440c-b55d-cf4384cb021c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034529 Oct 15 14:03:11.610980 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 582/1158] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 15 14:03:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 14:03:12.227083 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-c6eed209-8448-401d-8aff-a70a17679eda tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 14:03:12.227740 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-c6eed209-8448-401d-8aff-a70a17679eda tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] [instance: 165f6084-ac1a-4348-b7bb-9c2f6652f804] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 14:03:12.235010 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-c6eed209-8448-401d-8aff-a70a17679eda tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:03:12.235500 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-c6eed209-8448-401d-8aff-a70a17679eda tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:03:12.235988 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-c6eed209-8448-401d-8aff-a70a17679eda tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:03:12.236711 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-c6eed209-8448-401d-8aff-a70a17679eda tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:03:12.237157 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-c6eed209-8448-401d-8aff-a70a17679eda tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:03:12.237561 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-c6eed209-8448-401d-8aff-a70a17679eda tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:03:12.389682 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-c6eed209-8448-401d-8aff-a70a17679eda tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10fc1a48c9c41eaa1bf3ff2e4109657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1976b27e84a4484ba9d46a4244b08699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 14:03:12.398855 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-c6eed209-8448-401d-8aff-a70a17679eda tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] 10.222.0.36 "GET /compute/v2.1/servers/165f6084-ac1a-4348-b7bb-9c2f6652f804" status: 200 len: 1366 microversion: 2.1 time: 0.175511 Oct 15 14:03:12.399453 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 577/1159] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 14:03:12 2022] GET /compute/v2.1/servers/165f6084-ac1a-4348-b7bb-9c2f6652f804 => generated 1366 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 14:03:13.425927 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-fd0a2c4f-51bb-44fd-a38f-a0cb791ac696 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 14:03:13.426740 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-fd0a2c4f-51bb-44fd-a38f-a0cb791ac696 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] [instance: 165f6084-ac1a-4348-b7bb-9c2f6652f804] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 14:03:13.429894 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG dbcounter [-] [125242] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=2,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=125242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 14:03:13.438155 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-fd0a2c4f-51bb-44fd-a38f-a0cb791ac696 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:03:13.439129 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-fd0a2c4f-51bb-44fd-a38f-a0cb791ac696 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:03:13.439566 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-fd0a2c4f-51bb-44fd-a38f-a0cb791ac696 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:03:13.440378 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-fd0a2c4f-51bb-44fd-a38f-a0cb791ac696 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:03:13.440827 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-fd0a2c4f-51bb-44fd-a38f-a0cb791ac696 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:03:13.441245 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-fd0a2c4f-51bb-44fd-a38f-a0cb791ac696 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:03:13.583374 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-fd0a2c4f-51bb-44fd-a38f-a0cb791ac696 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10fc1a48c9c41eaa1bf3ff2e4109657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1976b27e84a4484ba9d46a4244b08699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 14:03:13.591748 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-fd0a2c4f-51bb-44fd-a38f-a0cb791ac696 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] 10.222.0.36 "GET /compute/v2.1/servers/165f6084-ac1a-4348-b7bb-9c2f6652f804" status: 200 len: 1556 microversion: 2.1 time: 0.173290 Oct 15 14:03:13.592355 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 583/1160] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 14:03:13 2022] GET /compute/v2.1/servers/165f6084-ac1a-4348-b7bb-9c2f6652f804 => generated 1556 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 14:03:13.624142 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-0689f154-1f4b-4d5f-9ca7-6e13edd4950f tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 14:03:13.624736 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-0689f154-1f4b-4d5f-9ca7-6e13edd4950f tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] [instance: 165f6084-ac1a-4348-b7bb-9c2f6652f804] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 14:03:13.628367 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG dbcounter [-] [125243] Writing DB stats nova_cell0:SELECT=2 {{(pid=125243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 14:03:13.629040 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG dbcounter [-] [125243] Writing DB stats nova_cell0:SELECT=6 {{(pid=125243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 14:03:13.636371 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-0689f154-1f4b-4d5f-9ca7-6e13edd4950f tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:03:13.637063 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-0689f154-1f4b-4d5f-9ca7-6e13edd4950f tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:03:13.637701 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-0689f154-1f4b-4d5f-9ca7-6e13edd4950f tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:03:13.638728 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-0689f154-1f4b-4d5f-9ca7-6e13edd4950f tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:03:13.639333 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-0689f154-1f4b-4d5f-9ca7-6e13edd4950f tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:03:13.639834 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-0689f154-1f4b-4d5f-9ca7-6e13edd4950f tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:03:13.720153 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-0689f154-1f4b-4d5f-9ca7-6e13edd4950f tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] 10.222.0.36 "GET /compute/v2.1/servers/165f6084-ac1a-4348-b7bb-9c2f6652f804/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.101896 Oct 15 14:03:13.721534 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 578/1161] 10.222.0.36 () {58 vars in 1275 bytes} [Sat Oct 15 14:03:13 2022] GET /compute/v2.1/servers/165f6084-ac1a-4348-b7bb-9c2f6652f804/os-interface => generated 284 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 14:03:14.728041 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [req-cba43503-7aa3-40ae-9aa1-13642184c9a7 req-4d184da2-546d-4b27-ae56-35c79c5df794 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "165f6084-ac1a-4348-b7bb-9c2f6652f804", "tag": "512f7ddf-b05b-425b-a250-3833a6c71721"}]} {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 14:03:14.732897 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG dbcounter [-] [125242] Writing DB stats nova_cell0:SELECT=6 {{(pid=125242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 14:03:14.739801 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [req-cba43503-7aa3-40ae-9aa1-13642184c9a7 req-4d184da2-546d-4b27-ae56-35c79c5df794 service nova] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:03:14.740316 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [req-cba43503-7aa3-40ae-9aa1-13642184c9a7 req-4d184da2-546d-4b27-ae56-35c79c5df794 service nova] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:03:14.740758 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [req-cba43503-7aa3-40ae-9aa1-13642184c9a7 req-4d184da2-546d-4b27-ae56-35c79c5df794 service nova] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:03:14.753098 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.compute.server_external_events [req-cba43503-7aa3-40ae-9aa1-13642184c9a7 req-4d184da2-546d-4b27-ae56-35c79c5df794 service nova] Creating event network-changed:512f7ddf-b05b-425b-a250-3833a6c71721 for instance 165f6084-ac1a-4348-b7bb-9c2f6652f804 on hv-cinder-86149 Oct 15 14:03:14.758183 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [req-cba43503-7aa3-40ae-9aa1-13642184c9a7 req-4d184da2-546d-4b27-ae56-35c79c5df794 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033894 Oct 15 14:03:14.758786 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 584/1162] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 15 14:03:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 14:04:30.234943 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG dbcounter [-] [125243] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=125243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 14:04:30.235761 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG dbcounter [-] [125243] Writing DB stats nova_cell1:SELECT=22 {{(pid=125243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 14:04:30.241208 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-2842f7da-63d0-4229-880a-ae83af95e1b9 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 14:04:30.241812 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-2842f7da-63d0-4229-880a-ae83af95e1b9 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] [instance: 165f6084-ac1a-4348-b7bb-9c2f6652f804] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 14:04:30.249329 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-2842f7da-63d0-4229-880a-ae83af95e1b9 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:04:30.249843 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-2842f7da-63d0-4229-880a-ae83af95e1b9 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:04:30.250278 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-2842f7da-63d0-4229-880a-ae83af95e1b9 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:04:30.250971 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-2842f7da-63d0-4229-880a-ae83af95e1b9 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:04:30.251423 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-2842f7da-63d0-4229-880a-ae83af95e1b9 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:04:30.251851 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-2842f7da-63d0-4229-880a-ae83af95e1b9 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:04:30.277469 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-2842f7da-63d0-4229-880a-ae83af95e1b9 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] 10.222.0.36 "GET /compute/v2.1/servers/165f6084-ac1a-4348-b7bb-9c2f6652f804/ips" status: 200 len: 149 microversion: 2.1 time: 0.044574 Oct 15 14:04:30.278068 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 579/1163] 10.222.0.36 () {58 vars in 1248 bytes} [Sat Oct 15 14:04:30 2022] GET /compute/v2.1/servers/165f6084-ac1a-4348-b7bb-9c2f6652f804/ips => generated 149 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 14:04:31.623753 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG dbcounter [-] [125242] Writing DB stats nova_api:SELECT=3 {{(pid=125242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 14:04:31.624590 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG dbcounter [-] [125242] Writing DB stats nova_cell1:SELECT=14 {{(pid=125242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 14:04:31.625989 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 15 14:04:31.626158 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Sat Oct 15 14:04:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/165f6084-ac1a-4348-b7bb-9c2f6652f804/os-volume_attachments (ip 10.222.0.36) !!! Oct 15 14:04:31.634065 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-9c08c8fb-2b4b-429d-8103-7c6490c6e3f5 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "403a3efd-584f-49d3-9ca4-5de3a143962f"}} {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 14:04:31.636569 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-9c08c8fb-2b4b-429d-8103-7c6490c6e3f5 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] [instance: 165f6084-ac1a-4348-b7bb-9c2f6652f804] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 14:04:31.644426 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-9c08c8fb-2b4b-429d-8103-7c6490c6e3f5 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:04:31.644919 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-9c08c8fb-2b4b-429d-8103-7c6490c6e3f5 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:04:31.645402 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-9c08c8fb-2b4b-429d-8103-7c6490c6e3f5 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:04:31.646527 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-9c08c8fb-2b4b-429d-8103-7c6490c6e3f5 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:04:31.647423 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-9c08c8fb-2b4b-429d-8103-7c6490c6e3f5 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:04:31.648607 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-9c08c8fb-2b4b-429d-8103-7c6490c6e3f5 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:04:32.148570 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-9c08c8fb-2b4b-429d-8103-7c6490c6e3f5 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] 10.222.0.36 "POST /compute/v2.1/servers/165f6084-ac1a-4348-b7bb-9c2f6652f804/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.526709 Oct 15 14:04:32.149223 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 585/1164] 10.222.0.36 () {60 vars in 1323 bytes} [Sat Oct 15 14:04:31 2022] POST /compute/v2.1/servers/165f6084-ac1a-4348-b7bb-9c2f6652f804/os-volume_attachments => generated 194 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 14:04:38.823295 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-4ff7bc15-41e5-4f2b-96de-3c5059b0966d tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 14:04:38.824145 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-4ff7bc15-41e5-4f2b-96de-3c5059b0966d tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] [instance: 165f6084-ac1a-4348-b7bb-9c2f6652f804] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 14:04:38.831936 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-4ff7bc15-41e5-4f2b-96de-3c5059b0966d tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:04:38.832449 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-4ff7bc15-41e5-4f2b-96de-3c5059b0966d tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:04:38.832869 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-4ff7bc15-41e5-4f2b-96de-3c5059b0966d tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:04:38.833570 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-4ff7bc15-41e5-4f2b-96de-3c5059b0966d tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:04:38.834020 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-4ff7bc15-41e5-4f2b-96de-3c5059b0966d tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:04:38.834441 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-4ff7bc15-41e5-4f2b-96de-3c5059b0966d tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:04:38.995865 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.objects.instance [None req-4ff7bc15-41e5-4f2b-96de-3c5059b0966d tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lazy-loading 'services' on Instance uuid 165f6084-ac1a-4348-b7bb-9c2f6652f804 {{(pid=125243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 15 14:04:39.092603 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-4ff7bc15-41e5-4f2b-96de-3c5059b0966d tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] 10.222.0.36 "DELETE /compute/v2.1/servers/165f6084-ac1a-4348-b7bb-9c2f6652f804/os-volume_attachments/403a3efd-584f-49d3-9ca4-5de3a143962f" status: 202 len: 0 microversion: 2.1 time: 0.274456 Oct 15 14:04:39.093200 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 580/1165] 10.222.0.36 () {58 vars in 1416 bytes} [Sat Oct 15 14:04:38 2022] DELETE /compute/v2.1/servers/165f6084-ac1a-4348-b7bb-9c2f6652f804/os-volume_attachments/403a3efd-584f-49d3-9ca4-5de3a143962f => generated 0 bytes in 276 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 15 14:04:39.103652 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-0efb2cd5-d423-40d3-b3ce-ef2fb7df3182 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 14:04:39.106345 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-0efb2cd5-d423-40d3-b3ce-ef2fb7df3182 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] [instance: 165f6084-ac1a-4348-b7bb-9c2f6652f804] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 14:04:39.113435 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-0efb2cd5-d423-40d3-b3ce-ef2fb7df3182 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:04:39.113907 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-0efb2cd5-d423-40d3-b3ce-ef2fb7df3182 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:04:39.114532 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-0efb2cd5-d423-40d3-b3ce-ef2fb7df3182 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:04:39.115491 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-0efb2cd5-d423-40d3-b3ce-ef2fb7df3182 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:04:39.115975 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-0efb2cd5-d423-40d3-b3ce-ef2fb7df3182 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:04:39.116608 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-0efb2cd5-d423-40d3-b3ce-ef2fb7df3182 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:04:39.157904 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-0efb2cd5-d423-40d3-b3ce-ef2fb7df3182 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] 10.222.0.36 "GET /compute/v2.1/servers/165f6084-ac1a-4348-b7bb-9c2f6652f804/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059299 Oct 15 14:04:39.158654 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 586/1166] 10.222.0.36 () {58 vars in 1302 bytes} [Sat Oct 15 14:04:39 2022] GET /compute/v2.1/servers/165f6084-ac1a-4348-b7bb-9c2f6652f804/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 14:04:40.171213 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-587c2913-92e0-4a96-9f70-0390fbf369e7 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 14:04:40.173610 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-587c2913-92e0-4a96-9f70-0390fbf369e7 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] [instance: 165f6084-ac1a-4348-b7bb-9c2f6652f804] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 14:04:40.181340 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-587c2913-92e0-4a96-9f70-0390fbf369e7 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:04:40.181835 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-587c2913-92e0-4a96-9f70-0390fbf369e7 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:04:40.182271 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-587c2913-92e0-4a96-9f70-0390fbf369e7 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:04:40.182969 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-587c2913-92e0-4a96-9f70-0390fbf369e7 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:04:40.183435 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-587c2913-92e0-4a96-9f70-0390fbf369e7 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:04:40.184023 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-587c2913-92e0-4a96-9f70-0390fbf369e7 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:04:40.215739 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-587c2913-92e0-4a96-9f70-0390fbf369e7 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] 10.222.0.36 "GET /compute/v2.1/servers/165f6084-ac1a-4348-b7bb-9c2f6652f804/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048917 Oct 15 14:04:40.216360 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 581/1167] 10.222.0.36 () {58 vars in 1302 bytes} [Sat Oct 15 14:04:40 2022] GET /compute/v2.1/servers/165f6084-ac1a-4348-b7bb-9c2f6652f804/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 15 14:04:40.281417 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-b98629e9-9dae-4dff-bbdf-8870cda16939 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 14:04:40.282008 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-b98629e9-9dae-4dff-bbdf-8870cda16939 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] [instance: 165f6084-ac1a-4348-b7bb-9c2f6652f804] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 14:04:40.288681 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-b98629e9-9dae-4dff-bbdf-8870cda16939 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:04:40.289195 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-b98629e9-9dae-4dff-bbdf-8870cda16939 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:04:40.289907 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-b98629e9-9dae-4dff-bbdf-8870cda16939 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:04:40.290700 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-b98629e9-9dae-4dff-bbdf-8870cda16939 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:04:40.291148 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-b98629e9-9dae-4dff-bbdf-8870cda16939 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:04:40.291569 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-b98629e9-9dae-4dff-bbdf-8870cda16939 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:04:40.317590 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-b98629e9-9dae-4dff-bbdf-8870cda16939 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] [instance: 165f6084-ac1a-4348-b7bb-9c2f6652f804] Going to try to terminate instance {{(pid=125242) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 15 14:04:40.399984 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-b98629e9-9dae-4dff-bbdf-8870cda16939 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] 10.222.0.36 "DELETE /compute/v2.1/servers/165f6084-ac1a-4348-b7bb-9c2f6652f804" status: 204 len: 0 microversion: 2.1 time: 0.122197 Oct 15 14:04:40.400710 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 587/1168] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 15 14:04:40 2022] DELETE /compute/v2.1/servers/165f6084-ac1a-4348-b7bb-9c2f6652f804 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 15 14:04:40.409425 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-e652c39d-6e96-4764-89e2-f9d49590523a tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 14:04:40.410046 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-e652c39d-6e96-4764-89e2-f9d49590523a tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] [instance: 165f6084-ac1a-4348-b7bb-9c2f6652f804] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 14:04:40.416833 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-e652c39d-6e96-4764-89e2-f9d49590523a tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:04:40.417327 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-e652c39d-6e96-4764-89e2-f9d49590523a tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:04:40.417764 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-e652c39d-6e96-4764-89e2-f9d49590523a tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:04:40.418471 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-e652c39d-6e96-4764-89e2-f9d49590523a tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:04:40.418925 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-e652c39d-6e96-4764-89e2-f9d49590523a tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:04:40.419350 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-e652c39d-6e96-4764-89e2-f9d49590523a tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:04:40.555633 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-e652c39d-6e96-4764-89e2-f9d49590523a tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10fc1a48c9c41eaa1bf3ff2e4109657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1976b27e84a4484ba9d46a4244b08699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 14:04:40.563779 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-e652c39d-6e96-4764-89e2-f9d49590523a tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] 10.222.0.36 "GET /compute/v2.1/servers/165f6084-ac1a-4348-b7bb-9c2f6652f804" status: 200 len: 1680 microversion: 2.1 time: 0.158438 Oct 15 14:04:40.564454 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 582/1169] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 14:04:40 2022] GET /compute/v2.1/servers/165f6084-ac1a-4348-b7bb-9c2f6652f804 => generated 1680 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 14:04:41.591066 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-920c108a-6974-4249-8673-6cb98ea9e6bc tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 14:04:41.591721 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-920c108a-6974-4249-8673-6cb98ea9e6bc tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] [instance: 165f6084-ac1a-4348-b7bb-9c2f6652f804] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 14:04:41.600779 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-920c108a-6974-4249-8673-6cb98ea9e6bc tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:04:41.601432 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-920c108a-6974-4249-8673-6cb98ea9e6bc tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:04:41.602436 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-920c108a-6974-4249-8673-6cb98ea9e6bc tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:04:41.603310 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-920c108a-6974-4249-8673-6cb98ea9e6bc tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:04:41.603792 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-920c108a-6974-4249-8673-6cb98ea9e6bc tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:04:41.604206 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-920c108a-6974-4249-8673-6cb98ea9e6bc tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:04:41.753688 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.policy [None req-920c108a-6974-4249-8673-6cb98ea9e6bc tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10fc1a48c9c41eaa1bf3ff2e4109657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1976b27e84a4484ba9d46a4244b08699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125242) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 14:04:41.762487 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-920c108a-6974-4249-8673-6cb98ea9e6bc tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] 10.222.0.36 "GET /compute/v2.1/servers/165f6084-ac1a-4348-b7bb-9c2f6652f804" status: 200 len: 1680 microversion: 2.1 time: 0.177684 Oct 15 14:04:41.762997 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 588/1170] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 14:04:41 2022] GET /compute/v2.1/servers/165f6084-ac1a-4348-b7bb-9c2f6652f804 => generated 1680 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 14:04:42.787466 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-b66dd82d-5aca-464c-9c4f-5a48d670a0e6 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 14:04:42.788119 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-b66dd82d-5aca-464c-9c4f-5a48d670a0e6 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] [instance: 165f6084-ac1a-4348-b7bb-9c2f6652f804] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 14:04:42.796265 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-b66dd82d-5aca-464c-9c4f-5a48d670a0e6 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:04:42.796808 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-b66dd82d-5aca-464c-9c4f-5a48d670a0e6 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:04:42.797206 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-b66dd82d-5aca-464c-9c4f-5a48d670a0e6 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:04:42.797924 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-b66dd82d-5aca-464c-9c4f-5a48d670a0e6 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:04:42.798383 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-b66dd82d-5aca-464c-9c4f-5a48d670a0e6 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:04:42.798879 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-b66dd82d-5aca-464c-9c4f-5a48d670a0e6 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:04:42.910419 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.policy [None req-b66dd82d-5aca-464c-9c4f-5a48d670a0e6 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10fc1a48c9c41eaa1bf3ff2e4109657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1976b27e84a4484ba9d46a4244b08699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125243) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 14:04:42.919048 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-b66dd82d-5aca-464c-9c4f-5a48d670a0e6 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] 10.222.0.36 "GET /compute/v2.1/servers/165f6084-ac1a-4348-b7bb-9c2f6652f804" status: 200 len: 1613 microversion: 2.1 time: 0.136401 Oct 15 14:04:42.919652 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 583/1171] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 14:04:42 2022] GET /compute/v2.1/servers/165f6084-ac1a-4348-b7bb-9c2f6652f804 => generated 1613 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 14:04:43.167930 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [req-04ac7613-66e2-41e2-bebc-40ed7ce66b94 req-2423bba0-5abc-42d2-9823-945b6d866026 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "165f6084-ac1a-4348-b7bb-9c2f6652f804", "name": "network-vif-deleted", "tag": "512f7ddf-b05b-425b-a250-3833a6c71721"}]} {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 14:04:43.178416 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [req-04ac7613-66e2-41e2-bebc-40ed7ce66b94 req-2423bba0-5abc-42d2-9823-945b6d866026 service nova] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:04:43.178893 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [req-04ac7613-66e2-41e2-bebc-40ed7ce66b94 req-2423bba0-5abc-42d2-9823-945b6d866026 service nova] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:04:43.179318 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [req-04ac7613-66e2-41e2-bebc-40ed7ce66b94 req-2423bba0-5abc-42d2-9823-945b6d866026 service nova] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:04:43.194113 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.compute.server_external_events [req-04ac7613-66e2-41e2-bebc-40ed7ce66b94 req-2423bba0-5abc-42d2-9823-945b6d866026 service nova] Creating event network-vif-deleted:512f7ddf-b05b-425b-a250-3833a6c71721 for instance 165f6084-ac1a-4348-b7bb-9c2f6652f804 on hv-cinder-86149 Oct 15 14:04:43.199439 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [req-04ac7613-66e2-41e2-bebc-40ed7ce66b94 req-2423bba0-5abc-42d2-9823-945b6d866026 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035288 Oct 15 14:04:43.203521 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 589/1172] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 15 14:04:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 14:04:43.943231 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-d79f7a82-5b12-49f0-a935-359b209e838e tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 14:04:43.943997 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-d79f7a82-5b12-49f0-a935-359b209e838e tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] [instance: 165f6084-ac1a-4348-b7bb-9c2f6652f804] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 14:04:43.951031 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-d79f7a82-5b12-49f0-a935-359b209e838e tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:04:43.951494 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-d79f7a82-5b12-49f0-a935-359b209e838e tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:04:43.951969 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-d79f7a82-5b12-49f0-a935-359b209e838e tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:04:43.952696 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-d79f7a82-5b12-49f0-a935-359b209e838e tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:04:43.953219 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-d79f7a82-5b12-49f0-a935-359b209e838e tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:04:43.953595 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-d79f7a82-5b12-49f0-a935-359b209e838e tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:04:43.968120 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.wsgi [None req-d79f7a82-5b12-49f0-a935-359b209e838e tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] HTTP exception thrown: Instance 165f6084-ac1a-4348-b7bb-9c2f6652f804 could not be found. Oct 15 14:04:43.970151 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-d79f7a82-5b12-49f0-a935-359b209e838e tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Request method failure captured: Oct 15 14:04:43.970151 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: request: GET /compute/v2.1/servers/165f6084-ac1a-4348-b7bb-9c2f6652f804 HTTP/1.1 Oct 15 14:04:43.970151 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: Accept: application/json Oct 15 14:04:43.970151 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: Accept-Encoding: identity Oct 15 14:04:43.970151 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: Connection: close Oct 15 14:04:43.970151 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: Content-Length: 0 Oct 15 14:04:43.970151 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: Content-Type: application/json Oct 15 14:04:43.970151 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: Host: 10.222.0.36 Oct 15 14:04:43.970151 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: Openstack-System-Scope: None Oct 15 14:04:43.970151 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: User-Agent: python-urllib3/1.26.12 Oct 15 14:04:43.970151 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Auth-Token: gAAAAABjSrwjLfc9eO9Ga-oGlJy_0-kXrWYl6E9iQsuiX0FzsrMojKgz761L4MHPRenZAoUO0wQyqfJ45bvEQq8ApfN15Y_P6uN8Md3wWVEiU_I4JYoXqcUDzANpGGWqTMo-HatpcMRcOiXDjsl3AXX5mHMNQbkMjtIRLTfF6ftg2a6TfPRcK1g Oct 15 14:04:43.970151 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Domain-Id: None Oct 15 14:04:43.970151 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Domain-Name: None Oct 15 14:04:43.970151 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Identity-Status: Confirmed Oct 15 14:04:43.970151 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Is-Admin-Project: True Oct 15 14:04:43.970151 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Project-Domain-Id: default Oct 15 14:04:43.970151 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Project-Domain-Name: Default Oct 15 14:04:43.970151 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Project-Id: 1976b27e84a4484ba9d46a4244b08699 Oct 15 14:04:43.970151 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Project-Name: tempest-AttachVolumeNegativeTest-20916687 Oct 15 14:04:43.970151 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Role: member,reader Oct 15 14:04:43.970151 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Roles: member,reader Oct 15 14:04:43.971990 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_1976b27e84a4484ba9d46a4244b08699", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/1976b27e84a4484ba9d46a4244b08699"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/1976b27e84a4484ba9d46a4244b08699"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/1976b27e84a4484ba9d46a4244b08699"}]}] Oct 15 14:04:43.971990 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Tenant: tempest-AttachVolumeNegativeTest-20916687 Oct 15 14:04:43.971990 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Tenant-Id: 1976b27e84a4484ba9d46a4244b08699 Oct 15 14:04:43.971990 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-20916687 Oct 15 14:04:43.971990 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-User: tempest-AttachVolumeNegativeTest-20916687-project Oct 15 14:04:43.971990 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-User-Domain-Id: default Oct 15 14:04:43.971990 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-User-Domain-Name: Default Oct 15 14:04:43.971990 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-User-Id: a10fc1a48c9c41eaa1bf3ff2e4109657 Oct 15 14:04:43.971990 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-User-Name: tempest-AttachVolumeNegativeTest-20916687-project Oct 15 14:04:43.971990 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: method: > Oct 15 14:04:43.971990 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: exception: Instance 165f6084-ac1a-4348-b7bb-9c2f6652f804 could not be found. Oct 15 14:04:43.971990 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: action_args: {'id': '165f6084-ac1a-4348-b7bb-9c2f6652f804'} Oct 15 14:04:43.973209 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 15 14:04:43.973209 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 14:04:43.973209 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 15 14:04:43.973209 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 15 14:04:43.973209 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 15 14:04:43.973209 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 15 14:04:43.973209 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 15 14:04:43.973209 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 15 14:04:43.973209 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 15 14:04:43.973209 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 15 14:04:43.973209 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 165f6084-ac1a-4348-b7bb-9c2f6652f804 could not be found. Oct 15 14:04:43.973209 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Oct 15 14:04:43.973209 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 14:04:43.973209 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Oct 15 14:04:43.973209 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 14:04:43.973209 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 14:04:43.973209 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 14:04:43.973209 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 15 14:04:43.973209 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 15 14:04:43.973209 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 15 14:04:43.974866 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 15 14:04:43.974866 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 15 14:04:43.974866 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 15 14:04:43.974866 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 15 14:04:43.974866 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 15 14:04:43.974866 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 15 14:04:43.974866 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 15 14:04:43.974866 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 165f6084-ac1a-4348-b7bb-9c2f6652f804 could not be found. Oct 15 14:04:43.974866 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Oct 15 14:04:43.974866 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 14:04:43.974866 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Oct 15 14:04:43.974866 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 14:04:43.974866 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 14:04:43.974866 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 14:04:43.974866 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 15 14:04:43.974866 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 15 14:04:43.974866 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 165f6084-ac1a-4348-b7bb-9c2f6652f804 could not be found. Oct 15 14:04:43.974866 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Oct 15 14:04:43.976433 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-d79f7a82-5b12-49f0-a935-359b209e838e tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Returning 404 to user: Instance 165f6084-ac1a-4348-b7bb-9c2f6652f804 could not be found. {{(pid=125243) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 15 14:04:43.976433 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-d79f7a82-5b12-49f0-a935-359b209e838e tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] 10.222.0.36 "GET /compute/v2.1/servers/165f6084-ac1a-4348-b7bb-9c2f6652f804" status: 404 len: 111 microversion: 2.1 time: 0.032323 Oct 15 14:04:43.976433 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 584/1173] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 14:04:43 2022] GET /compute/v2.1/servers/165f6084-ac1a-4348-b7bb-9c2f6652f804 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 15 14:04:43.981618 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-d7e2b2f5-e1e9-459f-81e9-c9e34afb41a4 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Calling method '.version_select at 0x7f1b5e12a700>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 14:04:44.003316 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-d7e2b2f5-e1e9-459f-81e9-c9e34afb41a4 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1597839276" status: 202 len: 0 microversion: 2.1 time: 0.025884 Oct 15 14:04:44.004017 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 590/1174] 10.222.0.36 () {58 vars in 1221 bytes} [Sat Oct 15 14:04:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1597839276 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 15 14:04:45.812733 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-9136ab79-b720-4dc6-9bd6-7a1a0b3faa51 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 14:04:45.813322 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-9136ab79-b720-4dc6-9bd6-7a1a0b3faa51 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] [instance: 165f6084-ac1a-4348-b7bb-9c2f6652f804] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 14:04:45.823047 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-9136ab79-b720-4dc6-9bd6-7a1a0b3faa51 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:04:45.823965 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-9136ab79-b720-4dc6-9bd6-7a1a0b3faa51 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:04:45.824487 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-9136ab79-b720-4dc6-9bd6-7a1a0b3faa51 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:04:45.825518 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-9136ab79-b720-4dc6-9bd6-7a1a0b3faa51 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:04:45.826065 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-9136ab79-b720-4dc6-9bd6-7a1a0b3faa51 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:04:45.826678 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-9136ab79-b720-4dc6-9bd6-7a1a0b3faa51 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:04:45.844859 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.wsgi [None req-9136ab79-b720-4dc6-9bd6-7a1a0b3faa51 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] HTTP exception thrown: Instance 165f6084-ac1a-4348-b7bb-9c2f6652f804 could not be found. Oct 15 14:04:45.846422 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-9136ab79-b720-4dc6-9bd6-7a1a0b3faa51 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Request method failure captured: Oct 15 14:04:45.846422 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: request: DELETE /compute/v2.1/servers/165f6084-ac1a-4348-b7bb-9c2f6652f804 HTTP/1.1 Oct 15 14:04:45.846422 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: Accept: application/json Oct 15 14:04:45.846422 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: Accept-Encoding: identity Oct 15 14:04:45.846422 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: Connection: close Oct 15 14:04:45.846422 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: Content-Length: 0 Oct 15 14:04:45.846422 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: Content-Type: application/json Oct 15 14:04:45.846422 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: Host: 10.222.0.36 Oct 15 14:04:45.846422 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: Openstack-System-Scope: None Oct 15 14:04:45.846422 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: User-Agent: python-urllib3/1.26.12 Oct 15 14:04:45.846422 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Auth-Token: gAAAAABjSrwjLfc9eO9Ga-oGlJy_0-kXrWYl6E9iQsuiX0FzsrMojKgz761L4MHPRenZAoUO0wQyqfJ45bvEQq8ApfN15Y_P6uN8Md3wWVEiU_I4JYoXqcUDzANpGGWqTMo-HatpcMRcOiXDjsl3AXX5mHMNQbkMjtIRLTfF6ftg2a6TfPRcK1g Oct 15 14:04:45.846422 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Domain-Id: None Oct 15 14:04:45.846422 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Domain-Name: None Oct 15 14:04:45.846422 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Identity-Status: Confirmed Oct 15 14:04:45.846422 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Is-Admin-Project: True Oct 15 14:04:45.846422 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Project-Domain-Id: default Oct 15 14:04:45.846422 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Project-Domain-Name: Default Oct 15 14:04:45.846422 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Project-Id: 1976b27e84a4484ba9d46a4244b08699 Oct 15 14:04:45.846422 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Project-Name: tempest-AttachVolumeNegativeTest-20916687 Oct 15 14:04:45.846422 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Role: member,reader Oct 15 14:04:45.846422 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Roles: member,reader Oct 15 14:04:45.848300 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_1976b27e84a4484ba9d46a4244b08699", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/1976b27e84a4484ba9d46a4244b08699"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/1976b27e84a4484ba9d46a4244b08699"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/1976b27e84a4484ba9d46a4244b08699"}]}] Oct 15 14:04:45.848300 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Tenant: tempest-AttachVolumeNegativeTest-20916687 Oct 15 14:04:45.848300 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Tenant-Id: 1976b27e84a4484ba9d46a4244b08699 Oct 15 14:04:45.848300 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-20916687 Oct 15 14:04:45.848300 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-User: tempest-AttachVolumeNegativeTest-20916687-project Oct 15 14:04:45.848300 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-User-Domain-Id: default Oct 15 14:04:45.848300 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-User-Domain-Name: Default Oct 15 14:04:45.848300 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-User-Id: a10fc1a48c9c41eaa1bf3ff2e4109657 Oct 15 14:04:45.848300 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-User-Name: tempest-AttachVolumeNegativeTest-20916687-project Oct 15 14:04:45.848300 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: method: > Oct 15 14:04:45.848300 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: exception: Instance 165f6084-ac1a-4348-b7bb-9c2f6652f804 could not be found. Oct 15 14:04:45.848300 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: action_args: {'id': '165f6084-ac1a-4348-b7bb-9c2f6652f804'} Oct 15 14:04:45.849288 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 15 14:04:45.849288 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 14:04:45.849288 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 15 14:04:45.849288 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 15 14:04:45.849288 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 15 14:04:45.849288 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 15 14:04:45.849288 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 15 14:04:45.849288 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 15 14:04:45.849288 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 15 14:04:45.849288 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 15 14:04:45.849288 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 165f6084-ac1a-4348-b7bb-9c2f6652f804 could not be found. Oct 15 14:04:45.849288 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Oct 15 14:04:45.849288 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 14:04:45.849288 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Oct 15 14:04:45.849288 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 14:04:45.849288 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 14:04:45.849288 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 14:04:45.849288 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 15 14:04:45.849288 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 15 14:04:45.849288 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 15 14:04:45.850942 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 15 14:04:45.850942 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 15 14:04:45.850942 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 15 14:04:45.850942 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 15 14:04:45.850942 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 15 14:04:45.850942 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 15 14:04:45.850942 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 15 14:04:45.850942 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 15 14:04:45.850942 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 15 14:04:45.850942 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 165f6084-ac1a-4348-b7bb-9c2f6652f804 could not be found. Oct 15 14:04:45.850942 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Oct 15 14:04:45.850942 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 14:04:45.850942 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Oct 15 14:04:45.850942 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 14:04:45.850942 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 14:04:45.850942 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 14:04:45.850942 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 15 14:04:45.850942 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 15 14:04:45.850942 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 165f6084-ac1a-4348-b7bb-9c2f6652f804 could not be found. Oct 15 14:04:45.850942 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Oct 15 14:04:45.852595 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-9136ab79-b720-4dc6-9bd6-7a1a0b3faa51 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Returning 404 to user: Instance 165f6084-ac1a-4348-b7bb-9c2f6652f804 could not be found. {{(pid=125243) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 15 14:04:45.852595 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-9136ab79-b720-4dc6-9bd6-7a1a0b3faa51 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] 10.222.0.36 "DELETE /compute/v2.1/servers/165f6084-ac1a-4348-b7bb-9c2f6652f804" status: 404 len: 111 microversion: 2.1 time: 0.039033 Oct 15 14:04:45.852595 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 585/1175] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 15 14:04:45 2022] DELETE /compute/v2.1/servers/165f6084-ac1a-4348-b7bb-9c2f6652f804 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 15 14:04:45.856778 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-0f38c6ba-472e-4633-b651-d0a60d978100 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 14:04:45.857510 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-0f38c6ba-472e-4633-b651-d0a60d978100 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] [instance: 165f6084-ac1a-4348-b7bb-9c2f6652f804] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 14:04:45.865033 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-0f38c6ba-472e-4633-b651-d0a60d978100 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:04:45.865516 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-0f38c6ba-472e-4633-b651-d0a60d978100 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:04:45.865947 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-0f38c6ba-472e-4633-b651-d0a60d978100 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:04:45.866627 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-0f38c6ba-472e-4633-b651-d0a60d978100 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:04:45.867071 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-0f38c6ba-472e-4633-b651-d0a60d978100 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:04:45.867484 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-0f38c6ba-472e-4633-b651-d0a60d978100 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:04:45.883015 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.wsgi [None req-0f38c6ba-472e-4633-b651-d0a60d978100 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] HTTP exception thrown: Instance 165f6084-ac1a-4348-b7bb-9c2f6652f804 could not be found. Oct 15 14:04:45.884724 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-0f38c6ba-472e-4633-b651-d0a60d978100 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Request method failure captured: Oct 15 14:04:45.884724 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: request: GET /compute/v2.1/servers/165f6084-ac1a-4348-b7bb-9c2f6652f804 HTTP/1.1 Oct 15 14:04:45.884724 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Accept: application/json Oct 15 14:04:45.884724 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Accept-Encoding: identity Oct 15 14:04:45.884724 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Connection: close Oct 15 14:04:45.884724 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Content-Length: 0 Oct 15 14:04:45.884724 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Content-Type: application/json Oct 15 14:04:45.884724 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Host: 10.222.0.36 Oct 15 14:04:45.884724 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Openstack-System-Scope: None Oct 15 14:04:45.884724 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: User-Agent: python-urllib3/1.26.12 Oct 15 14:04:45.884724 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Auth-Token: gAAAAABjSrwjLfc9eO9Ga-oGlJy_0-kXrWYl6E9iQsuiX0FzsrMojKgz761L4MHPRenZAoUO0wQyqfJ45bvEQq8ApfN15Y_P6uN8Md3wWVEiU_I4JYoXqcUDzANpGGWqTMo-HatpcMRcOiXDjsl3AXX5mHMNQbkMjtIRLTfF6ftg2a6TfPRcK1g Oct 15 14:04:45.884724 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Domain-Id: None Oct 15 14:04:45.884724 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Domain-Name: None Oct 15 14:04:45.884724 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Identity-Status: Confirmed Oct 15 14:04:45.884724 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Is-Admin-Project: True Oct 15 14:04:45.884724 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Project-Domain-Id: default Oct 15 14:04:45.884724 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Project-Domain-Name: Default Oct 15 14:04:45.884724 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Project-Id: 1976b27e84a4484ba9d46a4244b08699 Oct 15 14:04:45.884724 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Project-Name: tempest-AttachVolumeNegativeTest-20916687 Oct 15 14:04:45.884724 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Role: member,reader Oct 15 14:04:45.884724 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Roles: member,reader Oct 15 14:04:45.886283 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_1976b27e84a4484ba9d46a4244b08699", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/1976b27e84a4484ba9d46a4244b08699"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/1976b27e84a4484ba9d46a4244b08699"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/1976b27e84a4484ba9d46a4244b08699"}]}] Oct 15 14:04:45.886283 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Tenant: tempest-AttachVolumeNegativeTest-20916687 Oct 15 14:04:45.886283 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Tenant-Id: 1976b27e84a4484ba9d46a4244b08699 Oct 15 14:04:45.886283 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-20916687 Oct 15 14:04:45.886283 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-User: tempest-AttachVolumeNegativeTest-20916687-project Oct 15 14:04:45.886283 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-User-Domain-Id: default Oct 15 14:04:45.886283 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-User-Domain-Name: Default Oct 15 14:04:45.886283 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-User-Id: a10fc1a48c9c41eaa1bf3ff2e4109657 Oct 15 14:04:45.886283 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-User-Name: tempest-AttachVolumeNegativeTest-20916687-project Oct 15 14:04:45.886283 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: method: > Oct 15 14:04:45.886283 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: exception: Instance 165f6084-ac1a-4348-b7bb-9c2f6652f804 could not be found. Oct 15 14:04:45.886283 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: action_args: {'id': '165f6084-ac1a-4348-b7bb-9c2f6652f804'} Oct 15 14:04:45.887435 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 15 14:04:45.887435 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 14:04:45.887435 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 15 14:04:45.887435 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 15 14:04:45.887435 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 15 14:04:45.887435 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 15 14:04:45.887435 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 15 14:04:45.887435 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 15 14:04:45.887435 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 15 14:04:45.887435 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 15 14:04:45.887435 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 165f6084-ac1a-4348-b7bb-9c2f6652f804 could not be found. Oct 15 14:04:45.887435 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Oct 15 14:04:45.887435 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 14:04:45.887435 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Oct 15 14:04:45.887435 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 14:04:45.887435 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 14:04:45.887435 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 14:04:45.887435 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 15 14:04:45.887435 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 15 14:04:45.887435 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 15 14:04:45.890104 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 15 14:04:45.890104 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 15 14:04:45.890104 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 15 14:04:45.890104 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 15 14:04:45.890104 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 15 14:04:45.890104 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 15 14:04:45.890104 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 15 14:04:45.890104 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 165f6084-ac1a-4348-b7bb-9c2f6652f804 could not be found. Oct 15 14:04:45.890104 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Oct 15 14:04:45.890104 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 14:04:45.890104 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Oct 15 14:04:45.890104 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 14:04:45.890104 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 14:04:45.890104 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 14:04:45.890104 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 15 14:04:45.890104 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 15 14:04:45.890104 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 165f6084-ac1a-4348-b7bb-9c2f6652f804 could not be found. Oct 15 14:04:45.890104 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Oct 15 14:04:45.891755 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-0f38c6ba-472e-4633-b651-d0a60d978100 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Returning 404 to user: Instance 165f6084-ac1a-4348-b7bb-9c2f6652f804 could not be found. {{(pid=125242) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 15 14:04:45.891755 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-0f38c6ba-472e-4633-b651-d0a60d978100 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] 10.222.0.36 "GET /compute/v2.1/servers/165f6084-ac1a-4348-b7bb-9c2f6652f804" status: 404 len: 111 microversion: 2.1 time: 0.033593 Oct 15 14:04:45.891755 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 591/1176] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 14:04:45 2022] GET /compute/v2.1/servers/165f6084-ac1a-4348-b7bb-9c2f6652f804 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 15 14:04:47.049514 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-47f09424-29f5-4529-9edf-cc2f58dee547 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 14:04:47.050275 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-47f09424-29f5-4529-9edf-cc2f58dee547 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] [instance: 023bca17-a19b-4428-9008-ec108226f7f4] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 14:04:47.057198 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-47f09424-29f5-4529-9edf-cc2f58dee547 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:04:47.057686 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-47f09424-29f5-4529-9edf-cc2f58dee547 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:04:47.058127 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-47f09424-29f5-4529-9edf-cc2f58dee547 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:04:47.058830 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-47f09424-29f5-4529-9edf-cc2f58dee547 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:04:47.059281 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-47f09424-29f5-4529-9edf-cc2f58dee547 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:04:47.059717 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-47f09424-29f5-4529-9edf-cc2f58dee547 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:04:47.077561 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.wsgi [None req-47f09424-29f5-4529-9edf-cc2f58dee547 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] HTTP exception thrown: Instance 023bca17-a19b-4428-9008-ec108226f7f4 could not be found. Oct 15 14:04:47.079150 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-47f09424-29f5-4529-9edf-cc2f58dee547 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Request method failure captured: Oct 15 14:04:47.079150 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: request: DELETE /compute/v2.1/servers/023bca17-a19b-4428-9008-ec108226f7f4 HTTP/1.1 Oct 15 14:04:47.079150 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: Accept: application/json Oct 15 14:04:47.079150 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: Accept-Encoding: identity Oct 15 14:04:47.079150 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: Connection: close Oct 15 14:04:47.079150 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: Content-Length: 0 Oct 15 14:04:47.079150 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: Content-Type: application/json Oct 15 14:04:47.079150 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: Host: 10.222.0.36 Oct 15 14:04:47.079150 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: Openstack-System-Scope: None Oct 15 14:04:47.079150 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: User-Agent: python-urllib3/1.26.12 Oct 15 14:04:47.079150 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Auth-Token: gAAAAABjSrwjLfc9eO9Ga-oGlJy_0-kXrWYl6E9iQsuiX0FzsrMojKgz761L4MHPRenZAoUO0wQyqfJ45bvEQq8ApfN15Y_P6uN8Md3wWVEiU_I4JYoXqcUDzANpGGWqTMo-HatpcMRcOiXDjsl3AXX5mHMNQbkMjtIRLTfF6ftg2a6TfPRcK1g Oct 15 14:04:47.079150 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Domain-Id: None Oct 15 14:04:47.079150 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Domain-Name: None Oct 15 14:04:47.079150 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Identity-Status: Confirmed Oct 15 14:04:47.079150 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Is-Admin-Project: True Oct 15 14:04:47.079150 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Project-Domain-Id: default Oct 15 14:04:47.079150 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Project-Domain-Name: Default Oct 15 14:04:47.079150 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Project-Id: 1976b27e84a4484ba9d46a4244b08699 Oct 15 14:04:47.079150 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Project-Name: tempest-AttachVolumeNegativeTest-20916687 Oct 15 14:04:47.079150 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Role: member,reader Oct 15 14:04:47.079150 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Roles: member,reader Oct 15 14:04:47.080995 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_1976b27e84a4484ba9d46a4244b08699", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/1976b27e84a4484ba9d46a4244b08699"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/1976b27e84a4484ba9d46a4244b08699"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/1976b27e84a4484ba9d46a4244b08699"}]}] Oct 15 14:04:47.080995 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Tenant: tempest-AttachVolumeNegativeTest-20916687 Oct 15 14:04:47.080995 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Tenant-Id: 1976b27e84a4484ba9d46a4244b08699 Oct 15 14:04:47.080995 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-20916687 Oct 15 14:04:47.080995 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-User: tempest-AttachVolumeNegativeTest-20916687-project Oct 15 14:04:47.080995 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-User-Domain-Id: default Oct 15 14:04:47.080995 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-User-Domain-Name: Default Oct 15 14:04:47.080995 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-User-Id: a10fc1a48c9c41eaa1bf3ff2e4109657 Oct 15 14:04:47.080995 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-User-Name: tempest-AttachVolumeNegativeTest-20916687-project Oct 15 14:04:47.080995 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: method: > Oct 15 14:04:47.080995 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: exception: Instance 023bca17-a19b-4428-9008-ec108226f7f4 could not be found. Oct 15 14:04:47.080995 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: action_args: {'id': '023bca17-a19b-4428-9008-ec108226f7f4'} Oct 15 14:04:47.082238 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 15 14:04:47.082238 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 14:04:47.082238 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 15 14:04:47.082238 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 15 14:04:47.082238 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 15 14:04:47.082238 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 15 14:04:47.082238 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 15 14:04:47.082238 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 15 14:04:47.082238 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 15 14:04:47.082238 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 15 14:04:47.082238 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 023bca17-a19b-4428-9008-ec108226f7f4 could not be found. Oct 15 14:04:47.082238 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Oct 15 14:04:47.082238 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 14:04:47.082238 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Oct 15 14:04:47.082238 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 14:04:47.082238 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 14:04:47.082238 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 14:04:47.082238 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 15 14:04:47.082238 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 15 14:04:47.082238 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 15 14:04:47.083979 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 15 14:04:47.083979 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 15 14:04:47.083979 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 15 14:04:47.083979 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 15 14:04:47.083979 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 15 14:04:47.083979 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 15 14:04:47.083979 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 15 14:04:47.083979 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 15 14:04:47.083979 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 15 14:04:47.083979 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 023bca17-a19b-4428-9008-ec108226f7f4 could not be found. Oct 15 14:04:47.083979 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Oct 15 14:04:47.083979 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 14:04:47.083979 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Oct 15 14:04:47.083979 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 14:04:47.083979 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 14:04:47.083979 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 14:04:47.083979 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 15 14:04:47.083979 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 15 14:04:47.083979 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 023bca17-a19b-4428-9008-ec108226f7f4 could not be found. Oct 15 14:04:47.083979 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Oct 15 14:04:47.086193 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-47f09424-29f5-4529-9edf-cc2f58dee547 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Returning 404 to user: Instance 023bca17-a19b-4428-9008-ec108226f7f4 could not be found. {{(pid=125243) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 15 14:04:47.086193 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-47f09424-29f5-4529-9edf-cc2f58dee547 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] 10.222.0.36 "DELETE /compute/v2.1/servers/023bca17-a19b-4428-9008-ec108226f7f4" status: 404 len: 111 microversion: 2.1 time: 0.035183 Oct 15 14:04:47.086193 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 586/1177] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 15 14:04:47 2022] DELETE /compute/v2.1/servers/023bca17-a19b-4428-9008-ec108226f7f4 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 15 14:04:47.092373 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-948b98ca-0e32-45f1-bddc-085b58f48194 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 14:04:47.093014 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-948b98ca-0e32-45f1-bddc-085b58f48194 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] [instance: 023bca17-a19b-4428-9008-ec108226f7f4] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 14:04:47.100339 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-948b98ca-0e32-45f1-bddc-085b58f48194 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:04:47.100818 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-948b98ca-0e32-45f1-bddc-085b58f48194 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:04:47.101244 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-948b98ca-0e32-45f1-bddc-085b58f48194 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:04:47.101933 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-948b98ca-0e32-45f1-bddc-085b58f48194 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:04:47.102380 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-948b98ca-0e32-45f1-bddc-085b58f48194 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:04:47.102795 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-948b98ca-0e32-45f1-bddc-085b58f48194 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:04:47.116646 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.wsgi [None req-948b98ca-0e32-45f1-bddc-085b58f48194 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] HTTP exception thrown: Instance 023bca17-a19b-4428-9008-ec108226f7f4 could not be found. Oct 15 14:04:47.118193 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-948b98ca-0e32-45f1-bddc-085b58f48194 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Request method failure captured: Oct 15 14:04:47.118193 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: request: GET /compute/v2.1/servers/023bca17-a19b-4428-9008-ec108226f7f4 HTTP/1.1 Oct 15 14:04:47.118193 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Accept: application/json Oct 15 14:04:47.118193 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Accept-Encoding: identity Oct 15 14:04:47.118193 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Connection: close Oct 15 14:04:47.118193 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Content-Length: 0 Oct 15 14:04:47.118193 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Content-Type: application/json Oct 15 14:04:47.118193 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Host: 10.222.0.36 Oct 15 14:04:47.118193 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Openstack-System-Scope: None Oct 15 14:04:47.118193 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: User-Agent: python-urllib3/1.26.12 Oct 15 14:04:47.118193 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Auth-Token: gAAAAABjSrwjLfc9eO9Ga-oGlJy_0-kXrWYl6E9iQsuiX0FzsrMojKgz761L4MHPRenZAoUO0wQyqfJ45bvEQq8ApfN15Y_P6uN8Md3wWVEiU_I4JYoXqcUDzANpGGWqTMo-HatpcMRcOiXDjsl3AXX5mHMNQbkMjtIRLTfF6ftg2a6TfPRcK1g Oct 15 14:04:47.118193 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Domain-Id: None Oct 15 14:04:47.118193 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Domain-Name: None Oct 15 14:04:47.118193 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Identity-Status: Confirmed Oct 15 14:04:47.118193 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Is-Admin-Project: True Oct 15 14:04:47.118193 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Project-Domain-Id: default Oct 15 14:04:47.118193 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Project-Domain-Name: Default Oct 15 14:04:47.118193 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Project-Id: 1976b27e84a4484ba9d46a4244b08699 Oct 15 14:04:47.118193 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Project-Name: tempest-AttachVolumeNegativeTest-20916687 Oct 15 14:04:47.118193 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Role: member,reader Oct 15 14:04:47.118193 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Roles: member,reader Oct 15 14:04:47.120086 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_1976b27e84a4484ba9d46a4244b08699", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/1976b27e84a4484ba9d46a4244b08699"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/1976b27e84a4484ba9d46a4244b08699"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/1976b27e84a4484ba9d46a4244b08699"}]}] Oct 15 14:04:47.120086 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Tenant: tempest-AttachVolumeNegativeTest-20916687 Oct 15 14:04:47.120086 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Tenant-Id: 1976b27e84a4484ba9d46a4244b08699 Oct 15 14:04:47.120086 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-20916687 Oct 15 14:04:47.120086 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-User: tempest-AttachVolumeNegativeTest-20916687-project Oct 15 14:04:47.120086 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-User-Domain-Id: default Oct 15 14:04:47.120086 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-User-Domain-Name: Default Oct 15 14:04:47.120086 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-User-Id: a10fc1a48c9c41eaa1bf3ff2e4109657 Oct 15 14:04:47.120086 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-User-Name: tempest-AttachVolumeNegativeTest-20916687-project Oct 15 14:04:47.120086 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: method: > Oct 15 14:04:47.120086 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: exception: Instance 023bca17-a19b-4428-9008-ec108226f7f4 could not be found. Oct 15 14:04:47.120086 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: action_args: {'id': '023bca17-a19b-4428-9008-ec108226f7f4'} Oct 15 14:04:47.121255 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 15 14:04:47.121255 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 14:04:47.121255 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 15 14:04:47.121255 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 15 14:04:47.121255 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 15 14:04:47.121255 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 15 14:04:47.121255 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 15 14:04:47.121255 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 15 14:04:47.121255 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 15 14:04:47.121255 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 15 14:04:47.121255 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 023bca17-a19b-4428-9008-ec108226f7f4 could not be found. Oct 15 14:04:47.121255 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Oct 15 14:04:47.121255 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 14:04:47.121255 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Oct 15 14:04:47.121255 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 14:04:47.121255 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 14:04:47.121255 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 14:04:47.121255 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 15 14:04:47.121255 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 15 14:04:47.121255 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 15 14:04:47.123322 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 15 14:04:47.123322 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 15 14:04:47.123322 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 15 14:04:47.123322 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 15 14:04:47.123322 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 15 14:04:47.123322 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 15 14:04:47.123322 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 15 14:04:47.123322 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 023bca17-a19b-4428-9008-ec108226f7f4 could not be found. Oct 15 14:04:47.123322 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Oct 15 14:04:47.123322 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 14:04:47.123322 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Oct 15 14:04:47.123322 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 14:04:47.123322 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 14:04:47.123322 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 14:04:47.123322 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 15 14:04:47.123322 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 15 14:04:47.123322 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 023bca17-a19b-4428-9008-ec108226f7f4 could not be found. Oct 15 14:04:47.123322 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Oct 15 14:04:47.124988 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-948b98ca-0e32-45f1-bddc-085b58f48194 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Returning 404 to user: Instance 023bca17-a19b-4428-9008-ec108226f7f4 could not be found. {{(pid=125242) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 15 14:04:47.124988 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-948b98ca-0e32-45f1-bddc-085b58f48194 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] 10.222.0.36 "GET /compute/v2.1/servers/023bca17-a19b-4428-9008-ec108226f7f4" status: 404 len: 111 microversion: 2.1 time: 0.033572 Oct 15 14:04:47.124988 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 592/1178] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 14:04:47 2022] GET /compute/v2.1/servers/023bca17-a19b-4428-9008-ec108226f7f4 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 15 14:04:47.128566 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-4c593c72-142a-4afc-bd7f-13b0566bff34 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 14:04:47.129108 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-4c593c72-142a-4afc-bd7f-13b0566bff34 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] [instance: 1c2ec1ba-e381-4083-a794-c8ff83beb391] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 14:04:47.136344 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-4c593c72-142a-4afc-bd7f-13b0566bff34 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:04:47.136773 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-4c593c72-142a-4afc-bd7f-13b0566bff34 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:04:47.137204 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-4c593c72-142a-4afc-bd7f-13b0566bff34 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:04:47.137956 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-4c593c72-142a-4afc-bd7f-13b0566bff34 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:04:47.138388 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-4c593c72-142a-4afc-bd7f-13b0566bff34 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:04:47.138811 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-4c593c72-142a-4afc-bd7f-13b0566bff34 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:04:47.153986 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.wsgi [None req-4c593c72-142a-4afc-bd7f-13b0566bff34 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] HTTP exception thrown: Instance 1c2ec1ba-e381-4083-a794-c8ff83beb391 could not be found. Oct 15 14:04:47.155492 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-4c593c72-142a-4afc-bd7f-13b0566bff34 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Request method failure captured: Oct 15 14:04:47.155492 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: request: DELETE /compute/v2.1/servers/1c2ec1ba-e381-4083-a794-c8ff83beb391 HTTP/1.1 Oct 15 14:04:47.155492 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: Accept: application/json Oct 15 14:04:47.155492 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: Accept-Encoding: identity Oct 15 14:04:47.155492 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: Connection: close Oct 15 14:04:47.155492 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: Content-Length: 0 Oct 15 14:04:47.155492 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: Content-Type: application/json Oct 15 14:04:47.155492 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: Host: 10.222.0.36 Oct 15 14:04:47.155492 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: Openstack-System-Scope: None Oct 15 14:04:47.155492 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: User-Agent: python-urllib3/1.26.12 Oct 15 14:04:47.155492 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Auth-Token: gAAAAABjSrwjLfc9eO9Ga-oGlJy_0-kXrWYl6E9iQsuiX0FzsrMojKgz761L4MHPRenZAoUO0wQyqfJ45bvEQq8ApfN15Y_P6uN8Md3wWVEiU_I4JYoXqcUDzANpGGWqTMo-HatpcMRcOiXDjsl3AXX5mHMNQbkMjtIRLTfF6ftg2a6TfPRcK1g Oct 15 14:04:47.155492 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Domain-Id: None Oct 15 14:04:47.155492 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Domain-Name: None Oct 15 14:04:47.155492 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Identity-Status: Confirmed Oct 15 14:04:47.155492 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Is-Admin-Project: True Oct 15 14:04:47.155492 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Project-Domain-Id: default Oct 15 14:04:47.155492 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Project-Domain-Name: Default Oct 15 14:04:47.155492 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Project-Id: 1976b27e84a4484ba9d46a4244b08699 Oct 15 14:04:47.155492 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Project-Name: tempest-AttachVolumeNegativeTest-20916687 Oct 15 14:04:47.155492 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Role: member,reader Oct 15 14:04:47.155492 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Roles: member,reader Oct 15 14:04:47.157371 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_1976b27e84a4484ba9d46a4244b08699", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/1976b27e84a4484ba9d46a4244b08699"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/1976b27e84a4484ba9d46a4244b08699"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/1976b27e84a4484ba9d46a4244b08699"}]}] Oct 15 14:04:47.157371 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Tenant: tempest-AttachVolumeNegativeTest-20916687 Oct 15 14:04:47.157371 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Tenant-Id: 1976b27e84a4484ba9d46a4244b08699 Oct 15 14:04:47.157371 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-20916687 Oct 15 14:04:47.157371 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-User: tempest-AttachVolumeNegativeTest-20916687-project Oct 15 14:04:47.157371 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-User-Domain-Id: default Oct 15 14:04:47.157371 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-User-Domain-Name: Default Oct 15 14:04:47.157371 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-User-Id: a10fc1a48c9c41eaa1bf3ff2e4109657 Oct 15 14:04:47.157371 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-User-Name: tempest-AttachVolumeNegativeTest-20916687-project Oct 15 14:04:47.157371 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: method: > Oct 15 14:04:47.157371 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: exception: Instance 1c2ec1ba-e381-4083-a794-c8ff83beb391 could not be found. Oct 15 14:04:47.157371 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: action_args: {'id': '1c2ec1ba-e381-4083-a794-c8ff83beb391'} Oct 15 14:04:47.158533 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 15 14:04:47.158533 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 14:04:47.158533 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 15 14:04:47.158533 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 15 14:04:47.158533 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 15 14:04:47.158533 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 15 14:04:47.158533 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 15 14:04:47.158533 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 15 14:04:47.158533 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 15 14:04:47.158533 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 15 14:04:47.158533 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c2ec1ba-e381-4083-a794-c8ff83beb391 could not be found. Oct 15 14:04:47.158533 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Oct 15 14:04:47.158533 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 14:04:47.158533 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Oct 15 14:04:47.158533 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 14:04:47.158533 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 14:04:47.158533 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 14:04:47.158533 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 15 14:04:47.158533 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 15 14:04:47.158533 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 15 14:04:47.160280 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 15 14:04:47.160280 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 15 14:04:47.160280 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 15 14:04:47.160280 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 15 14:04:47.160280 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 15 14:04:47.160280 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 15 14:04:47.160280 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 15 14:04:47.160280 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 15 14:04:47.160280 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 15 14:04:47.160280 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c2ec1ba-e381-4083-a794-c8ff83beb391 could not be found. Oct 15 14:04:47.160280 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Oct 15 14:04:47.160280 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 14:04:47.160280 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Oct 15 14:04:47.160280 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 14:04:47.160280 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 14:04:47.160280 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 14:04:47.160280 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 15 14:04:47.160280 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 15 14:04:47.160280 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c2ec1ba-e381-4083-a794-c8ff83beb391 could not be found. Oct 15 14:04:47.160280 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Oct 15 14:04:47.162049 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-4c593c72-142a-4afc-bd7f-13b0566bff34 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Returning 404 to user: Instance 1c2ec1ba-e381-4083-a794-c8ff83beb391 could not be found. {{(pid=125243) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 15 14:04:47.162049 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-4c593c72-142a-4afc-bd7f-13b0566bff34 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] 10.222.0.36 "DELETE /compute/v2.1/servers/1c2ec1ba-e381-4083-a794-c8ff83beb391" status: 404 len: 111 microversion: 2.1 time: 0.032419 Oct 15 14:04:47.162049 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 587/1179] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 15 14:04:47 2022] DELETE /compute/v2.1/servers/1c2ec1ba-e381-4083-a794-c8ff83beb391 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 15 14:04:47.165752 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-41e71d3c-1702-4d96-af28-e100f86062d7 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 14:04:47.166367 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-41e71d3c-1702-4d96-af28-e100f86062d7 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] [instance: 1c2ec1ba-e381-4083-a794-c8ff83beb391] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 14:04:47.173052 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-41e71d3c-1702-4d96-af28-e100f86062d7 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:04:47.173532 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-41e71d3c-1702-4d96-af28-e100f86062d7 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:04:47.173963 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-41e71d3c-1702-4d96-af28-e100f86062d7 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:04:47.174663 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-41e71d3c-1702-4d96-af28-e100f86062d7 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:04:47.175110 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-41e71d3c-1702-4d96-af28-e100f86062d7 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:04:47.175532 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-41e71d3c-1702-4d96-af28-e100f86062d7 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:04:47.189726 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.wsgi [None req-41e71d3c-1702-4d96-af28-e100f86062d7 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] HTTP exception thrown: Instance 1c2ec1ba-e381-4083-a794-c8ff83beb391 could not be found. Oct 15 14:04:47.191269 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-41e71d3c-1702-4d96-af28-e100f86062d7 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Request method failure captured: Oct 15 14:04:47.191269 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: request: GET /compute/v2.1/servers/1c2ec1ba-e381-4083-a794-c8ff83beb391 HTTP/1.1 Oct 15 14:04:47.191269 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Accept: application/json Oct 15 14:04:47.191269 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Accept-Encoding: identity Oct 15 14:04:47.191269 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Connection: close Oct 15 14:04:47.191269 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Content-Length: 0 Oct 15 14:04:47.191269 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Content-Type: application/json Oct 15 14:04:47.191269 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Host: 10.222.0.36 Oct 15 14:04:47.191269 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Openstack-System-Scope: None Oct 15 14:04:47.191269 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: User-Agent: python-urllib3/1.26.12 Oct 15 14:04:47.191269 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Auth-Token: gAAAAABjSrwjLfc9eO9Ga-oGlJy_0-kXrWYl6E9iQsuiX0FzsrMojKgz761L4MHPRenZAoUO0wQyqfJ45bvEQq8ApfN15Y_P6uN8Md3wWVEiU_I4JYoXqcUDzANpGGWqTMo-HatpcMRcOiXDjsl3AXX5mHMNQbkMjtIRLTfF6ftg2a6TfPRcK1g Oct 15 14:04:47.191269 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Domain-Id: None Oct 15 14:04:47.191269 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Domain-Name: None Oct 15 14:04:47.191269 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Identity-Status: Confirmed Oct 15 14:04:47.191269 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Is-Admin-Project: True Oct 15 14:04:47.191269 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Project-Domain-Id: default Oct 15 14:04:47.191269 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Project-Domain-Name: Default Oct 15 14:04:47.191269 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Project-Id: 1976b27e84a4484ba9d46a4244b08699 Oct 15 14:04:47.191269 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Project-Name: tempest-AttachVolumeNegativeTest-20916687 Oct 15 14:04:47.191269 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Role: member,reader Oct 15 14:04:47.191269 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Roles: member,reader Oct 15 14:04:47.193269 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_1976b27e84a4484ba9d46a4244b08699", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/1976b27e84a4484ba9d46a4244b08699"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/1976b27e84a4484ba9d46a4244b08699"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/1976b27e84a4484ba9d46a4244b08699"}]}] Oct 15 14:04:47.193269 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Tenant: tempest-AttachVolumeNegativeTest-20916687 Oct 15 14:04:47.193269 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Tenant-Id: 1976b27e84a4484ba9d46a4244b08699 Oct 15 14:04:47.193269 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-20916687 Oct 15 14:04:47.193269 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-User: tempest-AttachVolumeNegativeTest-20916687-project Oct 15 14:04:47.193269 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-User-Domain-Id: default Oct 15 14:04:47.193269 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-User-Domain-Name: Default Oct 15 14:04:47.193269 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-User-Id: a10fc1a48c9c41eaa1bf3ff2e4109657 Oct 15 14:04:47.193269 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-User-Name: tempest-AttachVolumeNegativeTest-20916687-project Oct 15 14:04:47.193269 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: method: > Oct 15 14:04:47.193269 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: exception: Instance 1c2ec1ba-e381-4083-a794-c8ff83beb391 could not be found. Oct 15 14:04:47.193269 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: action_args: {'id': '1c2ec1ba-e381-4083-a794-c8ff83beb391'} Oct 15 14:04:47.194416 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 15 14:04:47.194416 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 14:04:47.194416 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 15 14:04:47.194416 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 15 14:04:47.194416 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 15 14:04:47.194416 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 15 14:04:47.194416 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 15 14:04:47.194416 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 15 14:04:47.194416 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 15 14:04:47.194416 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 15 14:04:47.194416 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c2ec1ba-e381-4083-a794-c8ff83beb391 could not be found. Oct 15 14:04:47.194416 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Oct 15 14:04:47.194416 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 14:04:47.194416 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Oct 15 14:04:47.194416 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 14:04:47.194416 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 14:04:47.194416 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 14:04:47.194416 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 15 14:04:47.194416 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 15 14:04:47.194416 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 15 14:04:47.196116 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 15 14:04:47.196116 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 15 14:04:47.196116 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 15 14:04:47.196116 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 15 14:04:47.196116 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 15 14:04:47.196116 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 15 14:04:47.196116 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 15 14:04:47.196116 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c2ec1ba-e381-4083-a794-c8ff83beb391 could not be found. Oct 15 14:04:47.196116 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Oct 15 14:04:47.196116 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 14:04:47.196116 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Oct 15 14:04:47.196116 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 14:04:47.196116 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 14:04:47.196116 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 14:04:47.196116 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 15 14:04:47.196116 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 15 14:04:47.196116 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c2ec1ba-e381-4083-a794-c8ff83beb391 could not be found. Oct 15 14:04:47.196116 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Oct 15 14:04:47.197732 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-41e71d3c-1702-4d96-af28-e100f86062d7 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Returning 404 to user: Instance 1c2ec1ba-e381-4083-a794-c8ff83beb391 could not be found. {{(pid=125242) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 15 14:04:47.197732 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-41e71d3c-1702-4d96-af28-e100f86062d7 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] 10.222.0.36 "GET /compute/v2.1/servers/1c2ec1ba-e381-4083-a794-c8ff83beb391" status: 404 len: 111 microversion: 2.1 time: 0.030830 Oct 15 14:04:47.197732 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 593/1180] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 14:04:47 2022] GET /compute/v2.1/servers/1c2ec1ba-e381-4083-a794-c8ff83beb391 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 15 14:04:48.352251 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-1adcac32-b9f7-42ef-b9b9-dd3cb2276ba7 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Calling method '>' {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 14:04:48.352799 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.compute.api [None req-1adcac32-b9f7-42ef-b9b9-dd3cb2276ba7 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] [instance: 00959d34-6e9e-4c3d-a32b-1dfc66397406] Fetching instance by UUID {{(pid=125243) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 14:04:48.359796 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-1adcac32-b9f7-42ef-b9b9-dd3cb2276ba7 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:04:48.360362 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-1adcac32-b9f7-42ef-b9b9-dd3cb2276ba7 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:04:48.360802 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-1adcac32-b9f7-42ef-b9b9-dd3cb2276ba7 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:04:48.361661 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-1adcac32-b9f7-42ef-b9b9-dd3cb2276ba7 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:04:48.362294 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-1adcac32-b9f7-42ef-b9b9-dd3cb2276ba7 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:04:48.362848 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG oslo_concurrency.lockutils [None req-1adcac32-b9f7-42ef-b9b9-dd3cb2276ba7 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:04:48.376803 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.wsgi [None req-1adcac32-b9f7-42ef-b9b9-dd3cb2276ba7 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] HTTP exception thrown: Instance 00959d34-6e9e-4c3d-a32b-1dfc66397406 could not be found. Oct 15 14:04:48.378372 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-1adcac32-b9f7-42ef-b9b9-dd3cb2276ba7 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Request method failure captured: Oct 15 14:04:48.378372 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: request: DELETE /compute/v2.1/servers/00959d34-6e9e-4c3d-a32b-1dfc66397406 HTTP/1.1 Oct 15 14:04:48.378372 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: Accept: application/json Oct 15 14:04:48.378372 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: Accept-Encoding: identity Oct 15 14:04:48.378372 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: Connection: close Oct 15 14:04:48.378372 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: Content-Length: 0 Oct 15 14:04:48.378372 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: Content-Type: application/json Oct 15 14:04:48.378372 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: Host: 10.222.0.36 Oct 15 14:04:48.378372 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: Openstack-System-Scope: None Oct 15 14:04:48.378372 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: User-Agent: python-urllib3/1.26.12 Oct 15 14:04:48.378372 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Auth-Token: gAAAAABjSrwjLfc9eO9Ga-oGlJy_0-kXrWYl6E9iQsuiX0FzsrMojKgz761L4MHPRenZAoUO0wQyqfJ45bvEQq8ApfN15Y_P6uN8Md3wWVEiU_I4JYoXqcUDzANpGGWqTMo-HatpcMRcOiXDjsl3AXX5mHMNQbkMjtIRLTfF6ftg2a6TfPRcK1g Oct 15 14:04:48.378372 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Domain-Id: None Oct 15 14:04:48.378372 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Domain-Name: None Oct 15 14:04:48.378372 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Identity-Status: Confirmed Oct 15 14:04:48.378372 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Is-Admin-Project: True Oct 15 14:04:48.378372 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Project-Domain-Id: default Oct 15 14:04:48.378372 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Project-Domain-Name: Default Oct 15 14:04:48.378372 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Project-Id: 1976b27e84a4484ba9d46a4244b08699 Oct 15 14:04:48.378372 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Project-Name: tempest-AttachVolumeNegativeTest-20916687 Oct 15 14:04:48.378372 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Role: member,reader Oct 15 14:04:48.378372 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Roles: member,reader Oct 15 14:04:48.379986 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_1976b27e84a4484ba9d46a4244b08699", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/1976b27e84a4484ba9d46a4244b08699"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/1976b27e84a4484ba9d46a4244b08699"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/1976b27e84a4484ba9d46a4244b08699"}]}] Oct 15 14:04:48.379986 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Tenant: tempest-AttachVolumeNegativeTest-20916687 Oct 15 14:04:48.379986 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Tenant-Id: 1976b27e84a4484ba9d46a4244b08699 Oct 15 14:04:48.379986 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-20916687 Oct 15 14:04:48.379986 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-User: tempest-AttachVolumeNegativeTest-20916687-project Oct 15 14:04:48.379986 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-User-Domain-Id: default Oct 15 14:04:48.379986 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-User-Domain-Name: Default Oct 15 14:04:48.379986 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-User-Id: a10fc1a48c9c41eaa1bf3ff2e4109657 Oct 15 14:04:48.379986 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: X-User-Name: tempest-AttachVolumeNegativeTest-20916687-project Oct 15 14:04:48.379986 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: method: > Oct 15 14:04:48.379986 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: exception: Instance 00959d34-6e9e-4c3d-a32b-1dfc66397406 could not be found. Oct 15 14:04:48.379986 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: action_args: {'id': '00959d34-6e9e-4c3d-a32b-1dfc66397406'} Oct 15 14:04:48.380875 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: {{(pid=125243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 15 14:04:48.380875 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 14:04:48.380875 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 15 14:04:48.380875 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 15 14:04:48.380875 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 15 14:04:48.380875 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 15 14:04:48.380875 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 15 14:04:48.380875 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 15 14:04:48.380875 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 15 14:04:48.380875 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 15 14:04:48.380875 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00959d34-6e9e-4c3d-a32b-1dfc66397406 could not be found. Oct 15 14:04:48.380875 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Oct 15 14:04:48.380875 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 14:04:48.380875 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Oct 15 14:04:48.380875 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 14:04:48.380875 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 14:04:48.380875 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 14:04:48.380875 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 15 14:04:48.380875 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 15 14:04:48.380875 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 15 14:04:48.382369 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 15 14:04:48.382369 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 15 14:04:48.382369 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 15 14:04:48.382369 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 15 14:04:48.382369 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 15 14:04:48.382369 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 15 14:04:48.382369 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 15 14:04:48.382369 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 15 14:04:48.382369 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 15 14:04:48.382369 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00959d34-6e9e-4c3d-a32b-1dfc66397406 could not be found. Oct 15 14:04:48.382369 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Oct 15 14:04:48.382369 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 14:04:48.382369 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Oct 15 14:04:48.382369 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 14:04:48.382369 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 14:04:48.382369 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 14:04:48.382369 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 15 14:04:48.382369 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 15 14:04:48.382369 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00959d34-6e9e-4c3d-a32b-1dfc66397406 could not be found. Oct 15 14:04:48.382369 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: ERROR nova.api.openstack.wsgi Oct 15 14:04:48.384109 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: DEBUG nova.api.openstack.wsgi [None req-1adcac32-b9f7-42ef-b9b9-dd3cb2276ba7 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Returning 404 to user: Instance 00959d34-6e9e-4c3d-a32b-1dfc66397406 could not be found. {{(pid=125243) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 15 14:04:48.384109 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: INFO nova.api.openstack.requestlog [None req-1adcac32-b9f7-42ef-b9b9-dd3cb2276ba7 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] 10.222.0.36 "DELETE /compute/v2.1/servers/00959d34-6e9e-4c3d-a32b-1dfc66397406" status: 404 len: 111 microversion: 2.1 time: 0.031471 Oct 15 14:04:48.384109 dv-cinder-861491-3-iscsi devstack@n-api.service[125243]: [pid: 125243|app: 0|req: 588/1181] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 15 14:04:48 2022] DELETE /compute/v2.1/servers/00959d34-6e9e-4c3d-a32b-1dfc66397406 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 15 14:04:48.390271 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-1642f1ab-6e53-4177-8eb4-6cb7bd2c24e1 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Calling method '>' {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 14:04:48.390896 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.compute.api [None req-1642f1ab-6e53-4177-8eb4-6cb7bd2c24e1 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] [instance: 00959d34-6e9e-4c3d-a32b-1dfc66397406] Fetching instance by UUID {{(pid=125242) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 14:04:48.397591 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-1642f1ab-6e53-4177-8eb4-6cb7bd2c24e1 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:04:48.398084 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-1642f1ab-6e53-4177-8eb4-6cb7bd2c24e1 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:04:48.398525 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-1642f1ab-6e53-4177-8eb4-6cb7bd2c24e1 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:04:48.399219 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-1642f1ab-6e53-4177-8eb4-6cb7bd2c24e1 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Acquiring lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 14:04:48.399672 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-1642f1ab-6e53-4177-8eb4-6cb7bd2c24e1 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 14:04:48.400131 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG oslo_concurrency.lockutils [None req-1642f1ab-6e53-4177-8eb4-6cb7bd2c24e1 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Lock "7dc09bc6-d873-4fce-bdea-89bf85d4cbce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 14:04:48.414010 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.wsgi [None req-1642f1ab-6e53-4177-8eb4-6cb7bd2c24e1 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] HTTP exception thrown: Instance 00959d34-6e9e-4c3d-a32b-1dfc66397406 could not be found. Oct 15 14:04:48.415576 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-1642f1ab-6e53-4177-8eb4-6cb7bd2c24e1 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Request method failure captured: Oct 15 14:04:48.415576 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: request: GET /compute/v2.1/servers/00959d34-6e9e-4c3d-a32b-1dfc66397406 HTTP/1.1 Oct 15 14:04:48.415576 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Accept: application/json Oct 15 14:04:48.415576 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Accept-Encoding: identity Oct 15 14:04:48.415576 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Connection: close Oct 15 14:04:48.415576 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Content-Length: 0 Oct 15 14:04:48.415576 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Content-Type: application/json Oct 15 14:04:48.415576 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Host: 10.222.0.36 Oct 15 14:04:48.415576 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: Openstack-System-Scope: None Oct 15 14:04:48.415576 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: User-Agent: python-urllib3/1.26.12 Oct 15 14:04:48.415576 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Auth-Token: gAAAAABjSrwjLfc9eO9Ga-oGlJy_0-kXrWYl6E9iQsuiX0FzsrMojKgz761L4MHPRenZAoUO0wQyqfJ45bvEQq8ApfN15Y_P6uN8Md3wWVEiU_I4JYoXqcUDzANpGGWqTMo-HatpcMRcOiXDjsl3AXX5mHMNQbkMjtIRLTfF6ftg2a6TfPRcK1g Oct 15 14:04:48.415576 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Domain-Id: None Oct 15 14:04:48.415576 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Domain-Name: None Oct 15 14:04:48.415576 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Identity-Status: Confirmed Oct 15 14:04:48.415576 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Is-Admin-Project: True Oct 15 14:04:48.415576 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Project-Domain-Id: default Oct 15 14:04:48.415576 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Project-Domain-Name: Default Oct 15 14:04:48.415576 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Project-Id: 1976b27e84a4484ba9d46a4244b08699 Oct 15 14:04:48.415576 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Project-Name: tempest-AttachVolumeNegativeTest-20916687 Oct 15 14:04:48.415576 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Role: member,reader Oct 15 14:04:48.415576 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Roles: member,reader Oct 15 14:04:48.417413 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_1976b27e84a4484ba9d46a4244b08699", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/1976b27e84a4484ba9d46a4244b08699"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/1976b27e84a4484ba9d46a4244b08699"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/1976b27e84a4484ba9d46a4244b08699"}]}] Oct 15 14:04:48.417413 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Tenant: tempest-AttachVolumeNegativeTest-20916687 Oct 15 14:04:48.417413 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Tenant-Id: 1976b27e84a4484ba9d46a4244b08699 Oct 15 14:04:48.417413 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-20916687 Oct 15 14:04:48.417413 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-User: tempest-AttachVolumeNegativeTest-20916687-project Oct 15 14:04:48.417413 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-User-Domain-Id: default Oct 15 14:04:48.417413 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-User-Domain-Name: Default Oct 15 14:04:48.417413 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-User-Id: a10fc1a48c9c41eaa1bf3ff2e4109657 Oct 15 14:04:48.417413 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: X-User-Name: tempest-AttachVolumeNegativeTest-20916687-project Oct 15 14:04:48.417413 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: method: > Oct 15 14:04:48.417413 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: exception: Instance 00959d34-6e9e-4c3d-a32b-1dfc66397406 could not be found. Oct 15 14:04:48.417413 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: action_args: {'id': '00959d34-6e9e-4c3d-a32b-1dfc66397406'} Oct 15 14:04:48.418587 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: {{(pid=125242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 15 14:04:48.418587 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 14:04:48.418587 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 15 14:04:48.418587 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 15 14:04:48.418587 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 15 14:04:48.418587 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 15 14:04:48.418587 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 15 14:04:48.418587 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 15 14:04:48.418587 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 15 14:04:48.418587 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 15 14:04:48.418587 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00959d34-6e9e-4c3d-a32b-1dfc66397406 could not be found. Oct 15 14:04:48.418587 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Oct 15 14:04:48.418587 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 14:04:48.418587 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Oct 15 14:04:48.418587 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 14:04:48.418587 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 14:04:48.418587 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 14:04:48.418587 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 15 14:04:48.418587 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 15 14:04:48.418587 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 15 14:04:48.420302 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 15 14:04:48.420302 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 15 14:04:48.420302 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 15 14:04:48.420302 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 15 14:04:48.420302 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 15 14:04:48.420302 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 15 14:04:48.420302 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 15 14:04:48.420302 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00959d34-6e9e-4c3d-a32b-1dfc66397406 could not be found. Oct 15 14:04:48.420302 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Oct 15 14:04:48.420302 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 14:04:48.420302 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Oct 15 14:04:48.420302 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 14:04:48.420302 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 14:04:48.420302 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 14:04:48.420302 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 15 14:04:48.420302 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 15 14:04:48.420302 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00959d34-6e9e-4c3d-a32b-1dfc66397406 could not be found. Oct 15 14:04:48.420302 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: ERROR nova.api.openstack.wsgi Oct 15 14:04:48.421727 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: DEBUG nova.api.openstack.wsgi [None req-1642f1ab-6e53-4177-8eb4-6cb7bd2c24e1 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] Returning 404 to user: Instance 00959d34-6e9e-4c3d-a32b-1dfc66397406 could not be found. {{(pid=125242) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 15 14:04:48.421727 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: INFO nova.api.openstack.requestlog [None req-1642f1ab-6e53-4177-8eb4-6cb7bd2c24e1 tempest-AttachVolumeNegativeTest-20916687 tempest-AttachVolumeNegativeTest-20916687-project] 10.222.0.36 "GET /compute/v2.1/servers/00959d34-6e9e-4c3d-a32b-1dfc66397406" status: 404 len: 111 microversion: 2.1 time: 0.032344 Oct 15 14:04:48.421727 dv-cinder-861491-3-iscsi devstack@n-api.service[125242]: [pid: 125242|app: 0|req: 594/1182] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 15 14:04:48 2022] GET /compute/v2.1/servers/00959d34-6e9e-4c3d-a32b-1dfc66397406 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0)